If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. |
|
|
Thread Tools | Display Modes |
#1
|
|||
|
|||
Excel 's precision problem
Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's implemention.ex: in Excel :gammaln(4)=1.79175946908210000 but it is 1.791759469228055 in MATLAB and Mathematica !! Same problem in function erf(),and so on! Some one who know the detail?? Thank you ! |
#2
|
|||
|
|||
Excel 's precision problem
"chenj" wrote in message ... Now I found Excel' precision is not very hign ! May be there is some problem in some Excel funcion's implemention.ex: in Excel :gammaln(4)=1.79175946908210000 but it is 1.791759469228055 in MATLAB and Mathematica !! Same problem in function erf(),and so on! According to my version of excel (2000) it evaluates to: 1.7917594690821 Numerically equal to your quoted value of 1.79175946908210000 but without the implicit level of precision that your trailing zeros might carry. I guess that you have to accept that it is only correct to 9 d.p.or 10 s.f. If you need more precision that that, you probably need to stick to dedicated apps. Alan. |
#3
|
|||
|
|||
Excel 's precision problem
-----Original Message----- "chenj" wrote in message ... Now I found Excel' precision is not very hign ! May be there is some problem in some Excel funcion's implemention.ex: in Excel :gammaln(4)=1.79175946908210000 but it is 1.791759469228055 in MATLAB and Mathematica !! Same problem in function erf(),and so on! hi I don't know what you said. would you told me more! Thank you ! According to my version of excel (2000) it evaluates to: 1.7917594690821 Numerically equal to your quoted value of 1.79175946908210000 but without the implicit level of precision that your trailing zeros might carry. I guess that you have to accept that it is only correct to 9 d.p.or 10 s.f. If you need more precision that that, you probably need to stick to dedicated apps. Alan. . |
#4
|
|||
|
|||
Excel 's precision problem
-----Original Message----- "chenj" wrote in message ... Now I found Excel' precision is not very hign ! May be there is some problem in some Excel funcion's implemention.ex: in Excel :gammaln(4)=1.79175946908210000 but it is 1.791759469228055 in MATLAB and Mathematica !! Same problem in function erf(),and so on! hi I don't know what you said. would you told me more! Thank you ! According to my version of excel (2000) it evaluates to: 1.7917594690821 Numerically equal to your quoted value of 1.79175946908210000 but without the implicit level of precision that your trailing zeros might carry. I guess that you have to accept that it is only correct to 9 d.p.or 10 s.f. If you need more precision that that, you probably need to stick to dedicated apps. Alan. . |
#5
|
|||
|
|||
Excel 's precision problem
-----Original Message----- "chenj" wrote in message ... Now I found Excel' precision is not very hign ! May be there is some problem in some Excel funcion's implemention.ex: in Excel :gammaln(4)=1.79175946908210000 but it is 1.791759469228055 in MATLAB and Mathematica !! Same problem in function erf(),and so on! hi I don't know what you said. would you told me more! Thank you ! According to my version of excel (2000) it evaluates to: 1.7917594690821 Numerically equal to your quoted value of 1.79175946908210000 but without the implicit level of precision that your trailing zeros might carry. I guess that you have to accept that it is only correct to 9 d.p.or 10 s.f. If you need more precision that that, you probably need to stick to dedicated apps. Alan. . |
#6
|
|||
|
|||
Excel 's precision problem
Hi Chenj / Chengj
"chengj" wrote in message ... hi I don't know what you said. would you told me more! Thank you ! Which part did you not understand? Essentially, I am saying that excel is not a high precision mathematical application. If you need that level of precision, I think you'll need to use a different tool. Other opinions are welcome! Alan. |
Thread Tools | |
Display Modes | |
|
|