A Microsoft Office (Excel, Word) forum. OfficeFrustration

If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

Go Back   Home » OfficeFrustration forum » Microsoft Excel » Setting up and Configuration
Site Map Home Register Authors List Search Today's Posts Mark Forums Read  

Excel 's precision problem



 
 
Thread Tools Display Modes
  #1  
Old November 13th, 2003, 09:18 AM
chenj
external usenet poster
 
Posts: n/a
Default Excel 's precision problem

Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!


Some one who know the detail??


Thank you !
  #2  
Old November 13th, 2003, 09:32 AM
Alan
external usenet poster
 
Posts: n/a
Default Excel 's precision problem


"chenj" wrote in message
...

Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!


According to my version of excel (2000) it evaluates to:

1.7917594690821

Numerically equal to your quoted value of 1.79175946908210000 but
without the implicit level of precision that your trailing zeros might
carry.

I guess that you have to accept that it is only correct to 9 d.p.or 10
s.f. If you need more precision that that, you probably need to stick
to dedicated apps.

Alan.


  #3  
Old November 13th, 2003, 10:02 AM
chengj
external usenet poster
 
Posts: n/a
Default Excel 's precision problem


-----Original Message-----

"chenj" wrote in

message
...

Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!



hi
I don't know what you said.
would you told me more!

Thank you !
According to my version of excel (2000) it evaluates to:

1.7917594690821

Numerically equal to your quoted value of

1.79175946908210000 but
without the implicit level of precision that your

trailing zeros might
carry.

I guess that you have to accept that it is only correct

to 9 d.p.or 10
s.f. If you need more precision that that, you probably

need to stick
to dedicated apps.

Alan.


.

  #4  
Old November 13th, 2003, 10:02 AM
chengj
external usenet poster
 
Posts: n/a
Default Excel 's precision problem


-----Original Message-----

"chenj" wrote in

message
...

Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!



hi
I don't know what you said.
would you told me more!

Thank you !
According to my version of excel (2000) it evaluates to:

1.7917594690821

Numerically equal to your quoted value of

1.79175946908210000 but
without the implicit level of precision that your

trailing zeros might
carry.

I guess that you have to accept that it is only correct

to 9 d.p.or 10
s.f. If you need more precision that that, you probably

need to stick
to dedicated apps.

Alan.


.

  #5  
Old November 13th, 2003, 10:02 AM
chengj
external usenet poster
 
Posts: n/a
Default Excel 's precision problem


-----Original Message-----

"chenj" wrote in

message
...

Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!



hi
I don't know what you said.
would you told me more!

Thank you !
According to my version of excel (2000) it evaluates to:

1.7917594690821

Numerically equal to your quoted value of

1.79175946908210000 but
without the implicit level of precision that your

trailing zeros might
carry.

I guess that you have to accept that it is only correct

to 9 d.p.or 10
s.f. If you need more precision that that, you probably

need to stick
to dedicated apps.

Alan.


.

  #6  
Old November 13th, 2003, 10:16 AM
Alan
external usenet poster
 
Posts: n/a
Default Excel 's precision problem

Hi Chenj / Chengj

"chengj" wrote in message
...

hi
I don't know what you said.
would you told me more!

Thank you !


Which part did you not understand?

Essentially, I am saying that excel is not a high precision
mathematical application.

If you need that level of precision, I think you'll need to use a
different tool.

Other opinions are welcome!

Alan.


 




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump


All times are GMT +1. The time now is 12:19 AM.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright ©2004-2024 OfficeFrustration.
The comments are property of their posters.