If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. |
|
|
Thread Tools | Display Modes |
#1
|
|||
|
|||
Unable to calculate std dev for any value with 6 or more digits to the left dec.
I am unable to obtain the standard deviation for any value
with six or more digits to the left of the decimal. The values are coordinates, usually with six or seven digits to the left of the decimal and three to the right. Found four types of standard deviation in the Microsoft Excel help menus. 1) STDEV - will work with values up to five places left of the decimal point. 2) STDEVA - will work with values up to five places left of the decimal point. 3) STDEVP - will work with values up to five places left of the decimal point. 4) STDEVPA - will work with values up to five places left of the decimal point. The STDEVP and STDEVPA give the values that are expected. For values with six, seven, eight or nine digits to the left of the decimal, a wrong value or zero is obtained, depending on the number of values in the list. Is there a problem with larger values? Any help would be appreciated. Thanks. |
Thread Tools | |
Display Modes | |
|
|