NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.

question about output from ncdump -p option

Hello All,
I don't understand the output I'm getting for a float variable when I use the -p option of the ncdump command. For example here is a file where I specified precision of the ncdump utility as -p 4,7: 

// Chl_ctrl(6, 0-95)
  0.006179, 0.005789, 0.002502, 0.002943, 0.003311, 0.003856, 0.006481,
  0.01431, 0.02607, 0.06223, 0.08741, 0.08848, 0.09337, 0.08391, 0.06148,
  0.03593, 0.03441, 0.06112, 0.08778, 0.06033, 0.05429, 0.05096, 0.0419,
  0.01465, 0.01362, 0.005015, 0.004674, 0.0125, 0.0115, 0.01906, 0.00876,
0.01265, 0.01997, 0.04652, 0.1069, 0.207, 0.2227, 0.1509, 0.1123, 0.1001, 
  0.1286, 0.1413, 0.366, 0.3504, 0.2979, 0.2345, 0.1877, 0.1553, 0.1623,
  0.2175, 0.2735, 0.3266, 0.3792, 0.4103, 0.3368, 0.2046, 0.0996, 0.04868,
  0.04047, 0.05427, 0.07043, 0.1198, 0.3692, 0.5651, 0.5157, 0.4695,
  0.4163, 0.3637, 0.3992, 0.3953, 0.3175, 0.2811, 0.2669, 0.2539, 0.1959,
  0.1751, 0.2147, 0.2245, 0.3235, 0.3358, 0.3153, 0.3176, 0.2354, 0.112,
  0.01587, 0.005737, 0.009106, 0.008648, 0.01087, 0.005333, 0.009314,
  0.008883, 0.02158, 0.01859, 0.0059, 0.003995,
Based on the documentation for the ncdump command's -p option I expected to see decimals places of 4 or less, yet I'm getting 6. Here is same variable with precision set at -p 2,2 

// Chl_ctrl(6, 0-95)
  0.0062, 0.0058, 0.0025, 0.0029, 0.0033, 0.0039, 0.0065, 0.014, 0.026,
  0.062, 0.087, 0.088, 0.093, 0.084, 0.061, 0.036, 0.034, 0.061, 0.088,
  0.06, 0.054, 0.051, 0.042, 0.015, 0.014, 0.005, 0.0047, 0.012, 0.012,
  0.019, 0.0088, 0.013, 0.02, 0.047, 0.11, 0.21, 0.22, 0.15, 0.11, 0.1,
  0.13, 0.14, 0.37, 0.35, 0.3, 0.23, 0.19, 0.16, 0.16, 0.22, 0.27, 0.33,
  0.38, 0.41, 0.34, 0.2, 0.1, 0.049, 0.04, 0.054, 0.07, 0.12, 0.37, 0.57,
  0.52, 0.47, 0.42, 0.36, 0.4, 0.4, 0.32, 0.28, 0.27, 0.25, 0.2, 0.18,
  0.21, 0.22, 0.32, 0.34, 0.32, 0.32, 0.24, 0.11, 0.016, 0.0057, 0.0091,
  0.0086, 0.011, 0.0053, 0.0093, 0.0089, 0.022, 0.019, 0.0059, 0.004
I expected to see decimal values of no more than 2 places, yet I'm getting up to 4. Can anyone explain how to interpret what the ncdump utility is giving me? I should mention that I'm also using the -b c option in the same command. 

Any comments would be most appreciated.

Janeen

==============================================================================
To unsubscribe netcdfgroup, visit:
http://www.unidata.ucar.edu/mailing-list-delete-form.html
==============================================================================
  • 2006 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdfgroup archives: