Re: [netcdfgroup] [EXTERNAL] Quantize Support in netCDF-Fortran: Only Bit Groom possible?

• To: Charlie Zender <zender@xxxxxxx>
• Subject: Re: [netcdfgroup] [EXTERNAL] Quantize Support in netCDF-Fortran: Only Bit Groom possible?
• From: "Baker, Lawrence M" <baker@xxxxxxxx>
• Date: Mon, 7 Nov 2022 22:03:43 +0000
• Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=usgs.gov; dmarc=pass action=none header.from=usgs.gov; dkim=pass header.d=usgs.gov; arc=none
• Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=pm8o6nEigWqdID6TpJbXg6OOCFHm1Do77tkKnw9/xq4=; b=DAiUQ7PSSPjfbooArgaiF9BfIHKnwRDnvc4n8UkyehRJMiVvrwyps7ELdTWA0jKUnuhSM3/UZudA51XEi5AY0ZX18H2TQg3FrbuISWGcZWrmHNvEVLrrYhWH9HPKfdDHKnKO4PLb2INTAwf0dMK9G/+nThMda4x7WPo4Tf+BaaLYA5NzrPGRvdGVLPXbw5E3rkqvQ9E2LbzsjJzeWduW9b3YTJBhOrb/WU4kjWiOWEcYOr1Pn2+Z03j864oNsGT6g1rJ47FxBTxRfNSsNHh/KlUnh0upBJgK2T9xQY9YhfMJo3H1hsvvG8+8ctbO4X4BG4QPC9XPO1mH9Dvd0s9FQQ==
• Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=D1W0AyyskPrrs5WtMlKZahU+RveMxuJlFzLr4aL9NXx/rZlgwuKLwNGWUussrzHLCelMxzB+Nt8porMPTy9avIk5VbGcFM6F9C9SjkXYtx9woHkEjbhwb0sUE406iPbrCw0U/z0qJXTlv5+aF+uPdCxXUIW4Pwalke0zbKsj1VriFlpFaH+1pDnwvPTqzjmnZ+asoHWuhVQkvu/ClSSKdRy/0k8o/gvpmLNuDROwVYrwmaU9LZ5njDDU2iDZCyNvapStJMB6MK1ThtnP1Z30CrLorhoJRHOq3O9Z4UiiUt7zfa0JHPVpzsYWfVxQiV6wfQsuMU3QqLpyGtR1O9S0JA==
• Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=usgs.gov;

Charlie,

IEEE
format implicitly defines the first significant bit as 1.

This is true only for normalized IEEE format.  Numbers that are too small to 
represent in the normalized IEEE format use subnormal format.  I do not know 
whether netCDF preserves subnormal numbers 1) in general, or 2) when they are 
compressed.  Whatever the behavior, I recommend it be documented.  (I am not a 
user of netCDF; only an observer of developer conversations.)

Respectfully,

Larry Baker
US Geological Survey (Ret.)
c. 650-784-9650
baker@xxxxxxxx<mailto:baker@xxxxxxxx>



On Nov 7 2022, at 1:54:00 PM, Charlie Zender 
<zender@xxxxxxx<mailto:zender@xxxxxxx>> wrote:



This email has been received from outside of DOI - Use caution before clicking 
on links, opening attachments, or responding.



Hi Matt,

Your understanding of the quantization implementation
is correct on all counts. The actual # of bits per
digit is ln(10)/ln(2) ~ 3.32. And note that netCDF
implementation defines NSB as the number of
_explicitly stored bits_, which is one less than
the number of significant bits because the IEEE
format implicitly defines the first significant bit as 1.
Thus NSB <=23 not <=24.

Charlie
--
Charlie Zender, Earth System Sci. & Computer Sci.
University of California, Irvine 949-891-2429 )'(

_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web.  Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.


netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx>
For list information or to unsubscribe,  visit: 
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.unidata.ucar.edu%2Fmailing_lists%2F&amp;data=05%7C01%7Cbaker%40usgs.gov%7C226de6b252974b9cd45608dac10a9ed7%7C0693b5ba4b184d7b9341f32f400a5494%7C0%7C0%7C638034548601706039%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=YT2h4EFt818Br0rnaQYROxj04C3L%2FjvHKjiy5OXy8vU%3D&amp;reserved=0

• References:
  • Re: [netcdfgroup] Quantize Support in netCDF-Fortran: Only Bit Groom possible?
    • From: Charlie Zender
  • Re: [netcdfgroup] Quantize Support in netCDF-Fortran: Only Bit Groom possible?
    • From: Edward Hartnett - NOAA Affiliate
  • Re: [netcdfgroup] Quantize Support in netCDF-Fortran: Only Bit Groom possible?
    • From: Edward Hartnett - NOAA Affiliate
  • Re: [netcdfgroup] [EXTERNAL] Re: Quantize Support in netCDF-Fortran: Only Bit Groom possible?
    • From: Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND APPLICATIONS INC]
  • Re: [netcdfgroup] Quantize Support in netCDF-Fortran: Only Bit Groom possible?
    • From: Charlie Zender