[thredds] Trouble with TDS accessing data

• To: "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx>
• Subject: [thredds] Trouble with TDS accessing data
• From: "Brown, Mitchell E (Mitch) CIV USARMY CEERD-CHL (USA)" <Mitchell.E.Brown@xxxxxxxxxxxxxx>
• Date: Mon, 26 Jun 2023 17:00:04 +0000
• Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=usace.army.mil; dmarc=pass action=none header.from=usace.army.mil; dkim=pass header.d=usace.army.mil; arc=none
• Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector5501; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=cmigoZX+WuShianrYR8E1BByP0NVcEaPQ7tHmS5T4lw=; b=oGsPe5Dqtnb89U9aqd3AzCXb6O+J9BTaPheIroFAGlPyDi/9TA1mOPKf7gxumzXZjUbnklDqmfbIwFUvhQWqEUS/ZMDF3E+ZeVVEHxohvOJQ67uXlH691b4qqRMjWf9pCY6VomAtkw/rZNmbCjRR9QJRFGjuWtezDxMGdId4t1RIpW4OU8BUorLrr0X9+GwoTxUWvIMbT1IjE/9TtXmj3yO8cj/EFuUBzygo0yWTe19Gi4Aap3qDTYpKsOc7jfzEQX2mhNRbl8HXBtekYMtWuQhvI2bUZTZaGynk5Mvz1C7WIKCCvg4TEGk8kLyVgsZ5BW3tyC4hvgcA/KqpuoFwtA==
• Arc-seal: i=1; a=rsa-sha256; s=arcselector5501; d=microsoft.com; cv=none; b=NyFlXXK/xOfG9q0i+TydQbbdmU9BDKsmm7NVyeGqTIUmzgnq/OT0dyixxkuHCpski/1qJd7j3P67iReB3KYueK4sOCIu8EBersGUoCl5pZh1uVL47Yr7HdgD7CwZ0UJ3LE4c7wFBuxBLHnD4UdzfCaVbUY8F4NWwCyzvGZ/MScZY06Z4wr4/iINyS7l8I1uI38f/DgGfytCX7iBvfeIqCAuNO79YUs5Ua9Ad8VHW95rfYIgLFkwvp/JYDTgphT5HX59s2vA7YQd2YLfTVLEimUiV6ulUi4/Aos21V5Sz1JBZI6MdOkhNzh+Zc820kcBQrZDdd1sOh/N5A+h+U/+uxg==
• Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=usace.army.mil;
• Ironport-data: A9a23:bJkRzKtZ76v8SysschBlqCQqZefnVOZcMUV32f8akzHdYApBsoF/q tZmKT2PbP3cZjD1e4x+aoy2oEMO75SDzdQwHgdrqilhQygb9ZOVVN+UEBz9bniYRiHhoOOLz Cm8hv3odp1coqr0/0/1WlTZhSAgk/vOH9IQMcacUghpXwhoVSw9vhxqnu89k+ZAjMOwa++3k YuaT/b3Zhn9glaYDkpOs/jY8E014qyo0N8llgRWic5j7Qe2e0Y9Ucp3yZGZdxPQXoRSF+imc OfPpJnRErTxon/Bovv8+lrKWhViroz6ZGBiuVIPM0SWuSWukwRpukoN2FrwXm8M49mBt4gZJ NygLvVcQy9xVkHHsLx1vxW1j0iSMIUekIIrL0RTvuS09EyZfn/O8s82K2wNFspBovY0GCZRo KlwxDAlNnhvhsq53+79V/JljcllJdPuLcUau3UIITPxVKt7B8+fBf+XuZkChGZYasNmRJ4yY +I8aCZkbBnEZ1tifH0ND404tPqzj3LyNTRCrUPToKszi4TW5FAsiOe9aIOOKrRmQ+1ns1S+t Hjv0170D08jKeKmiiOhrnCV07qncSTTHdh6+KeD3uJqmlCfync7FRsXWVKnqL+kgUekHd9TN iQpFjEGorduslGwR9LwGRSipW/Cux8YMzZNL9AHBMi24vK8y26k6qIsF1attPROWBcKeAEX
• Ironport-hdrordr: A9a23:Qb/Wtqom7NZ3M0rASn+gqYwaV5vdL9V00zEX/kB9WHVpm5Oj5q KTdaUgpHzJYWgqOE3IwerwRpVoMkmshKKdgLNhcYtKOTOW3VdAQ7sSkbcKrweQYhEWldQtmp uIEZIOd+EYZGIS5auXj2fYYrJQp+Vvm5rY/ts2uk0dMD2CHJsQlTuRZDzranGfYGF9dPwE/Z ynjPZvln6FQzA6f867Dn4KU6zovNvQjq/rZhYAGloO9BSOpSnA0s+1LzGomjMlFx9fy7Yr9m bI1ybj4L+4jv29whjAk0fO8pVtnsf7wNcrPr3MtiFVEESttu+bXvUiZ1SwhkFxnAib0idorD CDmWZlAy050QKgQoj8m2qf5+Cn6kdo15YS8zSlaDLY0L7EbSN/BMxbiY1DdBzFr0ImodFnya pOm3mUrpxNEHr77W/ADvXzJlhXf3CP0DIfuP9Wi2YaXZoVabdXo4Ba9ERJEI0YFCa/7Iw8Cu FhAMzV+f4TKDqhHj3kl3gqxMbpUmU4Hx+ATERHssuJ0yJOlHQ8y0cD3sQQknoJ6Zp4QZhZ4O bPNLhuidh1P4UrhGJGdZE8qOeMexvwqEj3QRevyHzcZdU6B04=

TDS Team,
We have a production TDS system that has been running for a long while (~5 
years) that accesses data for a collection of stations around the US (~41 years 
of hourly data for many variables per station).  When trying to use TDS' 
OpenDAP option to retrieve any record with time-varying data some stations, we 
get a message back with an error message (the variables with only one value 
work fine). The message we get is vague (see below).

Dataset {
    Float64 waveSpreadWindsea[time = 744];
} wis/Pacific/ST81512/1981/WIS-ocean_waves_ST81512_198103.nc;
---------------------------------------------
Error {
    code = 500;
    message = "null";
};

TDS can see there are 744 records (hourly data for one month), yet cannot 
retrieve and send that data back. I have downloaded the NetCDF file for this 
month and have been able to use other tools (HDFView, R, and Python) to read 
the file contents with no issues, yet Thredds is unable to retrieve that data.

For a station immediately adjacent to this location, TDS works completely fine 
in retrieving using OpenDAP.  The file sizes for each station is reasonably 
similar, so it's not like the data is not written correctly.

Here are a couple of links that can be used as references for "working" and 
"not working" in TDS.
Working:
//chldata.erdc.dren.mil/thredds/dodsC/wis/Pacific/ST81512/1981/WIS-ocean_waves_ST81512_198103.nc.ascii?waveSpreadWindsea%5B0:1:743%5D
Not Working:
//chldata.erdc.dren.mil/thredds/dodsC/wis/Pacific/ST81513/1981/WIS-ocean_waves_ST81513_198103.nc.ascii?waveSpreadWindsea%5B0:1:743%5D

There are plenty of other stations which show the same issue.

Would it be possible for someone (TDS developer or otherwise) to assist us in 
tracking down why some stations work and others do not?  We are presently using 
the 5.5 snapsnot with Apache Tomcat 9.0.76 and Java 11.0.19.

Thanks in advance,
Mitchell Brown

Coastal and Hydraulics Laboratory, ERDC
US Army Corps of Engineers

• Follow-Ups:
  • Re: [thredds] Trouble with TDS accessing data
    • From: Dennis Heimbigner