NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
At Sean’s request I moved my .dodsrc I was able to get it to work. (I think the only question I now have is what is wrong with that particular .dodsrc file..) USE_CACHE=0 MAX_CACHE_SIZE=20 MAX_CACHED_OBJ=5 IGNORE_EXPIRES=0 CACHE_ROOT=/Users/wjc/.dods_cache/ DEFAULT_EXPIRES=86400 ALWAYS_VALIDATE=0 DEFLATE=0 VALIDATE_SSL=1 CURL.COOKIEJAR=.dods_cookies CURL.SSL.VALIDATE=1 CURL.SSL.CERTIFICATE=/Users/wjc/.esg/credentials.pem CURL.SSL.KEY=/Users/wjc/.esg/credentials.pem CURL.SSL.CAPATH=/Users/wjc/.esg/certificates HTTP.COOKIEJAR=/Users/wjc/.cookies HTTP.NETRC=/Users/wjc/.netrc Wjhich specific lines need to be edited or removed? I’ll then close a second item that we have on github and close things there. Thanks much all! ------------------------------------------------ Bill Capehart <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> Atmospheric and Environmental Sciences Program Coordinator Civil and Environmental Engineering 201 Mineral Industries Building South Dakota School of Mines and Technology 501 East St Joseph Street Rapid City, SD 57701-3995 Ph: +1-605-394-1994 Mobile: +1-605-484-4692 From: Larry Baker <baker@xxxxxxxx> Date: Thursday, May 4, 2017 at 00:10 MDT To: William Capehart <William.Capehart@xxxxxxxxx> Cc: "dmh@xxxxxxxx" <dmh@xxxxxxxx>, "netcdfgroup@xxxxxxxxxxxxxxxx" <netcdfgroup@xxxxxxxxxxxxxxxx> Subject: Re: [netcdfgroup] Using NetCDF with OPeNDAP on MacOS Sierra (homebrew- and netCDF-dependant software) See https://github.com/Unidata/netcdf-c/issues/122 around July 10, 2015 for a similar/the same bug? My previous inference about strcmp() being the culprit is not quite right. The failing code in the thread I found (below) is just before the strcmp() call. Looks like the same problem to me. The cause at that time was "c" had a value of 67, while the nameindices[] array was declared [26]. doutriaux1@maryam:[build]:[10587]> lldb ~/build//install/Externals/bin/ncdump http://test.opendap.org/opendap/hyrax/netcdf/examples/ECMWF_ERA-40_subset.nc (lldb) target create "/Users/doutriaux1/build//install/Externals/bin/ncdump" Current executable set to '/Users/doutriaux1/build//install/Externals/bin/ncdump' (x86_64). (lldb) settings set -- target.run-args "http://test.opendap.org/opendap/hyrax/netcdf/examples/ECMWF_ERA-40_subset.nc" (lldb) r Process 45302 launched: '/Users/doutriaux1/build//install/Externals/bin/ncdump' (x86_64) Process 45302 stopped * thread #1: tid = 0xebf1, 0x00000001000b09c7 libnetcdf.7.dylib`occurlflagbyname(name=0x0000000100186749) + 327 at occurlflags.c:301, queue = 'com.apple.main-thread', stop reason = EXC_BAD_ACCESS (code=1, address=0x2) frame #0: 0x00000001000b09c7 libnetcdf.7.dylib`occurlflagbyname(name=0x0000000100186749) + 327 at occurlflags.c:301 298 299 if(nameindices[c] == NULL) 300 return NULL; /* no possible match */ -> 301 for(f=nameindices[c];f->name;f++) { 302 int cmp = strcmp(name,f->name); 303 if(cmp > 0) break; /* We assume sorted */ 304 if(cmp == 0) return f; Larry Baker US Geological Survey 650-329-5608 baker@xxxxxxxx<mailto:baker@xxxxxxxx> On May 3, 2017, at 10:57 PM, Larry Baker <baker@xxxxxxxx<mailto:baker@xxxxxxxx>> wrote: Looks to me like an illegal memory access in a strcmp() inside libnetcdf.11.dylib. The "occurlflagbyname()" is the failing function inside libnetcdf? Larry Baker US Geological Survey 650-329-5608 baker@xxxxxxxx<mailto:baker@xxxxxxxx> On May 3, 2017, at 10:44 PM, Capehart, William J <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> wrote: OK. I am not familiar with how to use this but here is the output that I have for lldb usng … lldb --debug /usr/local/bin/ncdump http://test.opendap.org/opendap/data/nc/3fnoc.nc https://gist.github.com/wjcapehart/8cc8068a6b6951ee98a2a48dbae02520 And for my output for the fortran program that I wrote. https://gist.github.com/9a46b7750bc5a9c3ebfdf1916941f490 For the command % otool -L /usr/local/bin/ncdump http://test.opendap.org/opendap/data/nc/3fnoc.nc /usr/local/bin/ncdump: @rpath/libnetcdf.11.dylib (compatibility version 11.0.0, current version 11.4.0) /usr/local/opt/hdf5/lib/libhdf5_hl.100.dylib (compatibility version 101.0.0, current version 101.0.0) /usr/local/opt/hdf5/lib/libhdf5.100.dylib (compatibility version 101.0.0, current version 101.1.0) /usr/local/opt/szip/lib/libsz.2.dylib (compatibility version 3.0.0, current version 3.0.0) /usr/local/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.8) /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1238.50.2) /usr/lib/libcurl.4.dylib (compatibility version 7.0.0, current version 9.0.0) /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/objdump: 'http://test.opendap.org/opendap/data/nc/3fnoc.nc': No such file or directory ------------------------------------------------ Bill Capehart <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> Atmospheric and Environmental Sciences Program Coordinator Civil and Environmental Engineering 201 Mineral Industries Building South Dakota School of Mines and Technology 501 East St Joseph Street Rapid City, SD 57701-3995 Ph: +1-605-394-1994 Mobile: +1-605-484-4692 From: <netcdfgroup-bounces@xxxxxxxxxxxxxxxx<mailto:netcdfgroup-bounces@xxxxxxxxxxxxxxxx>> on behalf of Larry Baker <baker@xxxxxxxx<mailto:baker@xxxxxxxx>> Date: Wednesday, May 3, 2017 at 16:45 MDT To: "dmh@xxxxxxxx<mailto:dmh@xxxxxxxx>" <dmh@xxxxxxxx<mailto:dmh@xxxxxxxx>> Cc: "netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx>" <netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx>> Subject: Re: [netcdfgroup] Using NetCDF with OPeNDAP on MacOS Sierra (homebrew- and netCDF-dependant software) Good idea: lldb Larry Baker US Geological Survey 650-329-5608 baker@xxxxxxxx<mailto:baker@xxxxxxxx> On 3 May 2017, at 3:35:19 PM, dmh@xxxxxxxx<mailto:dmh@xxxxxxxx> wrote: Is there a osx equivalent of gdb? If so, you could probably run the ncdump command using that debugger and it will probably catch the seg fault. This would allow some idea of where the failure is occurring. =Dennis Heimbigner Unidata On 5/3/2017 4:25 PM, Capehart, William J wrote: To be desperate ;-P is there a way to test things with just the libcurl to see where the problem is? I am assuming that most people are getting satisfaction with the resident version with Sierra. I'm really on my last leg here. I'm not even getting core files with my seg faults on ncdump or my simple Fortran program inbuilt to test it... both run just fine on Centos . Sent from my iPhone On May 3, 2017, at 15:04, "dmh@xxxxxxxx<mailto:dmh@xxxxxxxx>" <dmh@xxxxxxxx<mailto:dmh@xxxxxxxx>> wrote: To be pedantic, ncdump (via the netcdf-c library) uses libcurl. =Dennis Heimbigner Unidata On 5/3/2017 2:31 PM, Roy Mendelssohn - NOAA Federal wrote: Hmm - I may be wrong but i thought the ncdump for a remote file just uses curl to get the .das and .dds and forms the .cdl response from those. Have you tried a different server? Say, ncdump -h http://coastwatch.pfeg.noaa.gov/erddap/griddap/jplAquariusSSSMonthlyV4 -Roy On May 3, 2017, at 1:25 PM, Capehart, William J <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> wrote: Roy for the curl I get the followingf % curl -v http://test.opendap.org/opendap/data/nc/3fnoc.nc.das * Trying 52.44.0.41... * TCP_NODELAY set * Connected to test.opendap.org<http://test.opendap.org/> (52.44.0.41) port 80 (#0) GET /opendap/data/nc/3fnoc.nc.das HTTP/1.1 Host: test.opendap.org<http://test.opendap.org/> User-Agent: curl/7.51.0 Accept: */* < HTTP/1.1 200 OK < Date: Wed, 03 May 2017 20:22:21 GMT < X-FRAME-OPTIONS: DENY < Last-Modified: Tue, 10 Jan 2006 18:32:26 GMT < Set-Cookie: JSESSIONID=63E4296077ED5DBE9CFE2C49B169D4ED; Path=/opendap; HttpOnly < XDODS-Server: dods/3.2 < XOPeNDAP-Server: bes/3.17.4, csv_handler/1.1.6, dap-server/ascii/4.1.5, dap-server/usage/4.2.6, dap-server/www/4.1.5, dapreader_module/0.0.1, fileout_gdal/0.10.1, fileout_json/1.0.6, fileout_netcdf/1.4.3, fits_handler/1.0.18, freeform_handler/3.9.6, functions/1.1.0, gateway_module/1.1.9, gdal_handler/1.0.7, hdf4_handler/3.12.3, hdf5_handler/2.3.5, libdap/3.18.3, ncml_moddule/1.4.4, netcdf_handler/3.11.6, w10n_handler/1.0.6, xml_data_handler/1.1.2 < X-DAP: 3.2 < Content-Description: dods_das < Content-Type: text/plain < Connection: close < Transfer-Encoding: chunked < Attributes { u { String units "meter per second"; String long_name "Vector wind eastward component"; String missing_value "-32767"; String scale_factor "0.005"; } v { String units "meter per second"; String long_name "Vector wind northward component"; String missing_value "-32767"; String scale_factor "0.005"; } lat { String units "degree North"; } lon { String units "degree East"; } time { String units "hours from base_time"; } NC_GLOBAL { String base_time "88-245-00:00:00"; String title " FNOC UV wind components from 1988-245 to 1988-247."; } DODS_EXTRA { String Unlimited_Dimension "time_a"; } } * Curl_http_done: called premature == 0 * Closing connection 0 ------------------------------------------------ Bill Capehart <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> Atmospheric and Environmental Sciences Program Coordinator Civil and Environmental Engineering 201 Mineral Industries Building South Dakota School of Mines and Technology 501 East St Joseph Street Rapid City, SD 57701-3995 Ph: +1-605-394-1994 Mobile: +1-605-484-4692 On 5/3/17, 14:19 MDT, "Roy Mendelssohn - NOAA Federal" <roy.mendelssohn@xxxxxxxx<mailto:roy.mendelssohn@xxxxxxxx>> wrote: More specifically, what do you get when you give: curl -v http://test.opendap.org/opendap/data/nc/3fnoc.nc.das -Roy On May 3, 2017, at 1:01 PM, Roy Mendelssohn - NOAA Federal <roy.mendelssohn@xxxxxxxx<mailto:roy.mendelssohn@xxxxxxxx>> wrote: What happens if you just do a curl to get the address but ask for the .das instead, and see if your curl and access the site. -Roy On May 3, 2017, at 12:57 PM, Capehart, William J <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> wrote: Did that with both fink and homebrew including compiling all from source each time. Still no traction. :-( ------------------------------------------------ Bill Capehart <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> Atmospheric and Environmental Sciences Program Coordinator Civil and Environmental Engineering 201 Mineral Industries Building South Dakota School of Mines and Technology 501 East St Joseph Street Rapid City, SD 57701-3995 Ph: +1-605-394-1994 Mobile: +1-605-484-4692 On 5/3/17, 08:06 MDT, "Roy Mendelssohn - NOAA Federal" <roy.mendelssohn@xxxxxxxx<mailto:roy.mendelssohn@xxxxxxxx>> wrote: try installing the fink curl. -roy On May 3, 2017, at 6:47 AM, Capehart, William J <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> wrote: I am attaching my gist of the build https://gist.github.com/anonymous/4db828fcd4384c7883a8687147ced1f7 The C tst is 3.make The C++4 Test is 7.make The Fortran Test is 11.make The C++ test is 16.make Hi Sean: And the output of my nc-config –alll https://gist.github.com/733ad6330523a83cee204f9f7f34c061 The curl version on my mac (10.12.4) is the on-board version which I presume is what I need % curl --version curl 7.51.0 (x86_64-apple-darwin16.0) libcurl/7.51.0 SecureTransport zlib/1.2.8 Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp smb smbs smtp smtps telnet tftp Features: AsynchDNS IPv6 Largefile GSS-API Kerberos SPNEGO NTLM NTLM_WB SSL libz UnixSockets And curl -Oing my the target file produces the following https://gist.github.com/wjcapehart/6f49640a075f47b1040c48917ebd631b Sorry Larry: valgrind is reporting from homebrew that is in compatible with MacOS post El Capitan. Roy: from the client side I’m not seeing any significant redflags in the console logs Really really out of clues at this point. Thanks to everyone or their input though. Bill From: Sean Arms <sarms@xxxxxxxx<mailto:sarms@xxxxxxxx>> Date: Tuesday, May 2, 2017 at 17:50 MDT To: William Capehart <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> Cc: "netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx>" <netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx>> Subject: Re: [netcdfgroup] Using NetCDF with OPeNDAP on MacOS Sierra (homebrew- and netCDF-dependant software) Greetings Bill, I have a suspicion this has to do with the way curl was built. What does nc-config --libs give you? Sean On Sun, Apr 30, 2017 at 10:42 AM, Capehart, William J <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> wrote: Hi All I have been having a particularly time working with NetCDF with OPeNDAP on my Macs (right now both are on MacOS 10.12.4). I’ve mostly been using homebrew but this also happens with NCL 6.3 and 6.4 as downloaded from Earth System Grid. When testing code using just the NetCDF fortran libraries as well as just using ncdump I get segmentation faults when I try to access http://test.opendap.org/opendap/data/nc/3fnoc.nc Is anyone else having any luck with their MacOS Sierra NetCDF builds and the software that leverages NetCDF? ------------------------------------------------ Bill Capehart <William.Capehart@xxxxxxxxx<mailto:William.Capehart@xxxxxxxxx>> Atmospheric and Environmental Sciences Program Coordinator Civil and Environmental Engineering 201 Mineral Industries Building South Dakota School of Mines and Technology 501 East St Joseph Street Rapid City, SD 57701-3995 Ph: +1-605-394-1994 Mobile: +1-605-484-4692 _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. netcdfgroup mailing list netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx> For list information or to unsubscribe, visit: http://www.unidata.ucar.edu/mailing_lists/ ********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center ***Note new street address*** 110 McAllister Way Santa Cruz, CA 95060 Phone: (831)-420-3666 Fax: (831) 420-3980 e-mail: Roy.Mendelssohn@xxxxxxxx<mailto:Roy.Mendelssohn@xxxxxxxx> www: http://www.pfeg.noaa.gov/ "Old age and treachery will overcome youth and skill." "From those who have been given much, much will be expected" "the arc of the moral universe is long, but it bends toward justice" -MLK Jr. ********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center ***Note new street address*** 110 McAllister Way Santa Cruz, CA 95060 Phone: (831)-420-3666 Fax: (831) 420-3980 e-mail: Roy.Mendelssohn@xxxxxxxx<mailto:Roy.Mendelssohn@xxxxxxxx> www: http://www.pfeg.noaa.gov/ "Old age and treachery will overcome youth and skill." "From those who have been given much, much will be expected" "the arc of the moral universe is long, but it bends toward justice" -MLK Jr. ********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center ***Note new street address*** 110 McAllister Way Santa Cruz, CA 95060 Phone: (831)-420-3666 Fax: (831) 420-3980 e-mail: Roy.Mendelssohn@xxxxxxxx<mailto:Roy.Mendelssohn@xxxxxxxx> www: http://www.pfeg.noaa.gov/ "Old age and treachery will overcome youth and skill." "From those who have been given much, much will be expected" "the arc of the moral universe is long, but it bends toward justice" -MLK Jr. ********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center ***Note new street address*** 110 McAllister Way Santa Cruz, CA 95060 Phone: (831)-420-3666 Fax: (831) 420-3980 e-mail: Roy.Mendelssohn@xxxxxxxx<mailto:Roy.Mendelssohn@xxxxxxxx> www: http://www.pfeg.noaa.gov/ "Old age and treachery will overcome youth and skill." "From those who have been given much, much will be expected" "the arc of the moral universe is long, but it bends toward justice" -MLK Jr. _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. netcdfgroup mailing list netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx> For list information or to unsubscribe, visit: http://www.unidata.ucar.edu/mailing_lists/ _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. netcdfgroup mailing list netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx> For list information or to unsubscribe, visit: http://www.unidata.ucar.edu/mailing_lists/ _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. netcdfgroup mailing list netcdfgroup@xxxxxxxxxxxxxxxx<mailto:netcdfgroup@xxxxxxxxxxxxxxxx> For list information or to unsubscribe, visit: http://www.unidata.ucar.edu/mailing_lists/
netcdfgroup
archives: