NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Greetings Jian, Ah yes, the -catalog option. This should work. I do not know for sure if multithreading in 4.5 will work for the TDM, as the initial threading issue was related to an apache httpclient upgrade (which I think happened in 4.6). The TDM will hang after about 5 updates, so it will fail pretty fast. Cheers, Sean On Wed, Jul 6, 2016 at 6:49 PM, 唐健 <tangjian@xxxxxxxxxx> wrote: > Hi Sean, > > Thanks for the quick reply. > I was trying to google yesterday and found it in application-config.xml > also. > But cannot find the flag to use it beside from ant the source. > > One more question, is it safe to use multi-thread? Because I find this > https://github.com/Unidata/thredds/issues/496 . > I am using TDM 4.5 and TDS 4.5.5 right now. > > Yesterday I also try to run multi TDM by using the flag like " -catalog > nwp_cma_grapes_global.xml " > like this, acutually it works... > > runTDM.bat: > > start "" "C:/Program Files/Java/jdk1.7.0_55/bin/java" -Xmx1g > -Dtds.content.root.path="C:\Program Files\Apache Software Foundation\Tomcat > 7.0\content" -jar tdm-4.5.jar -catalog nwp_cma_grapes_global.xml -tds " > http://thredds.cma.gov.cn/"; > start "" "C:/Program Files/Java/jdk1.7.0_55/bin/java" -Xmx1g > -Dtds.content.root.path="C:\Program Files\Apache Software Foundation\Tomcat > 7.0\content" -jar tdm-4.5.jar -catalog nwp_cma_grapes_meso.xml -tds " > http://thredds.cma.gov.cn/"; > start "" "C:/Program Files/Java/jdk1.7.0_55/bin/java" -Xmx1g > -Dtds.content.root.path="C:\Program Files\Apache Software Foundation\Tomcat > 7.0\content" -jar tdm-4.5.jar -catalog nwp_cma_grapes_ruc.xml -tds " > http://thredds.cma.gov.cn/"; > start "" "C:/Program Files/Java/jdk1.7.0_55/bin/java" -Xmx1g > -Dtds.content.root.path="C:\Program Files\Apache Software Foundation\Tomcat > 7.0\content" -jar tdm-4.5.jar -catalog nwp_cma_t639.xml -tds " > http://thredds.cma.gov.cn/"; > > I will try the multi-threads way this afternoon. > Thanks very much again! > > Cheers, > Jian > > > -----原始邮件----- > *发件人:*"Sean Arms" <sarms@xxxxxxxx> > *发送时间:*2016-07-07 05:27:37 (星期四) > *收件人:* "唐健" <tangjian@xxxxxxxxxx> > *抄送:* thredds <thredds@xxxxxxxxxxxxxxxx> > *主题:* Re: [thredds] How to speed up gbx9 file generation > > > Greetings Jian, > > The performance of the TDM will be limited to the performance of your I/O > system. While running more than one TDM against a single TDS won't work due > to the way the TDM finds collections that need scanned, you can run a > single TDM in a multithreaded mode. In your TDM run script, you can set the > number of threads to use by setting the flag > > -nthreads=<number of threads> > > By default, the TDM runs with one thread. > > Cheers, > > Sean > > > On Wed, Jul 6, 2016 at 12:40 AM, 唐健 <tangjian@xxxxxxxxxx> wrote: > >> HI everyone >> >> We run our thredds server and TDM on a virtual workstation with 2.0GHz >> E78850*2, and 32GB memory, windows server 2008. >> The script run TDM is like this >> "C:/Program Files/Java/jdk1.7.0_55/bin/java" -Xmx10g >> -Dtds.content.root.path="C:\Program Files\Apache Software Foundation\Tomcat >> 7.0\content" -jar tdm-4.5.jar -tds "http://thredds.cma.gov.cn/"; -cred .. >> In operation it only take like 0.5GB memory. >> >> My problem is almost all global model and meso-scale model output comes >> in at the most busy time around 3-4 pm local time. >> and there are a lot of files. it takes quite long time for tdm to build >> indexes. >> for example, when one model output is all there, tdm is busy building >> indexes for another model, and it cannot generate gbx9 and ncx2 file for >> this model. >> Is there anything I can do about it? >> Maybe run multi-TDM? >> or put one TDM in charge of every single model output? >> >> or can I use any other program to scan dirs and generate gbx9 for each >> file once it comes in ? >> >> If anyone has any suggestion, please let me know. >> Many thanks >> >> >> Cheers >> Jian >> >> >> -- >> Dr. Jian TANG >> Central Meteorological Office >> National Meteorological Center of CMA >> >> >> >> _______________________________________________ >> NOTE: All exchanges posted to Unidata maintained email lists are >> recorded in the Unidata inquiry tracking system and made publicly >> available through the web. Users who post to any of the lists we >> maintain are reminded to remove any personal information that they >> do not want to be made public. >> >> >> thredds mailing list >> thredds@xxxxxxxxxxxxxxxx >> For list information or to unsubscribe, visit: >> http://www.unidata.ucar.edu/mailing_lists/ >> > > > -- > Dr. Jian TANG > Central Meteorological Office > National Meteorological Center of CMA > No. 46, Zhongguancun South Street, Haidian District, Beijing > P. R. China, 100081 > > >
thredds archives: