NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.

[IDDBrasil #XPZ-611749]: Re: 20060609: CONDUIT Latency (cont.)

Hi Waldenio,

re: I regret that you were not able to be in Baltimore for the AGU meeting
> I regret this also :-( May be some opportunity arise in September,
> during another WMO meeting in Peru. My intention is to provide training
> courses for others countries of South America in december. So some of
> these peoples can attend here also.

This sounds good!

re: there is a bottleneck somewhere, and we need to work to find it
> I think that the bottleneck lies in Sao Paulo (FAPESP). So we will
> need to "show them" that they are the bottleneck. To do this work,
> I think that FTP can be a tool.

I am not sure that FTP is the best thing to use for this test.  What
we could do is run a separate instance of the LDM on yakov and some
other machine at CPTEC using a port different than 388.  If there is
port-specific packet shaping going on (our theory), then running the
LDM on a different port will demonstrate it conclusively.

Do you (CPTEC) have a spare machine on which we could load and run
the LDM requesting CONDUIT data from yakov.unidata.ucar.edu?  If yes,
we should work together to get a test setup using a different port
and see if the rate limiting exists on the test machine.

In the meantime, however, it will be useful to do the 10-way split
of CONDUIT feed requests AND change the upstream from idd.cise-nsf.gov
to idd.unidata.ucar.edu.  If my theory is correct, the 10-way split
should result in significantly lower latencies.  The reason for this
is that each request will get 10% of the full feed, or about 150 MB/hour.
Since moingobe is able to ingest the NNEXRAD datastream with no latency,
and since the average hourly volume in NNEXRAD is on the order of
150 MB/hour, the ten-way split of CONDUIT should result in 10 connections
carrying about the same load as the single NNEXRAD feed.

Please let me know when you have implemented the 10-way CONDUIT split
and if you can identify a test machine on which we could run LDM tests
using a port other than 388.

> Cheers,
> Waldenio.
> 
> 
> 

Cheers,

Tom
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
support@xxxxxxxxxxxxxxxx                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
==================
Ticket ID: XPZ-611749
Department: Support IDD Brasil
Priority: Normal
Status: Closed


  • 2006 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the idd-brasil archives: