Re: [mcidas-x] Cloud Mask

• To: RICHARD A FREY <richard.frey@xxxxxxxxxxxxx>
• Subject: Re: [mcidas-x] Cloud Mask
• From: Russ Dengel <russd@xxxxxxxxxxxxx>
• Date: Fri, 22 Jan 2021 14:04:03 +0000
• Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ssec.wisc.edu; dmarc=pass action=none header.from=ssec.wisc.edu; dkim=pass header.d=ssec.wisc.edu; arc=none
• Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=r4YL+fHF7HfGlDE5GhH7ci1o6a4VCPrzX7HAelxk5mo=; b=Q9MJzWnl7gpkqzyoo8QRWq8A98smrqDXBgEMmjQa93esrwD4PtywQs3WJECvPpUsEE18bv2OzY8o77tHm0eZxz1j5bo2zV+eakd5WvdYbz1jmEBpzoN4Ql1ClUc+lm7W8trUPoLpHnl+WFx48AiFaye3uQjMSUFyd4lv+7KJ0krgHEk0TlF+k96n3ues/xGBygrOCokU6BEmKoOKxATCwCPSJ6BmN11ylz2j/55LuwWCirMtZqQT5SOUiogoigkkM7hRTTEhi6UR3piP5MCv4biB+eEiroK2/DS1tVDT22e3t6I0fujgrJp/kRMoH5CfYMDmNQsEBCS0N6HMTN4now==
• Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cdNwsFSrby72wezjAUQQHxCTEq2dXYS5zjWhXyKN6LGVtwRWeKmp+E1887+BmmLUjy/lX1iU1NWCvWbizW7+OzQ59SDuS3UJkbMwdCLfRK1yzWWS2wHpc6zXkRV0O33JEiTbDh3H/YBCr6CQnKgpSb2ozQcPnEAvtzu5PwNnhf03KWoh4w4gkzjgOqBXK8a6Y6i3fQaILZPloKl+ZPUQAqpFPEkcMmYrd1rKN63GXwu1hisU69W/qwd3EnDDEKdeAV4gypRyZWDga0qg3N+/2ANWeXVLSy+c+j0QXCGxGD9tPH87OgwWw8CIG2QaH/DHcDEHZfj0Aj273MAD5fhLTw==

Rich,

   Thats the same problem I have. I can’t move the file into your account. Lets 
have TC give us sudo to each other’s accounts.

Russ

On Jan 22, 2021, at 7:56 AM, Richard Frey 
<richard.frey@xxxxxxxxxxxxx<mailto:richard.frey@xxxxxxxxxxxxx>> wrote:

Hi Russ,

Thanks for tracking this down.  I don't have permission to copy the new file 
over to McIDAS20201.  Do you have that permission?  If so could you do that?  
If not, I guess I'll have to get TC to do it.

Thanks,
Rich

On 1/21/2021 2:57 PM, Russ Dengel wrote:
Rich,

   YUP that was the problem all along. the server was reading the 
Cloud_Mask_SPI file instead of the Cloud_Mask file. I have placed updated code 
in my account on neige in ~russd/xrd/src. The file is
        modxaget.cp

    Copy this module into your McIDAS2020.1 /src directory (replacing the 
modxaget.cp that currently resides there)
    Run the McIDAS 2020.1 .sh script to make and install the new code

Russ

On Jan 21, 2021, at 1:21 PM, Russ Dengel 
<russd@xxxxxxxxxxxxx<mailto:russd@xxxxxxxxxxxxx>> wrote:

Rich,

    The server is reading the Cloud_Mask_SPI dataset. I’m guessing that it 
should be reading the Cloud_Mask dataset. What is this SPI variant?

Russ

On Jan 20, 2021, at 8:56 AM, Richard Frey 
<richard.frey@xxxxxxxxxxxxx<mailto:richard.frey@xxxxxxxxxxxxx>> wrote:

The mask is a byte array, 6X2030X1354.  McIDAS bands 1-30 except bands 2 and 6 
are represented by one bit each of the 48 per pixel.  Band 2 (basic output 
mask) is a 2-bit value (value=0-3) as is Band 6 (scene type).  Band 31 (250- 
mask) is displayed at 4 times the resolution of the other bands and is created 
from the remaining 16 bits (33-48).

On 1/20/2021 8:42 AM, Russ Dengel wrote:
Weird!? For all of the other bands they resolve as 1 byte values (HDF type 20 = 
Int8) but band2 comes back as a 2byte value (type 22 = Int16). AND the 
dimension order is different for band2. Again, For all the other band Is get 3 
dimensions (6X2030X1354). For Band2 I get 3 dimensions but the order is 
2030X1354X2. This is why I asked for the dump. That will tell me the internals 
of Band2.

Russ

On Jan 20, 2021, at 8:28 AM, Richard Frey 
<richard.frey@xxxxxxxxxxxxx<mailto:richard.frey@xxxxxxxxxxxxx>> wrote:

Just to be clear, that's single byte values, not 2-byte.
Rich


-------- Forwarded Message --------
Subject:        Re: Cloud Mask
To:     Russ Dengel <russd@xxxxxxxxxxxxx><mailto:russd@xxxxxxxxxxxxx>
References:     
<B13A31C3-417F-4724-9C8D-781C1F1F96A4@xxxxxxxxxxxxx><mailto:B13A31C3-417F-4724-9C8D-781C1F1F96A4@xxxxxxxxxxxxx>
 
<b622b783-2736-4626-bfa0-96ed440fa968@xxxxxxxxxxxxx><mailto:b622b783-2736-4626-bfa0-96ed440fa968@xxxxxxxxxxxxx>
 
<0B15961D-C6E9-4E94-9E1C-1AA012FABEF8@xxxxxxxxxxxxx><mailto:0B15961D-C6E9-4E94-9E1C-1AA012FABEF8@xxxxxxxxxxxxx>
From:   Richard Frey 
<richard.frey@xxxxxxxxxxxxx><mailto:richard.frey@xxxxxxxxxxxxx>
Message-ID:     
<049cbe48-bdd8-8a3c-97ac-5129d7d0df94@xxxxxxxxxxxxx><mailto:049cbe48-bdd8-8a3c-97ac-5129d7d0df94@xxxxxxxxxxxxx>
Date:   Wed, 20 Jan 2021 08:24:43 -0600
User-Agent:     Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) 
Gecko/20100101 Thunderbird/78.6.1
MIME-Version:   1.0
In-Reply-To:    
<0B15961D-C6E9-4E94-9E1C-1AA012FABEF8@xxxxxxxxxxxxx><mailto:0B15961D-C6E9-4E94-9E1C-1AA012FABEF8@xxxxxxxxxxxxx>
Content-Type:   text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding:      7bit
Content-Language:       en-US


In the MODIS cloud mask (MxD35_L2) data, both mask and QA are byte values.


On 1/20/2021 8:22 AM, Russ Dengel wrote:

Rich,

    No problem.

    Thanks for the dump. That might clear up some mysteries. The Band2 imagery 
appears to be INT16 (2byte values) from what I can tell without the dump. Is 
that correct?

Russ



On Jan 20, 2021, at 8:14 AM, Richard Frey 
<richard.frey@xxxxxxxxxxxxx><mailto:richard.frey@xxxxxxxxxxxxx> wrote:

Hi Russ,

Sorry, I took a Covid day yesterday ...

On neige, use ~richardf/bin/ncdump -h.

Rich

On 1/19/2021 1:30 PM, Russ Dengel wrote:


Rich

       Do you have access to a ncdump exe? I need a
            ncdump -h
       for the test file that you supplied to me. Looks like there are some 
differences between Band2 in these files. I need some info on how this band is 
read and how the Qual Flag is applied.

Russ