Forums

Back

RE: IRIS version 6.6 now available for testing

RSS (Opens New Window)(Opens New Window)
MD
Matt Davis, modified 5 Years ago.

IRIS version 6.6 now available for testing

Youngling Posts: 199 Join Date: 6/14/11 Recent Posts
Good morning,

IRIS version 6.6 is now available for testing at https://irisqa.ncep.noaa.gov. It has been processing data since yesterday at 13Z. 

Release notes: 

https://docs.google.com/document/d/1U0B54gOC3bgK1vS98SY_qSPJ7Of6jFbDWlhV5gi4uUk/edit?usp=sharing

Important Changes to the observations API:

This release contains a number of bug fixes and new features for the observations API. 
Offices which use the API to obtain observational data will need to test their scripts against the QA tier. This can be done by pointing your scripts to a base URL of:

Your authkeys will work against QA as well, so no change to those is needed. The description document for the API is: 

https://docs.google.com/document/d/16agbW3gK03nzkB-uZ-6vdpu6EyDPuzEZY8Uomei-mfQ/edit?usp=sharing

Thanks,
Matt


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537



DV
Don Van Dyke, modified 5 Years ago.

Re: IRIS version 6.6 now available for testing

Youngling Posts: 11 Join Date: 4/12/16 Recent Posts

Hi Matt,

There's a group of stations for TAE reporting a couple thousand inches of rain in the new version.  It was really wet here with Sally but not that wet. :-)  I attached a screenshot. 

-Don


On 9/22/2020 10:05 AM, Matt Davis wrote:
Good morning,

IRIS version 6.6 is now available for testing at https://irisqa.ncep.noaa.gov. It has been processing data since yesterday at 13Z. 

Release notes: 

https://docs.google.com/document/d/1U0B54gOC3bgK1vS98SY_qSPJ7Of6jFbDWlhV5gi4uUk/edit?usp=sharing

Important Changes to the observations API:

This release contains a number of bug fixes and new features for the observations API. 
Offices which use the API to obtain observational data will need to test their scripts against the QA tier. This can be done by pointing your scripts to a base URL of:

Your authkeys will work against QA as well, so no change to those is needed. The description document for the API is: 

https://docs.google.com/document/d/16agbW3gK03nzkB-uZ-6vdpu6EyDPuzEZY8Uomei-mfQ/edit?usp=sharing

Thanks,
Matt


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537




--
Matt Davis IRIS Virtual Lab Forum http://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/11916248VLab.Notifications@noaa.gov
-- 
Don Van Dyke
Lead Forecaster
WSR-88D, Storm Data, and Verification Focal Points
NWS Tallahassee, FL
(850) 942-8833
“Until somebody shows me that a machine can out-forecast 
me, or out-forecast other people I consider good forecasters, 
I’m not willing to concede that a machine should be issuing a 
forecast.” –Al Moller

Attachments:

Attachment

MD
Matt Davis, modified 5 Years ago.

RE: Re: IRIS version 6.6 now available for testing

Youngling Posts: 199 Join Date: 6/14/11 Recent Posts
Hi Don,

Since IRIS 6.6 is now capable of using 5, 15, and 30 minute precipitation in SHEF, it's picking up some alert data out of your 
RR5TAE product. The issue is that a number of reports in there are using -999.99 as the precipitation accumulation (PCIRR), and then
bouncing between that and a normal value like 54.62 causing the precip algorithm to sum those changes. This is something I can programmatically
fix in a later version, but I would suggest modifying the program that creates the SHEF to simply not encode any missing values, vs -999.99. Another 
less desirable option would be to add precip to the exclude list for those sites, but then in an actual rainfall event, they would not be available.

Thanks,
Matt

364
SRUS52 KTAE 221014
RR5TAE
 
: HYDROMETEOROLOGICAL DATA REPORT #5
: NATIONAL WEATHER SERVICE TALLAHASSEE FL
: CHOCTAWHATCHEE PEA YELLOW RIVER WATER MANAGEMENT AUTHORITY
: ALERT - STAGE AND RAINFALL DATA  (30 MINUTE)
 
.E SLLA1 0922 Z DH1008/HGIRR/DIH1/2.35
.E SLLA1 0922 Z DH1008/PCIRR/DIH1/-999.99
 
: DATA IS EVENT DRIVEN AND REPRESENTS LATEST DATA AS OF
: OBSERVATION TIME.  IF NO NEW DATA IS REPORTED...IT IS ASSUMED
: THAT THE READING HAS NOT CHANGED AND THE LAST OBSERVATION
: RECEIVED WILL BE REPORTED AS CURRENT DATA.
: DATA IS PROVISIONAL AND HAS NOT  BEEN QUALITY CONTROLLED.
: DATA SHOULD BE USED WITH CAUTION.
 
$$

On Tue, Sep 22, 2020 at 8:45 AM Don Van Dyke <VLab.Notifications@noaa.gov> wrote:

Hi Matt,

There's a group of stations for TAE reporting a couple thousand inches of rain in the new version.  It was really wet here with Sally but not that wet. :-)  I attached a screenshot. 

-Don


On 9/22/2020 10:05 AM, Matt Davis wrote:
Good morning,

IRIS version 6.6 is now available for testing at https://irisqa.ncep.noaa.gov. It has been processing data since yesterday at 13Z. 

Release notes: 

https://docs.google.com/document/d/1U0B54gOC3bgK1vS98SY_qSPJ7Of6jFbDWlhV5gi4uUk/edit?usp=sharing

Important Changes to the observations API:

This release contains a number of bug fixes and new features for the observations API. 
Offices which use the API to obtain observational data will need to test their scripts against the QA tier. This can be done by pointing your scripts to a base URL of:

Your authkeys will work against QA as well, so no change to those is needed. The description document for the API is: 

https://docs.google.com/document/d/16agbW3gK03nzkB-uZ-6vdpu6EyDPuzEZY8Uomei-mfQ/edit?usp=sharing

Thanks,
Matt


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537




--
Matt Davis IRIS Virtual Lab Forum http://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/11916248VLab.Notifications@noaa.gov
-- 
Don Van Dyke
Lead Forecaster
WSR-88D, Storm Data, and Verification Focal Points
NWS Tallahassee, FL
(850) 942-8833
“Until somebody shows me that a machine can out-forecast 
me, or out-forecast other people I consider good forecasters, 
I’m not willing to concede that a machine should be issuing a 
forecast.” –Al Moller

--
Don Van Dyke IRIS Virtual Lab Forum http://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/11916865 VLab.Notifications@noaa.gov


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537



DV
Don Van Dyke, modified 5 Years ago.

Re: IRIS version 6.6 now available for testing

Youngling Posts: 11 Join Date: 4/12/16 Recent Posts

Hi Matt,

Thanks for the info.  I spoke with hour hydrologist about this and he said it's vendor software for the ChocPea stations that are reporting this way, and it comes to us like that through the MADIS FTP, so he wasn't sure if we could modify it or not.  He also had concerns that the Southeast River Forecast Center would need to know the data is actually missing and not just unreported.  He said he would look into it, but it sounds like your programmatic solution might be the way to go in the long run since the data is given to us in this way from a 3rd party vendor.  In the meantime, we can just filter out that data if we need to from IRIS.  Thanks!

-Don 


On 9/22/2020 11:02 AM, Matt Davis wrote:
Hi Don,

Since IRIS 6.6 is now capable of using 5, 15, and 30 minute precipitation in SHEF, it's picking up some alert data out of your 
RR5TAE product. The issue is that a number of reports in there are using -999.99 as the precipitation accumulation (PCIRR), and then
bouncing between that and a normal value like 54.62 causing the precip algorithm to sum those changes. This is something I can programmatically
fix in a later version, but I would suggest modifying the program that creates the SHEF to simply not encode any missing values, vs -999.99. Another 
less desirable option would be to add precip to the exclude list for those sites, but then in an actual rainfall event, they would not be available.

Thanks,
Matt

364
SRUS52 KTAE 221014
RR5TAE
 
: HYDROMETEOROLOGICAL DATA REPORT #5
: NATIONAL WEATHER SERVICE TALLAHASSEE FL
: CHOCTAWHATCHEE PEA YELLOW RIVER WATER MANAGEMENT AUTHORITY
: ALERT - STAGE AND RAINFALL DATA  (30 MINUTE)
 
.E SLLA1 0922 Z DH1008/HGIRR/DIH1/2.35
.E SLLA1 0922 Z DH1008/PCIRR/DIH1/-999.99
 
: DATA IS EVENT DRIVEN AND REPRESENTS LATEST DATA AS OF
: OBSERVATION TIME.  IF NO NEW DATA IS REPORTED...IT IS ASSUMED
: THAT THE READING HAS NOT CHANGED AND THE LAST OBSERVATION
: RECEIVED WILL BE REPORTED AS CURRENT DATA.
: DATA IS PROVISIONAL AND HAS NOT  BEEN QUALITY CONTROLLED.
: DATA SHOULD BE USED WITH CAUTION.
 
$$

On Tue, Sep 22, 2020 at 8:45 AM Don Van Dyke <VLab.Notifications@noaa.gov> wrote:

Hi Matt,

There's a group of stations for TAE reporting a couple thousand inches of rain in the new version.  It was really wet here with Sally but not that wet. :-)  I attached a screenshot. 

-Don


On 9/22/2020 10:05 AM, Matt Davis wrote:
Good morning,

IRIS version 6.6 is now available for testing at https://irisqa.ncep.noaa.gov. It has been processing data since yesterday at 13Z. 

Release notes: 

https://docs.google.com/document/d/1U0B54gOC3bgK1vS98SY_qSPJ7Of6jFbDWlhV5gi4uUk/edit?usp=sharing

Important Changes to the observations API:

This release contains a number of bug fixes and new features for the observations API. 
Offices which use the API to obtain observational data will need to test their scripts against the QA tier. This can be done by pointing your scripts to a base URL of:

Your authkeys will work against QA as well, so no change to those is needed. The description document for the API is: 

https://docs.google.com/document/d/16agbW3gK03nzkB-uZ-6vdpu6EyDPuzEZY8Uomei-mfQ/edit?usp=sharing

Thanks,
Matt


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537




--
Matt Davis IRIS Virtual Lab Forum http://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/11916248VLab.Notifications@noaa.gov
-- 
Don Van Dyke
Lead Forecaster
WSR-88D, Storm Data, and Verification Focal Points
NWS Tallahassee, FL
(850) 942-8833
“Until somebody shows me that a machine can out-forecast 
me, or out-forecast other people I consider good forecasters, 
I’m not willing to concede that a machine should be issuing a 
forecast.” –Al Moller

--
Don Van Dyke IRIS Virtual Lab Forum http://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/11916865 VLab.Notifications@noaa.gov


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537




--
Matt Davis IRIS Virtual Lab Forum http://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/11917135 VLab.Notifications@noaa.gov
-- 
Don Van Dyke
Lead Forecaster
WSR-88D, Storm Data, and Verification Focal Points
NWS Tallahassee, FL
(850) 942-8833
“Until somebody shows me that a machine can out-forecast 
me, or out-forecast other people I consider good forecasters, 
I’m not willing to concede that a machine should be issuing a 
forecast.” –Al Moller
WP
William Perry, modified 5 Years ago.

RE: IRIS version 6.6 now available for testing

Youngling Posts: 3 Join Date: 9/18/13 Recent Posts

For the IRIS 6.6 notes, Section 5. Other, c. Station Log, am not seeing the two options for exporting the log. Only option is as a CSV.

https://irisqa.ncep.noaa.gov/index.html?wfo=rnk

TE
Tony Edwards, modified 5 Years ago.

RE: IRIS version 6.6 now available for testing

Youngling Posts: 17 Join Date: 12/16/13 Recent Posts

Hello!

I ran a 48 hour rainfall summary in IRIS 6.6 this morning.  While QC'ing the reports, I noticed that many of them ran low.  This included ASOS, Coop and Cocorahs.  

For instance, 

Parkersburg ASOS PKB   IRIS amount 1.78   should have been 2.04

Beckley ASOSO BKW  IRIS 1.44 amount   should have been 1.82

Charleston ASOS CRW   IRIS 1.39 amount   should have been 1.77

Elkins ASOSO EKN   IRIS 1.33 amount   should have been 1.45

 

With the Coop and Cocorahs, it appears that multiple sites had missing observations that were transmitted.

From what I can tell all RAWS stations were calculated correctly.  I did not verify CWOP or AWS station data.

 

I was under the assumption that 6.6 would improve these type of errors?

 

Thanks,

Tony Edwards

NWS Charleston, WV

MD
Matt Davis, modified 5 Years ago.

RE: IRIS version 6.6 now available for testing

Youngling Posts: 199 Join Date: 6/14/11 Recent Posts
Hi Tony - I saw the same issue. It appears it was possibly related to networking changes being made. I did a spot check in the NE where it's raining this morning, and 
everything checked out for multi-day totals. All of the data you mention, ASOS/AWOS, COOP, and CoCoRHaS comes from external sources, whereas the mesonets are
read directly from MADIS on IDP. AWOS/AWOS and COOP are fed from SBN and CoCoRHaSs is obtained from their server. 

I'll keep an eye on it. The new version is correct, because I have tests for that, and they all passed.

Thanks,
Matt

On Fri, Oct 30, 2020 at 8:50 AM Tony Edwards <VLab.Notifications@noaa.gov> wrote:

Hello!

I ran a 48 hour rainfall summary in IRIS 6.6 this morning.  While QC'ing the reports, I noticed that many of them ran low.  This included ASOS, Coop and Cocorahs.  

For instance, 

Parkersburg ASOS PKB   IRIS amount 1.78   should have been 2.04

Beckley ASOSO BKW  IRIS 1.44 amount   should have been 1.82

Charleston ASOS CRW   IRIS 1.39 amount   should have been 1.77

Elkins ASOSO EKN   IRIS 1.33 amount   should have been 1.45

 

With the Coop and Cocorahs, it appears that multiple sites had missing observations that were transmitted.

From what I can tell all RAWS stations were calculated correctly.  I did not verify CWOP or AWS station data.

 

I was under the assumption that 6.6 would improve these type of errors?

 

Thanks,

Tony Edwards

NWS Charleston, WV


--
Tony Edwards IRIS Virtual Lab Forum https://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/12369270 VLab.Notifications@noaa.gov


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537



TE
Tony Edwards, modified 5 Years ago.

RE: IRIS version 6.6 now available for testing

Youngling Posts: 17 Join Date: 12/16/13 Recent Posts
Sounds good.  Thanks for looking into it Matt!

Tony


On Sun, Nov 1, 2020 at 1:21 PM Matt Davis <VLab.Notifications@noaa.gov> wrote:
Hi Tony - I saw the same issue. It appears it was possibly related to networking changes being made. I did a spot check in the NE where it's raining this morning, and 
everything checked out for multi-day totals. All of the data you mention, ASOS/AWOS, COOP, and CoCoRHaS comes from external sources, whereas the mesonets are
read directly from MADIS on IDP. AWOS/AWOS and COOP are fed from SBN and CoCoRHaSs is obtained from their server. 

I'll keep an eye on it. The new version is correct, because I have tests for that, and they all passed.

Thanks,
Matt

On Fri, Oct 30, 2020 at 8:50 AM Tony Edwards <VLab.Notifications@noaa.gov> wrote:

Hello!

I ran a 48 hour rainfall summary in IRIS 6.6 this morning.  While QC'ing the reports, I noticed that many of them ran low.  This included ASOS, Coop and Cocorahs.  

For instance, 

Parkersburg ASOS PKB   IRIS amount 1.78   should have been 2.04

Beckley ASOSO BKW  IRIS 1.44 amount   should have been 1.82

Charleston ASOS CRW   IRIS 1.39 amount   should have been 1.77

Elkins ASOSO EKN   IRIS 1.33 amount   should have been 1.45

 

With the Coop and Cocorahs, it appears that multiple sites had missing observations that were transmitted.

From what I can tell all RAWS stations were calculated correctly.  I did not verify CWOP or AWS station data.

 

I was under the assumption that 6.6 would improve these type of errors?

 

Thanks,

Tony Edwards

NWS Charleston, WV


--
Tony Edwards IRIS Virtual Lab Forum https://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/12369270 VLab.Notifications@noaa.gov


--
Project Manager for IRIS, iNWS, CAP Handler
and NWSChat Long Term Update
Meteorological Development Lab
Office of Science and Technology Integration
NOAA DSRC 3D131, Boulder, Colorado
(608) 406-0537




--
Matt Davis IRIS Virtual Lab Forum http://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/12390124 VLab.Notifications@noaa.gov