Forums

Back

RE: Duplicate (older) entries in PNS

MH
Mike Hardiman, modified 3 Years ago.

Duplicate (older) entries in PNS

Youngling Posts: 16 Join Date: 12/17/13 Recent Posts

There's a thread from about a year ago ("PNS generation showing duplicate data") in which duplicate reports with different values and times were showing up in PNS products. It was supposed to be fixed, but I'm getting a similar error with snowfall reports.

This is very problematic with frequent-updating spotters, since we might to grab all reports up to 6 hours old (especially if the storm has ended in the far west of the CWA, and is still on-going in the far east, even reports over 6 hours old may be valid "Storm Totals"). 

Attached is an example. Note the METADATA section shows the same Lat/Lon, but it happily included all three reports for Beach Lake, PA instead of tossing out the older reports. I thought this used to work in IRIS, and ECLAIRS even had a radius filter in case the lat/lons weren't quite the same but were really close together.

It'd be really nice if when generating a PNS, you could select different report age cutoff times for different counties/zones. 

 

 

 

MS
Mike Sutton, modified 3 Years ago.

RE: Duplicate (older) entries in PNS

Youngling Posts: 61 Join Date: 6/21/13 Recent Posts
Mike,

Have you utilized the Deduplicate functionality in the Weather Reports/LSRs All Weather Reports table?  If that is not sufficient, we can open a Feature Request for this item.

Thanks,
ms

On Sat, Mar 12, 2022 at 9:15 PM Mike Hardiman <VLab.Notifications@noaa.gov> wrote:

There's a thread from about a year ago ("PNS generation showing duplicate data") in which duplicate reports with different values and times were showing up in PNS products. It was supposed to be fixed, but I'm getting a similar error with snowfall reports.

This is very problematic with frequent-updating spotters, since we might to grab all reports up to 6 hours old (especially if the storm has ended in the far west of the CWA, and is still on-going in the far east, even reports over 6 hours old may be valid "Storm Totals"). 

Attached is an example. Note the METADATA section shows the same Lat/Lon, but it happily included all three reports for Beach Lake, PA instead of tossing out the older reports. I thought this used to work in IRIS, and ECLAIRS even had a radius filter in case the lat/lons weren't quite the same but were really close together.

It'd be really nice if when generating a PNS, you could select different report age cutoff times for different counties/zones. 

 

 

 


--
Mike Hardiman IRIS Virtual Lab Forum https://vlab.noaa.gov/web/iris/iris-forum/-/message_boards/view_message/21138061VLab.Notifications@noaa.gov


--
Mike Sutton - KB5ZRC
Information Technology Officer
Weather Forecast Office
4899 Tim Dougherty Drive SE
Grand Rapids, MI  49512-4034
Google Voice:  (616) 379-9216
Office:  (616) 949-0643 x486
AWIPS2 - Build 20.2.3-43