Forums

Back

RE: Re: Whole Story Uncertainty and Probabilities Viewer v4.5 (and more)

JS
Jack Settelmaier, modified 3 Years ago.

Re: Whole Story Uncertainty and Probabilities Viewer v4.5 (and more)

Youngling Posts: 67 Join Date: 11/2/12 Recent Posts
Dave, 

This "additional aspects" email of your WSUP v4.5 upgrade does not seem to be a Forum post from which I can respond and ask questions, so I'm making one with this email to ask a few questions.

It's awesome to see the NBM/NDFD Archive Viewer, feeding off NODD AWS data endpoints, in place and usable!!
  1) Does the code read the GRIB on the fly to create, or are the geoTIFFS being used?  I assume the latter, but the ability to see the S3 link had me wondering.
  1a) I like that the S3 link "decodes" the user's request and shows which WMO-encoded GRIB files were the base data. 
  2) When one hits submit, is there a URL used that can be used, and modified, directly to grab a series of images?
  3) Given this implementation, one of our SR SOOs asked if we might see the return of the 4-panel viewer to easily compare NBM, NDFD, RTMA/URMA, WPC, etc.

For the new graphical.mdl.nws.noaa.gov site, and how it displays images....
  4) Is the WMS step only used "in the server back-end" to return an image to the webpage, or is there a public-facing WMS link that one can point to/alter, for potential use in other interfaces that can consume WMS?
  5) Is this graphical.mdl.nws.noaa.gov public-facing?



 

On Tue, Apr 5, 2022 at 10:07 AM David.Ruth <david.ruth@noaa.gov> wrote:
Yesterday, MDL pushed version 4.5 of our Whole Story Uncertainty & Probabilities (WSUP) Viewer to VLab production. The WSUP prototype is being developed to investigate the feasibility of using the public cloud to visually convey whole story uncertainty and probabilistic forecast information to NWS forecast offices nationwide that is currently only available on supercomputers at the National Centers for Environmental Prediction (NCEP).

This WSUP version provides improved drawing of layers on the map with more options, including the much requested ability to add custom sample points to the map display.

As you know, WSUP keeps only a couple weeks of NBM and NDFD grids online. To look at maps of older NBM and NDFD grids, we have now implemented an NBM/NDFD Archive Viewer. These grids are pulled from the "Big Data" archive on AWS, which extends back to April 2020.

I would also like to draw your attention to a new cloud option for low bandwidth users of NDFD. This new site, graphical.mdl.nws.noaa.gov (modeled after graphical.weather.gov), provides simple map graphics by making WMS calls to digital.mdl.nws.noaa.gov on-the-fly. Users can get simple graphics for all NDFD elements, not just those that were available prior to the implementation of digital.weather.gov. The bandwidth required for NDFD's digital website to work properly has been a recurring complaint from low end users for many years. A simple mouseover menu (ala graphical.weather.gov) is also preferred by some. The availability of this new site on AWS should make it easier for the NWS to retire the legacy NIDS sites.

Please use our VLab community to communicate bugs, suggestions, or general discussion. As always, the latest WSUP Viewer release notes can be found under announcements in the VLab WSUP forum.

DR



--
Jack Settelmaier

Attachments:

Attachment

DR
David Ruth, modified 3 Years ago.

RE: Re: Whole Story Uncertainty and Probabilities Viewer v4.5 (and more)

Youngling Posts: 32 Join Date: 5/12/15 Recent Posts

Jack,

1)  The Big Data archive viewer reads GeoTIFFs for NBM and GRIBv2 for NDFD.

2) No.  Dave Miller plans to email you what he knows about accessing NBM and NDFD Big Data via ArcGIS Pro.

3) We are in the process of adding RTMA and a grid difference function to the Big Data archive viewer.    To my knowledge, URMA and WPC are not available via Big Data.   We have no plan to arrange the maps into multiple panels.

4)  The WMS is on the back-end.   We will be able to provide a public-facing WMS from digital after we install a new MapCache version.

5)  Graphical.mdl.nws.noaa.gov is public-facing.    Users can link to images on the new graphical just like they could from graphical.weather.gov on NIDS.

For example, https://graphical.weather.gov/supplementalpages/view_image.php?image=../images/conus/MaxT1_conus.png is now https://graphical.mdl.nws.noaa.gov/supplementalpages/view_image.php?sector=CONUS&element=maxt&n=1

I should also note that the new graphical has a nifty download image function that enables you to create small, medium, or large images via the WMS.

DR

On 4/5/2022 3:52 PM, Jack Settelmaier wrote:
Dave, 

This "additional aspects" email of your WSUP v4.5 upgrade does not seem to be a Forum post from which I can respond and ask questions, so I'm making one with this email to ask a few questions.

It's awesome to see the NBM/NDFD Archive Viewer, feeding off NODD AWS data endpoints, in place and usable!!
  1) Does the code read the GRIB on the fly to create, or are the geoTIFFS being used?  I assume the latter, but the ability to see the S3 link had me wondering.
  1a) I like that the S3 link "decodes" the user's request and shows which WMO-encoded GRIB files were the base data. 
  2) When one hits submit, is there a URL used that can be used, and modified, directly to grab a series of images?
  3) Given this implementation, one of our SR SOOs asked if we might see the return of the 4-panel viewer to easily compare NBM, NDFD, RTMA/URMA, WPC, etc.

For the new graphical.mdl.nws.noaa.gov site, and how it displays images....
  4) Is the WMS step only used "in the server back-end" to return an image to the webpage, or is there a public-facing WMS link that one can point to/alter, for potential use in other interfaces that can consume WMS?
  5) Is this graphical.mdl.nws.noaa.gov public-facing?

On Tue, Apr 5, 2022 at 10:07 AM David.Ruth <david.ruth@noaa.gov> wrote:
Yesterday, MDL pushed version 4.5 of our Whole Story Uncertainty & Probabilities (WSUP) Viewer to VLab production. The WSUP prototype is being developed to investigate the feasibility of using the public cloud to visually convey whole story uncertainty and probabilistic forecast information to NWS forecast offices nationwide that is currently only available on supercomputers at the National Centers for Environmental Prediction (NCEP).

This WSUP version provides improved drawing of layers on the map with more options, including the much requested ability to add custom sample points to the map display.

As you know, WSUP keeps only a couple weeks of NBM and NDFD grids online. To look at maps of older NBM and NDFD grids, we have now implemented an NBM/NDFD Archive Viewer. These grids are pulled from the "Big Data" archive on AWS, which extends back to April 2020.

I would also like to draw your attention to a new cloud option for low bandwidth users of NDFD. This new site, graphical.mdl.nws.noaa.gov (modeled after graphical.weather.gov), provides simple map graphics by making WMS calls to digital.mdl.nws.noaa.gov on-the-fly. Users can get simple graphics for all NDFD elements, not just those that were available prior to the implementation of digital.weather.gov. The bandwidth required for NDFD's digital website to work properly has been a recurring complaint from low end users for many years. A simple mouseover menu (ala graphical.weather.gov) is also preferred by some. The availability of this new site on AWS should make it easier for the NWS to retire the legacy NIDS sites.

Please use our VLab community to communicate bugs, suggestions, or general discussion. As always, the latest WSUP Viewer release notes can be found under announcements in the VLab WSUP forum.

DR



--
Jack Settelmaier

--
Jack Settelmaier Whole Story Uncertainty & Probabilities Viewer Virtual Lab Forum http://vlab.noaa.gov/web/wsup/forums/-/message_boards/view_message/21544978VLab.Notifications@noaa.gov
JS
Jack Settelmaier, modified 3 Years ago.

RE: Re: Whole Story Uncertainty and Probabilities Viewer v4.5 (and more)

Youngling Posts: 67 Join Date: 11/2/12 Recent Posts
On Wed, Apr 6, 2022 at 2:06 PM David Ruth <VLab.Notifications@noaa.gov> wrote:

Jack,

1)  The Big Data archive viewer reads GeoTIFFs for NBM and GRIBv2 for NDFD.

So the viewer converts GRIB2 to an image on the fly for NDFD?  What code, if I may ask? 

2) No.  Dave Miller plans to email you what he knows about accessing NBM and NDFD Big Data via ArcGIS Pro.

Thanks, got his email. 

3) We are in the process of adding RTMA and a grid difference function to the Big Data archive viewer.    To my knowledge, URMA and WPC are not available via Big Data.   We have no plan to arrange the maps into multiple panels.

Thanks. 

4)  The WMS is on the back-end.   We will be able to provide a public-facing WMS from digital after we install a new MapCache version.

Thanks. 

5)  Graphical.mdl.nws.noaa.gov is public-facing.    Users can link to images on the new graphical just like they could from graphical.weather.gov on NIDS.

For example, https://graphical.weather.gov/supplementalpages/view_image.php?image=../images/conus/MaxT1_conus.png is now https://graphical.mdl.nws.noaa.gov/supplementalpages/view_image.php?sector=CONUS&element=maxt&n=1

I should also note that the new graphical has a nifty download image function that enables you to create small, medium, or large images via the WMS.

Wonderful!

Great work in providing these extra functions in WSUP!! 

DR

On 4/5/2022 3:52 PM, Jack Settelmaier wrote:
Dave, 

This "additional aspects" email of your WSUP v4.5 upgrade does not seem to be a Forum post from which I can respond and ask questions, so I'm making one with this email to ask a few questions.

It's awesome to see the NBM/NDFD Archive Viewer, feeding off NODD AWS data endpoints, in place and usable!!
  1) Does the code read the GRIB on the fly to create, or are the geoTIFFS being used?  I assume the latter, but the ability to see the S3 link had me wondering.
  1a) I like that the S3 link "decodes" the user's request and shows which WMO-encoded GRIB files were the base data. 
  2) When one hits submit, is there a URL used that can be used, and modified, directly to grab a series of images?
  3) Given this implementation, one of our SR SOOs asked if we might see the return of the 4-panel viewer to easily compare NBM, NDFD, RTMA/URMA, WPC, etc.

For the new graphical.mdl.nws.noaa.gov site, and how it displays images....
  4) Is the WMS step only used "in the server back-end" to return an image to the webpage, or is there a public-facing WMS link that one can point to/alter, for potential use in other interfaces that can consume WMS?
  5) Is this graphical.mdl.nws.noaa.gov public-facing?

On Tue, Apr 5, 2022 at 10:07 AM David.Ruth <david.ruth@noaa.gov> wrote:
Yesterday, MDL pushed version 4.5 of our Whole Story Uncertainty & Probabilities (WSUP) Viewer to VLab production. The WSUP prototype is being developed to investigate the feasibility of using the public cloud to visually convey whole story uncertainty and probabilistic forecast information to NWS forecast offices nationwide that is currently only available on supercomputers at the National Centers for Environmental Prediction (NCEP).

This WSUP version provides improved drawing of layers on the map with more options, including the much requested ability to add custom sample points to the map display.

As you know, WSUP keeps only a couple weeks of NBM and NDFD grids online. To look at maps of older NBM and NDFD grids, we have now implemented an NBM/NDFD Archive Viewer. These grids are pulled from the "Big Data" archive on AWS, which extends back to April 2020.

I would also like to draw your attention to a new cloud option for low bandwidth users of NDFD. This new site, graphical.mdl.nws.noaa.gov (modeled after graphical.weather.gov), provides simple map graphics by making WMS calls to digital.mdl.nws.noaa.gov on-the-fly. Users can get simple graphics for all NDFD elements, not just those that were available prior to the implementation of digital.weather.gov. The bandwidth required for NDFD's digital website to work properly has been a recurring complaint from low end users for many years. A simple mouseover menu (ala graphical.weather.gov) is also preferred by some. The availability of this new site on AWS should make it easier for the NWS to retire the legacy NIDS sites.

Please use our VLab community to communicate bugs, suggestions, or general discussion. As always, the latest WSUP Viewer release notes can be found under announcements in the VLab WSUP forum.

DR



--
Jack Settelmaier

--
Jack Settelmaier Whole Story Uncertainty & Probabilities Viewer Virtual Lab Forum http://vlab.noaa.gov/web/wsup/forums/-/message_boards/view_message/21544978VLab.Notifications@noaa.gov

--
David Ruth Whole Story Uncertainty & Probabilities Viewer Virtual Lab Forum http://vlab.noaa.gov/web/wsup/forums/-/message_boards/view_message/21573822VLab.Notifications@noaa.gov


--
Jack Settelmaier
Digital Techniques Meteorologist
NOAA/NWS, Southern Region HQ
Fort Worth, TX 
Work Desk: 682 703 3685
Virtual Office (most core work hours): https://meet.google.com/ujm-ajkv-rhk
DR
David Ruth, modified 3 Years ago.

RE: Re: Whole Story Uncertainty and Probabilities Viewer v4.5 (and more)

Youngling Posts: 32 Join Date: 5/12/15 Recent Posts

The Big Data archive viewer uses MapServer which renders images directly from GRIB.

DR

On 4/8/2022 4:27 PM, Jack Settelmaier wrote:
On Wed, Apr 6, 2022 at 2:06 PM David Ruth <VLab.Notifications@noaa.gov> wrote:

Jack,

1)  The Big Data archive viewer reads GeoTIFFs for NBM and GRIBv2 for NDFD.

So the viewer converts GRIB2 to an image on the fly for NDFD?  What code, if I may ask? 

2) No.  Dave Miller plans to email you what he knows about accessing NBM and NDFD Big Data via ArcGIS Pro.

Thanks, got his email. 

3) We are in the process of adding RTMA and a grid difference function to the Big Data archive viewer.    To my knowledge, URMA and WPC are not available via Big Data.   We have no plan to arrange the maps into multiple panels.

Thanks. 

4)  The WMS is on the back-end.   We will be able to provide a public-facing WMS from digital after we install a new MapCache version.

Thanks. 

5)  Graphical.mdl.nws.noaa.gov is public-facing.    Users can link to images on the new graphical just like they could from graphical.weather.gov on NIDS.

For example, https://graphical.weather.gov/supplementalpages/view_image.php?image=../images/conus/MaxT1_conus.png is now https://graphical.mdl.nws.noaa.gov/supplementalpages/view_image.php?sector=CONUS&element=maxt&n=1

I should also note that the new graphical has a nifty download image function that enables you to create small, medium, or large images via the WMS.

Wonderful!

Great work in providing these extra functions in WSUP!! 

DR

On 4/5/2022 3:52 PM, Jack Settelmaier wrote:
Dave, 

This "additional aspects" email of your WSUP v4.5 upgrade does not seem to be a Forum post from which I can respond and ask questions, so I'm making one with this email to ask a few questions.

It's awesome to see the NBM/NDFD Archive Viewer, feeding off NODD AWS data endpoints, in place and usable!!
  1) Does the code read the GRIB on the fly to create, or are the geoTIFFS being used?  I assume the latter, but the ability to see the S3 link had me wondering.
  1a) I like that the S3 link "decodes" the user's request and shows which WMO-encoded GRIB files were the base data. 
  2) When one hits submit, is there a URL used that can be used, and modified, directly to grab a series of images?
  3) Given this implementation, one of our SR SOOs asked if we might see the return of the 4-panel viewer to easily compare NBM, NDFD, RTMA/URMA, WPC, etc.

For the new graphical.mdl.nws.noaa.gov site, and how it displays images....
  4) Is the WMS step only used "in the server back-end" to return an image to the webpage, or is there a public-facing WMS link that one can point to/alter, for potential use in other interfaces that can consume WMS?
  5) Is this graphical.mdl.nws.noaa.gov public-facing?

On Tue, Apr 5, 2022 at 10:07 AM David.Ruth <david.ruth@noaa.gov> wrote:
Yesterday, MDL pushed version 4.5 of our Whole Story Uncertainty & Probabilities (WSUP) Viewer to VLab production. The WSUP prototype is being developed to investigate the feasibility of using the public cloud to visually convey whole story uncertainty and probabilistic forecast information to NWS forecast offices nationwide that is currently only available on supercomputers at the National Centers for Environmental Prediction (NCEP).

This WSUP version provides improved drawing of layers on the map with more options, including the much requested ability to add custom sample points to the map display.

As you know, WSUP keeps only a couple weeks of NBM and NDFD grids online. To look at maps of older NBM and NDFD grids, we have now implemented an NBM/NDFD Archive Viewer. These grids are pulled from the "Big Data" archive on AWS, which extends back to April 2020.

I would also like to draw your attention to a new cloud option for low bandwidth users of NDFD. This new site, graphical.mdl.nws.noaa.gov (modeled after graphical.weather.gov), provides simple map graphics by making WMS calls to digital.mdl.nws.noaa.gov on-the-fly. Users can get simple graphics for all NDFD elements, not just those that were available prior to the implementation of digital.weather.gov. The bandwidth required for NDFD's digital website to work properly has been a recurring complaint from low end users for many years. A simple mouseover menu (ala graphical.weather.gov) is also preferred by some. The availability of this new site on AWS should make it easier for the NWS to retire the legacy NIDS sites.

Please use our VLab community to communicate bugs, suggestions, or general discussion. As always, the latest WSUP Viewer release notes can be found under announcements in the VLab WSUP forum.

DR



--
Jack Settelmaier

--
Jack Settelmaier Whole Story Uncertainty & Probabilities Viewer Virtual Lab Forum http://vlab.noaa.gov/web/wsup/forums/-/message_boards/view_message/21544978VLab.Notifications@noaa.gov

--
David Ruth Whole Story Uncertainty & Probabilities Viewer Virtual Lab Forum http://vlab.noaa.gov/web/wsup/forums/-/message_boards/view_message/21573822VLab.Notifications@noaa.gov


--
Jack Settelmaier
Digital Techniques Meteorologist
NOAA/NWS, Southern Region HQ
Fort Worth, TX 
Work Desk: 682 703 3685
Virtual Office (most core work hours): https://meet.google.com/ujm-ajkv-rhk

--
Jack Settelmaier Whole Story Uncertainty & Probabilities Viewer Virtual Lab Forum http://vlab.noaa.gov/web/wsup/forums/-/message_boards/view_message/21608437VLab.Notifications@noaa.gov
PS
Paul Schlatter, modified 3 Years ago.

RE: Re: Whole Story Uncertainty and Probabilities Viewer v4.5 (and more)

Youngling Posts: 1 Join Date: 5/20/13 Recent Posts

Dave,

Thanks to you and the team at MDL for developing the NBM archive.  I've already grabbed 20 images from a major event we had several months ago.  The interface is overall fantastic.  The only critique I have of the archive viewer is that you can't preserve the zoom and centerpoint of the graphics so you can easily compare one to another.  

 

The other request that is probably not possible is to include NBMv4.1 into the archive.  I know that's a long shot, but has there been any discussion on that?