Forums (Forecast Builder)

Back

Bring back "populate from model" option for PoTThunder

JM
Joseph Moore, modified 5 Years ago.

Bring back "populate from model" option for PoTThunder

Padawan Posts: 88 Join Date: 11/1/13 Recent Posts

Hello! I believe this feedback has already been shared, but I just wanted to chime in and say it has really been a loss to lose the default "populate from model" option for PotThunder that used the SREF/MOSGuide probabilities. As I've shared before with the FB Developers, while the SREF/MOSGuide probs aren't perfect, in most cases (especially mid to long range) they were great at capturing those widespread-showers-isolated-thunder scenarios and provided a much more valuable forecast for our partners as opposed to the old and much less useful alternative of PoP = PoTThunder, which is what we have been recommended to use since NBM PoTThunder is way too low.

Thanks for listening!

JT
Justin Titus, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 33 Join Date: 10/24/15 Recent Posts
Here ya go, Joe! Thanks for bringing it up!
 
Justin
 
---------- Forwarded message ---------
From: Bruce Smith - NOAA Federal <bruce.smith@noaa.gov>
Date: Fri, Jun 7, 2019 at 3:31 PM
Subject: NBM and PotThunder
To: _NWS CR SOO <cr.soo@noaa.gov>
Cc: <cr.mic@noaa.gov>, _NWS CR WCM <cr.wcm@noaa.gov>, _NWS CR ITO <cr.ito@noaa.gov>, _NWS CR ESA <cr.esa@noaa.gov>, _NWS CR SSD <cr.ssd@noaa.gov>


 

CR SOOs:
 
Shortly after our NBM V3.1 switch earlier this week, it became apparent that some forecasters were relying on a ForecastBuilder capability for PotThunder that was removed during the switch.  Consequently, a CR Tech Order will be distributed early next week to update ForecastBuilder to depict the following three options for PotThunder:
  1. From PoP
  2. NBM (default)
  3. Experimental Combo
Option 3, previously removed, will be restored (this is the popular technique developed by Ariel Cohen and Chauncy Shultz that combines lapse rates, PoP, and probabilities from the SREF and MOSGuide).
 
Please continue to encourage your forecasters to provide NBM feedback.  In most cases, we expect to elevate concerns or suggestions to NBM developers for evaluation and possible implementation.  The CRGMAT and SSD want to remain responsive to your comments, and work together to help the NBM continually improve.   
 
Please share with your forecast staff.
 
Thanks...CR SSD
 
--
Bruce B. Smith - Chief, Science & Technology Integration (STI/SSD)
NOAA/NWS/Central Region Headquarters, Kansas City MO
989.370.8976 (c) 816.268.3110 (w)
JM
Joseph Moore, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 88 Join Date: 11/1/13 Recent Posts
Thank you for sharing that, Justin. But to clarify, the "experimental combo" is not what I am asking for - I would like the old blend that used SREF/MOSGuide (as available) thunder probabilities, not the "combo," since I found the combo method performed poorly compared to the SREF/MOSGuide calibrated probabilities. I think this option was just called "Blend of models" in the GUI. Is it possible to have this as an option as well as NBM?

Thanks,
Joe

On Fri, Jun 7, 2019 at 8:33 PM Justin Titus <VLab.Notifications@noaa.gov> wrote:
Here ya go, Joe! Thanks for bringing it up!
 
Justin
 
---------- Forwarded message ---------
From: Bruce Smith - NOAA Federal <bruce.smith@noaa.gov>
Date: Fri, Jun 7, 2019 at 3:31 PM
Subject: NBM and PotThunder
To: _NWS CR SOO <cr.soo@noaa.gov>
Cc: <cr.mic@noaa.gov>, _NWS CR WCM <cr.wcm@noaa.gov>, _NWS CR ITO <cr.ito@noaa.gov>, _NWS CR ESA <cr.esa@noaa.gov>, _NWS CR SSD <cr.ssd@noaa.gov>


 

CR SOOs:
 
Shortly after our NBM V3.1 switch earlier this week, it became apparent that some forecasters were relying on a ForecastBuilder capability for PotThunder that was removed during the switch.  Consequently, a CR Tech Order will be distributed early next week to update ForecastBuilder to depict the following three options for PotThunder:
  1. From PoP
  2. NBM (default)
  3. Experimental Combo
Option 3, previously removed, will be restored (this is the popular technique developed by Ariel Cohen and Chauncy Shultz that combines lapse rates, PoP, and probabilities from the SREF and MOSGuide).
 
Please continue to encourage your forecasters to provide NBM feedback.  In most cases, we expect to elevate concerns or suggestions to NBM developers for evaluation and possible implementation.  The CRGMAT and SSD want to remain responsive to your comments, and work together to help the NBM continually improve.   
 
Please share with your forecast staff.
 
Thanks...CR SSD
 
--
Bruce B. Smith - Chief, Science & Technology Integration (STI/SSD)
NOAA/NWS/Central Region Headquarters, Kansas City MO
989.370.8976 (c) 816.268.3110 (w)
Virtual Lab Message Boards https://vlab.noaa.gov/web/forecastbuilder/forums/-/message_boards/view_message/6797927 VLab.Notifications@noaa.gov http://vlab.noaa.gov


--
Joseph J. Moore
Meteorologist
NOAA/National Weather Service Duluth, MN
weather.gov/duluth | 218-729-0653
JT
Justin Titus, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 33 Join Date: 10/24/15 Recent Posts
Ah, I see, sorry for the confusion. This is a topic of discussion in both the CR GMAT and the ForecastBuilder Development teams.

Thanks!
Justin

On Mon, Jun 10, 2019 at 5:06 PM Joseph Moore <VLab.Notifications@noaa.gov> wrote:
Thank you for sharing that, Justin. But to clarify, the "experimental combo" is not what I am asking for - I would like the old blend that used SREF/MOSGuide (as available) thunder probabilities, not the "combo," since I found the combo method performed poorly compared to the SREF/MOSGuide calibrated probabilities. I think this option was just called "Blend of models" in the GUI. Is it possible to have this as an option as well as NBM?

Thanks,
Joe

On Fri, Jun 7, 2019 at 8:33 PM Justin Titus <VLab.Notifications@noaa.gov> wrote:
Here ya go, Joe! Thanks for bringing it up!
 
Justin
 
---------- Forwarded message ---------
From: Bruce Smith - NOAA Federal <bruce.smith@noaa.gov>
Date: Fri, Jun 7, 2019 at 3:31 PM
Subject: NBM and PotThunder
To: _NWS CR SOO <cr.soo@noaa.gov>
Cc: <cr.mic@noaa.gov>, _NWS CR WCM <cr.wcm@noaa.gov>, _NWS CR ITO <cr.ito@noaa.gov>, _NWS CR ESA <cr.esa@noaa.gov>, _NWS CR SSD <cr.ssd@noaa.gov>


 

CR SOOs:
 
Shortly after our NBM V3.1 switch earlier this week, it became apparent that some forecasters were relying on a ForecastBuilder capability for PotThunder that was removed during the switch.  Consequently, a CR Tech Order will be distributed early next week to update ForecastBuilder to depict the following three options for PotThunder:
  1. From PoP
  2. NBM (default)
  3. Experimental Combo
Option 3, previously removed, will be restored (this is the popular technique developed by Ariel Cohen and Chauncy Shultz that combines lapse rates, PoP, and probabilities from the SREF and MOSGuide).
 
Please continue to encourage your forecasters to provide NBM feedback.  In most cases, we expect to elevate concerns or suggestions to NBM developers for evaluation and possible implementation.  The CRGMAT and SSD want to remain responsive to your comments, and work together to help the NBM continually improve.   
 
Please share with your forecast staff.
 
Thanks...CR SSD
 
--
Bruce B. Smith - Chief, Science & Technology Integration (STI/SSD)
NOAA/NWS/Central Region Headquarters, Kansas City MO
989.370.8976 (c) 816.268.3110 (w)
Virtual Lab Message Boards https://vlab.noaa.gov/web/forecastbuilder/forums/-/message_boards/view_message/6797927 VLab.Notifications@noaa.gov http://vlab.noaa.gov


--
Joseph J. Moore
Meteorologist
NOAA/National Weather Service Duluth, MN
weather.gov/duluth | 218-729-0653
Virtual Lab Message Boards http://vlab.noaa.gov/web/forecastbuilder/forums/-/message_boards/view_message/6819128 VLab.Notifications@noaa.gov http://vlab.noaa.gov
John Keyes, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Youngling Posts: 5 Join Date: 7/17/13 Recent Posts

Are these discussions that we are privy to, or just left wondering what they are about?  :-)  

 

I would agree with Joe that option he mentioned is really preferred.   The probabilities generated where a much better starting point to create grids from, especially for fire weather purposes.  If anything, they could be about 10% too high at times.    

AJ
Andy Just, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 99 Join Date: 6/2/15 Recent Posts

I would like to thank everyone for providing feedback on the topic of thunder as it remains challenging, as it did before the NBM transition.  One benefit that has come out of this transition is getting some idea of what option(s) were in use out in the field.   Additionally we are getting some good feedback on the NBM thunderstorm probabilities.  To summarize the feedback and issues thus far (includes those pre-NBM transition):

 

1. The 12 hour NBM thunderstorm probabilities are not useful because of the 6 hour PoP population.

2. There are National SmartInit issues with the NBM thunderstorm probabilities, as noted in NIC ticket 64921.   NBM thunderstorm probabilities actually come in every 6 hours, representing a 12 hour period (note MOSGuide is similar to this).  This could partially solve item #1 above.

3. Feedback goes both ways in terms of utilizing the previous SREF/MOSGuide blend of thunderstorm probabilities and the Experimental Combo method.  Please note that the reason the SREF/MOSGuide blend was not put back into ForecastBuilder is that it is identical to the NBM.

4. The SREF, MOSGuide and NBM thunderstorm probability guidance is all calibrated to cloud to ground lightning, 0.01" of QPF, and the temporal time period of the guidance. These combine to produce low values for these data sets.  The Experimental Combo method tries to rectify that and put probabilities more typical of what we are use to, while injecting some science research.

 

Further discussion of thunder issue will occur among regional and national teams based on the great feedback received thus far. 

JM
Joseph Moore, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 88 Join Date: 11/1/13 Recent Posts
Hey Andy,

The SREF/MOSGuide option is not the same as NBM. The NBM output is typically lower in my experience. This is why I was asking for it to be put back. I can provide examples if needed.

As I've said in previous feedback, I really feel like the SREF/MOSGuide option is good enough for what we're trying to achieve when it comes to the probability of thunder in our grids, but since the transition, NBM has been a step backwards because the probabilities are usually lower than what we had been including using the SREF/MOSGuide blend option.

-Joe

On Mon, Jun 17, 2019 at 8:51 AM Andy Just <VLab.Notifications@noaa.gov> wrote:

I would like to thank everyone for providing feedback on the topic of thunder as it remains challenging, as it did before the NBM transition.  One benefit that has come out of this transition is getting some idea of what option(s) were in use out in the field.   Additionally we are getting some good feedback on the NBM thunderstorm probabilities.  To summarize the feedback and issues thus far (includes those pre-NBM transition):

 

1. The 12 hour NBM thunderstorm probabilities are not useful because of the 6 hour PoP population.

2. There are National SmartInit issues with the NBM thunderstorm probabilities, as noted in NIC ticket 64921.   NBM thunderstorm probabilities actually come in every 6 hours, representing a 12 hour period (note MOSGuide is similar to this).  This could partially solve item #1 above.

3. Feedback goes both ways in terms of utilizing the previous SREF/MOSGuide blend of thunderstorm probabilities and the Experimental Combo method.  Please note that the reason the SREF/MOSGuide blend was not put back into ForecastBuilder is that it is identical to the NBM.

4. The SREF, MOSGuide and NBM thunderstorm probability guidance is all calibrated to cloud to ground lightning, 0.01" of QPF, and the temporal time period of the guidance. These combine to produce low values for these data sets.  The Experimental Combo method tries to rectify that and put probabilities more typical of what we are use to, while injecting some science research.

 

Further discussion of thunder issue will occur among regional and national teams based on the great feedback received thus far. 

Virtual Lab Message Boards https://vlab.noaa.gov/web/forecastbuilder/forums/-/message_boards/view_message/6872474 VLab.Notifications@noaa.gov http://vlab.noaa.gov


--
Joseph J. Moore
Meteorologist
NOAA/National Weather Service Duluth, MN
weather.gov/duluth | 218-729-0653
DB
David Barjenbruch, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Youngling Posts: 21 Join Date: 9/2/14 Recent Posts

Hi Joe,  I also like this suggestion, especially since the MOSGuide does have 6 hour guidance beyond Day 3 and all the way through Day 7.  It does a nice job showing the diurnal cycle of convection driven by our terrain.  The "combo" package using lapse rates and surface Td really doesn't work well here, as we usually have steep mid level lapse rates driven by downslope flow off the Front Range, giving us inconsistent PotThunder grids over time and space. 

DB
David Barjenbruch, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Youngling Posts: 21 Join Date: 9/2/14 Recent Posts

I should also add that traditional MOSGuide is scheduled to cease in November.  Ideally, the NBM would transition to a 6 hour Prob Thunder to capture the diurnal or even synoptic scale condition more accurately.  Hope is that the change can be made for NBM v4.0. 

Dave

AJ
Andy Just, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 99 Join Date: 6/2/15 Recent Posts

All,

  I want to let everyone know that discussion continues on this topic with many groups/teams, therefore thunder remains a work in progress.  There are two ultimate goals:

 

1. How to better utilize the NBM thunderstorm probabilities in ForecastBuilder

2. What improvements can be made to the NBM thunderstorm probabilities.

  

  Another good reason to focus on these goals is like David mentioned the MOSGuide is going away when NBM 3.2 goes operational this November. 

  

  One idea that could make thunder easier is to make it a "conditional" grid, i.e. what is the probability the environment supports thunder.  During the summer months, much of the time thunder would be 100% from day 1 -7, allowing the PoP to dictate the thunder verbiage.  The idea still needs to go through various teams prior to approval.

 

  As always feel free to share other ideas

John Keyes, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Youngling Posts: 5 Join Date: 7/17/13 Recent Posts

The problem with your last idea is that could create potential issues with thunderstorm coverage vs POP/shower coverage, which is important for those of us dealing with Red Flag Warnings.  If you go with the idea that the environment WILL support thunderstorms and therefore Pot_Thunder is 100%, but coverage is not going to be anywhere near that...you will run into a lot more editing of those grids down to where it gets the mention down to isolated, etc. vs what is going on now even with offices using FB.  

AJ
Andy Just, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 99 Join Date: 6/2/15 Recent Posts

John,

  I may have been incorrect in my statement that PotThunder will often be 100%.  An example is attached.  In the example, NBM data for 12Z June 28 - 00Z June 29 as a 36 hour forecast is provided for PoP12 (left) and TstmPrb12 (right).  Over northern Lower MI note that the thunderstorm probabilities are half or more of the PoP. Therefore the conditional probability would be ~50% in this area, compared to the rest of the domain where the conditional probability would be 100%.  Thus the weather verbiage would come out with "Showers and a chance of thunderstorms."   So I believe the NBM thunderstorm probabilities will pick up on lower coverage/probabilities situations when they arise.

  Regarding Red Flag Warnings, I'm assuming this might be more in relation to dry thunderstorm.  Discussion is ongoing but it is likely we are going to utilize the PotDryThunder grid instead, with thunder limited either by CWR and/or where QPF <= 0.10"   The good news here is we can populate dry thunder from the NBM (it's essentially a copy of the SREF which can be viewed on SPC's website). 

JM
Joseph Moore, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Padawan Posts: 88 Join Date: 11/1/13 Recent Posts
Andy/FB Team/CR-GMAT and others,

Bottom line up front: I'd really like the SREF/MOSGuide blend to return as the default PotThunder option, or at the very least to please include it as an option again in the PotThunder GUI, because I think it provided a much better first-guess/good-enough option for thunder possibilities over the current NBM. (Again, this is not the same as the experimental combo option that was also previously available.) An example case follows below:

Just wanted to pass along an example case from the mid-range timeframe. This is a case for the afternoon (21z-00z) period of this upcoming Wed July 3 as forecasted today (Mon July 1 day shift, so using 12z runs as latest available guidance). To be brief, we're expecting a fairly unstable airmass (1000-2000 j/kg SBCAPE), just 25-35 knots of shear with an along-front storm motion - nothing crazy, very low severe risk, just looking like showers and storms along and ahead of a front with perhaps a marginal localized flood risk. I want to make sure we have a widespread thunder mention, especially since this is day 3 and things could still change. SPC has general thunder in their forecast across the entire CWA, with a marginal risk just within the southwest corner of our CWA. (I included the GEFS plume for SBCAPE valid at KHIB, Hibbing, MN, which is about dead-center of the CWA graphics - it's the left dot in the near-perfect-square zone on the GFE screenshots.)

When looking at the screenshots, note that the current settings require a value of 15 or greater to include a thunder mention in the Wx grid. The NBM output is conservative, as is the gridded MOS (MOSGUIDE) output, but the SREF is a nice job painting where the risk for thunder may be, with the highest probability ~40% in the area most likely to see thunder. We/NBM have ~50% POPs in north-central MN during this time period. I checked NBM 3.2 as well, and found that its output was similarly too low for what I would like to include.

I realize this seems like a very minor issue, but I really need to include thunder in this time period. We have the predictability to say "yes, there is a real, legitimate chance for thunderstorms" in this timeframe, and this has value in a 3-day forecast. Northern Minnesota is full of resorts, campgrounds, family cabins, and hundreds of miles of forests where people are camping, often without access to cell phone service. Having an accurate 3-day forecast can be very important for safety - just by including "chance for thunderstorms" in the forecast might be the nudge someone needs to adjust their plans, or at the very least be mentally prepared to expect storms as opposed to just a "chance for rain/showers." There's plenty of spread in the guidance, but there is enough support to actually include a thunder mention in the wx grid. (Yes, sure, I can communicate this possibility for thunder in the HWO and social media graphics.... but I also would like to make sure this is included in my forecast that people will see on the point-n-click.)

Thanks,
Joe


On Fri, Jun 28, 2019 at 3:03 PM Andy Just <VLab.Notifications@noaa.gov> wrote:

John,

  I may have been incorrect in my statement that PotThunder will often be 100%.  An example is attached.  In the example, NBM data for 12Z June 28 - 00Z June 29 as a 36 hour forecast is provided for PoP12 (left) and TstmPrb12 (right).  Over northern Lower MI note that the thunderstorm probabilities are half or more of the PoP. Therefore the conditional probability would be ~50% in this area, compared to the rest of the domain where the conditional probability would be 100%.  Thus the weather verbiage would come out with "Showers and a chance of thunderstorms."   So I believe the NBM thunderstorm probabilities will pick up on lower coverage/probabilities situations when they arise.

  Regarding Red Flag Warnings, I'm assuming this might be more in relation to dry thunderstorm.  Discussion is ongoing but it is likely we are going to utilize the PotDryThunder grid instead, with thunder limited either by CWR and/or where QPF <= 0.10"   The good news here is we can populate dry thunder from the NBM (it's essentially a copy of the SREF which can be viewed on SPC's website). 

Virtual Lab Message Boards https://vlab.noaa.gov/web/forecastbuilder/forums/-/message_boards/view_message/6964743VLab.Notifications@noaa.govhttp://vlab.noaa.gov


--
Joseph J. Moore
Meteorologist
NOAA/National Weather Service Duluth, MN
weather.gov/duluth | 218-729-0653
John Keyes, modified 5 Years ago.

RE: Bring back "populate from model" option for PoTThunder

Youngling Posts: 5 Join Date: 7/17/13 Recent Posts

Going back to the DryThunder grid.   We are one of several offices (and the trend is slowly growing) that no longer use dry vs wet for issuing Red Flag Warnings.  We strictly base our criteria from thunderstorm coverage.  They DryThunder grid really has no use at our office, and likely for those using similar criteria.