New Perspectives on Ensemble Sensitivity Analysis with Applications to a Climatology of Severe Convection

Brian C. Ancell Texas Tech University, Lubbock, Texas

Search for other papers by Brian C. Ancell in
Current site
Google Scholar
PubMed
Close
and
Austin A. Coleman Texas Tech University, Lubbock, Texas

Search for other papers by Austin A. Coleman in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Ensemble sensitivity analysis (ESA) is a statistical technique applied within an ensemble to reveal the atmospheric flow features that relate to a chosen aspect of the flow. Given its ease of use (it is simply a linear regression between a chosen function of the forecast variables and the entire atmospheric state earlier or simultaneously in time), ensemble sensitivity has been the focus of several studies over roughly the last 10 years. Such studies have primarily tried to understand the relevant dynamics and/or key precursors of high-impact weather events. Other applications of ESA have been more operationally oriented, including observation targeting within data assimilation systems and real-time adjustment techniques that attempt to utilize both sensitivity information and observations to improve forecasts. While ESA has gained popularity, its fundamental properties remain a substantially underutilized basis for realizing the technique’s full scientific potential. For example, the relationship between ensemble sensitivity and the pure dynamics of the system can teach us how to appropriately apply various sensitivity-based applications, and combining sensitivity with other ensemble properties such as spread can distinguish between a fluid dynamics problem and a predictability one. This work aims to present new perspectives on ensemble sensitivity, and clarify its fundamentals, with the hopes of making it a more accessible, attractive, and useful tool in the atmospheric sciences. These new perspectives are applied in part to a short climatology of severe convection forecasts to demonstrate the unique knowledge that can gained through broadened use of ESA.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Brian C. Ancell, brian.ancell@ttu.edu

Abstract

Ensemble sensitivity analysis (ESA) is a statistical technique applied within an ensemble to reveal the atmospheric flow features that relate to a chosen aspect of the flow. Given its ease of use (it is simply a linear regression between a chosen function of the forecast variables and the entire atmospheric state earlier or simultaneously in time), ensemble sensitivity has been the focus of several studies over roughly the last 10 years. Such studies have primarily tried to understand the relevant dynamics and/or key precursors of high-impact weather events. Other applications of ESA have been more operationally oriented, including observation targeting within data assimilation systems and real-time adjustment techniques that attempt to utilize both sensitivity information and observations to improve forecasts. While ESA has gained popularity, its fundamental properties remain a substantially underutilized basis for realizing the technique’s full scientific potential. For example, the relationship between ensemble sensitivity and the pure dynamics of the system can teach us how to appropriately apply various sensitivity-based applications, and combining sensitivity with other ensemble properties such as spread can distinguish between a fluid dynamics problem and a predictability one. This work aims to present new perspectives on ensemble sensitivity, and clarify its fundamentals, with the hopes of making it a more accessible, attractive, and useful tool in the atmospheric sciences. These new perspectives are applied in part to a short climatology of severe convection forecasts to demonstrate the unique knowledge that can gained through broadened use of ESA.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Brian C. Ancell, brian.ancell@ttu.edu
Save
  • Ancell, B. C. , 2016: Improving high-impact forecasts through sensitivity-based ensemble subsets: Demonstration and initial tests. Wea. Forecasting, 31, 10191036, https://doi.org/10.1175/WAF-D-15-0121.1.

    • Search Google Scholar
    • Export Citation
  • Ancell, B. C. , and C. F. Mass , 2006: Structure, growth rates, and tangent linear accuracy of adjoint sensitivities with respect to horizontal and vertical resolution. Mon. Wea. Rev., 134, 29712988, https://doi.org/10.1175/MWR3227.1.

    • Search Google Scholar
    • Export Citation
  • Ancell, B. C. , and G. J. Hakim , 2007: Comparing ensemble and adjoint sensitivity analysis with applications to observation targeting. Mon. Wea. Rev., 135, 41174134, https://doi.org/10.1175/2007MWR1904.1.

    • Search Google Scholar
    • Export Citation
  • Ancell, B. C. , E. Kashawlic , and J. L. Schroeder , 2015: Evaluation of wind forecasts and observation impacts from variational and ensemble data assimilation for wind energy applications. Mon. Wea. Rev., 143, 32303245, https://doi.org/10.1175/MWR-D-15-0001.1.

    • Search Google Scholar
    • Export Citation
  • Anderson, J. , T. Hoar , K. Raeder , H. Liu , N. Collins , R. Torn , and A. Avellano , 2009: The Data Assimilation Research Testbed: A community facility. Bull. Amer. Meteor. Soc., 90, 12831296, https://doi.org/10.1175/2009BAMS2618.1.

    • Search Google Scholar
    • Export Citation
  • Bednarczyk, C. N. , and B. C. Ancell , 2015: Ensemble sensitivity analysis applied to a Southern Plains convective event. Mon. Wea. Rev., 143, 230249, https://doi.org/10.1175/MWR-D-13-00321.1.

    • Search Google Scholar
    • Export Citation
  • Berman, J. D. , and R. D. Torn , 2019: The impact of initial condition and warm conveyor belt forecast uncertainty on variability in the downstream waveguide in an ECWMF case study. Mon. Wea. Rev., 147, 40714089, https://doi.org/10.1175/MWR-D-18-0333.1.

    • Search Google Scholar
    • Export Citation
  • Berman, J. D. , R. D. Torn , G. S. Romine , and M. L. Weisman , 2017: Sensitivity of northern Great Plains convection forecasts to upstream and downstream forecast errors. Mon. Wea. Rev., 145, 21412163, https://doi.org/10.1175/MWR-D-16-0353.1.

    • Search Google Scholar
    • Export Citation
  • Chang, E. K. M. , M. Zhang , and K. Raeder , 2013: Medium-range ensemble sensitivity analysis of two extreme Pacific extratropical cyclones. Mon. Wea. Rev., 141, 211231, https://doi.org/10.1175/MWR-D-11-00304.1.

    • Search Google Scholar
    • Export Citation
  • Coleman, A. A. , and B. C. Ancell , 2020: Toward the improvement of high-impact probabilistic forecasts with a sensitivity-based convective-scale ensemble subsetting technique. Mon. Wea. Rev., 148, 49955014, https://doi.org/10.1175/MWR-D-20-0043.1.

    • Search Google Scholar
    • Export Citation
  • Errico, R. M. , 1997: What is an adjoint model? Bull. Amer. Meteor. Soc., 78, 25772591, https://doi.org/10.1175/1520-0477(1997)078<2577:WIAAM>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Hacker, J. P. , and L. Lei , 2015: Multivariate ensemble sensitivity with localization. Mon. Wea. Rev., 143, 20132027, https://doi.org/10.1175/MWR-D-14-00309.1.

    • Search Google Scholar
    • Export Citation
  • Hakim, G. J. , and R. D. Torn , 2008: Ensemble synoptic analysis. Synoptic– Dynamic Meteorology and Weather Analysis and Forecasting: A Tribute to Fred Sanders, Meteor. Monogr., No. 55, Amer. Meteor. Soc., 147162, https://doi.org/10.1007/978-0-933876-68-2_7.

    • Search Google Scholar
    • Export Citation
  • Hanley, K. E. , D. J. Kirshbaum , N. M. Roberts , and G. Leoncini , 2013: Sensitivities of a squall line over central Europe in a convective-scale ensemble. Mon. Wea. Rev., 141, 112133, https://doi.org/10.1175/MWR-D-12-00013.1.

    • Search Google Scholar
    • Export Citation
  • Hill, A. J. , C. C. Weiss , and B. C. Ancell , 2016: Ensemble sensitivity analysis for mesoscale forecasts of convection initiation. Mon. Wea. Rev., 144, 41614182, https://doi.org/10.1175/MWR-D-15-0338.1.

    • Search Google Scholar
    • Export Citation
  • Hill, A. J. , C. C. Weiss , and B. C. Ancell , 2020: Factors influencing ensemble sensitivity–based targeted observing predictions at convection-allowing resolutions. Mon. Wea. Rev., 148, 44974517, https://doi.org/10.1175/MWR-D-20-0015.1.

    • Search Google Scholar
    • Export Citation
  • Hu, C.-C. , and C.-C. Wu , 2020: Ensemble sensitivity analysis of tropical cyclone intensification rate during the development stage. J. Atmos. Sci., 77, 33873405, https://doi.org/10.1175/JAS-D-19-0196.1.

    • Search Google Scholar
    • Export Citation
  • Kerr, C. A. , D. J. Stensrud , and X. Wang , 2019: Diagnosing convective dependencies on near-storm environments using ensemble sensitivity analyses. Mon. Wea. Rev., 147, 495517, https://doi.org/10.1175/MWR-D-18-0140.1.

    • Search Google Scholar
    • Export Citation
  • Limpert, G. L. , and A. L. Houston , 2018: Ensemble sensitivity analysis for targeted observations of supercell thunderstorms. Mon. Wea. Rev., 146, 17051721, https://doi.org/10.1175/MWR-D-17-0029.1.

    • Search Google Scholar
    • Export Citation
  • Madaus, L. E. , and G. J. Hakim , 2015: Rapid, short-term ensemble forecast adjustment through offline data assimilation. Quart. J. Roy. Meteor. Soc., 141, 26302642, https://doi.org/10.1002/qj.2549.

    • Search Google Scholar
    • Export Citation
  • Markowski, P. M. , and Y. P. Richardson , 2014: What we know and don’t know about tornado formation. Phys. Today, 67, 2631, https://doi.org/10.1063/PT.3.2514.

    • Search Google Scholar
    • Export Citation
  • McMurdie, L. A. , and B. C. Ancell , 2014: Predictability characteristics of landfalling cyclones along the North American west coast. Mon. Wea. Rev., 142, 301319, https://doi.org/10.1175/MWR-D-13-00141.1.

    • Search Google Scholar
    • Export Citation
  • Melhauser, C. , and F. Zhang , 2012: Practical and intrinsic predictability of severe and convective weather at the mesoscales. J. Atmos. Sci., 69, 33503371, https://doi.org/10.1175/JAS-D-11-0315.1.

    • Search Google Scholar
    • Export Citation
  • Nystrom, R. G. , F. Zhang , E. B. Munsell , S. A. Braun , J. A. Sippel , Y. Wang , and K. A. Emanuel , 2018: Predictability and dynamics of Hurricane Joaquin (2015) explored through convection-permitting ensemble sensitivity experiments. J. Atmos. Sci., 75, 401424, https://doi.org/10.1175/JAS-D-17-0137.1.

    • Search Google Scholar
    • Export Citation
  • Parker, T. , T. Woollings , and A. Weisheimer , 2018: Ensemble sensitivity analysis of Greenland blocking in medium-range forecasts. Quart. J. Roy. Meteor. Soc., 144, 23582379, https://doi.org/10.1002/qj.3391.

    • Search Google Scholar
    • Export Citation
  • Quandt, L.-A. , and Coauthors, 2019: Ensemble sensitivity analysis of the blocking system over Russia in summer 2010. Mon. Wea. Rev., 147, 657675, https://doi.org/10.1175/MWR-D-18-0252.1.

    • Search Google Scholar
    • Export Citation
  • Ren, S. , L. Lei , Z.-M. Tan , and Y. Zhang , 2019: Multivariate ensemble sensitivity analysis for Super Typhoon Haiyan (2013). Mon. Wea. Rev., 147, 34673480, https://doi.org/10.1175/MWR-D-19-0074.1.

    • Search Google Scholar
    • Export Citation
  • Skamarock, W. C. , and Coauthors, 2008: A description of the Advanced Research WRF version 3. NCAR Tech. Note NCAR/TN-475+STR, 113 pp., https://doi.org/10.5065/D68S4MVH.

    • Search Google Scholar
    • Export Citation
  • Smith, N. H. , and B. C. Ancell , 2017: Ensemble sensitivity analysis of wind ramp events with applications to observation targeting. Mon. Wea. Rev., 145, 25052522, https://doi.org/10.1175/MWR-D-16-0306.1.

    • Search Google Scholar
    • Export Citation
  • Talagrand, O. , and P. Courtier , 1987: Variational assimilation of meteorological observations with the adjoint vorticity equation. I: Theory. Quart .J. Roy. Meteor. Soc., 113, 13111328, https://doi.org/10.1002/qj.49711347812.

    • Search Google Scholar
    • Export Citation
  • Torn, R. D. , 2010: Ensemble-based sensitivity analysis applied to African easterly waves. Wea. Forecasting, 25, 6178, https://doi.org/10.1175/2009WAF2222255.1.

    • Search Google Scholar
    • Export Citation
  • Torn, R. D. , and G. J. Hakim , 2008: Ensemble-based sensitivity analysis. Mon. Wea. Rev., 136, 663677, https://doi.org/10.1175/2007MWR2132.1.

    • Search Google Scholar
    • Export Citation
  • Torn, R. D. , and G. J. Hakim , 2009: Initial condition sensitivity of western Pacific extratropical transitions determined using ensemble-based sensitivity analysis. Mon. Wea. Rev., 137, 33883406, https://doi.org/10.1175/2009MWR2879.1.

    • Search Google Scholar
    • Export Citation
  • Torn, R. D. , and G. S. Romine , 2015: Sensitivity of central Oklahoma convection forecasts to upstream potential vorticity anomalies during two strongly forced cases during MPEX. Mon. Wea. Rev., 143, 40644087, https://doi.org/10.1175/MWR-D-15-0085.1.

    • Search Google Scholar
    • Export Citation
  • Weisman, M. L. , and Coauthors, 2015: The Mesoscale Predictability Experiment (MPEX). Bull. Amer. Meteor. Soc., 96, 21272149, https://doi.org/10.1175/BAMS-D-13-00281.1.

    • Search Google Scholar
    • Export Citation
  • Wile, S. M. , J. P. Hacker , and J. H. Chilcoat , 2015: The potential utility of high-resolution ensemble sensitivity analysis for observation placement during weak flow in complex terrain. Wea. Forecasting, 30, 15211536, https://doi.org/10.1175/WAF-D-14-00066.1.

    • Search Google Scholar
    • Export Citation
  • Zack, J. , E. Natenberg , S. Young , J. Manobianco , and C. Kamath , 2010a: Application of ensemble sensitivity analysis to observation targeting for short-term wind speed forecasting. Lawrence Livermore National Laboratory Tech. Rep. LLNL-TR-42442, 32 pp.

    • Search Google Scholar
    • Export Citation
  • Zack, J. , E. Natenberg , S. Young , G. V. Knowe , K. Waight , J. Manobianco , and C. Kamath , 2010b: Application of ensemble sensitivity analysis to observation targeting for short-term wind speed forecasting in the Washington-Oregon region. Lawrence Livermore National Laboratory Tech. Rep. LLNL-TR-458086, 65 pp.

    • Search Google Scholar
    • Export Citation
  • Zack, J. , E. Natenberg , S. Young , G. V. Knowe , K. Waight , J. Manobianco , and C. Kamath , 2010c: Application of ensemble sensitivity analysis to observation targeting for short-term wind speed forecasting in the Tehachapi region winter season. Lawrence Livermore National Laboratory Tech. Rep. LLNL-TR-460956, 57 pp.

    • Search Google Scholar
    • Export Citation
  • Zheng, M. , E. K. M. Chang , and B. Colle , 2013: Ensemble sensitivity tools for assessing extratropical cyclone intensity and track predictability. Wea. Forecasting, 28, 11331156, https://doi.org/10.1175/WAF-D-12-00132.1.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 19 0 0
Full Text Views 4402 2411 152
PDF Downloads 2510 637 65