Editorial Type:
Article
Article Type:
Research Article

Verification of a Multimodel Storm Surge Ensemble around New York City and Long Island for the Cool Season

Tom Di Liberto School of Marine and Atmospheric Sciences, Stony Brook University, Stony Brook, New York

Search for other papers by Tom Di Liberto in
Current site
Google Scholar
PubMed Close
,
Brian A. Colle School of Marine and Atmospheric Sciences, Stony Brook University, Stony Brook, New York

Search for other papers by Brian A. Colle in
Current site
Google Scholar
PubMed Close
,
Nickitas Georgas Stevens Institute of Technology, Hoboken, New Jersey

Search for other papers by Nickitas Georgas in
Current site
Google Scholar
PubMed Close
,
Alan F. Blumberg Stevens Institute of Technology, Hoboken, New Jersey

Search for other papers by Alan F. Blumberg in
Current site
Google Scholar
PubMed Close
, and
Arthur A. Taylor Meteorological Development Laboratory, NOAA/NWS, Office of Science and Technology, Silver Spring, Maryland

Search for other papers by Arthur A. Taylor in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Dec 2011
DOI:
https://doi.org/10.1175/WAF-D-10-05055.1
Page(s):
922–939
Restricted access

Abstract

Three real-time storm surge forecasting systems [the eight-member Stony Brook ensemble (SBSS), the Stevens Institute of Technology’s New York Harbor Observing and Prediction System (SIT-NYHOPS), and the NOAA Extratropical Storm Surge (NOAA-ET) model] are verified for 74 available days during the 2007–08 and 2008–09 cool seasons for five stations around the New York City–Long Island region. For the raw storm surge forecasts, the SIT-NYHOPS model has the lowest root-mean-square errors (RMSEs) on average, while the NOAA-ET has the largest RMSEs after hour 24 as a result of a relatively large negative surge bias. The SIT-NYHOPS and SBSS also have a slight negative surge bias after hour 24. Many of the underpredicted surges in the SBSS ensemble are associated with large waves at an offshore buoy, thus illustrating the potential importance of nearshore wave breaking (radiation stresses) on the surge predictions. A bias correction using the last 5 days of predictions (BC) removes most of the surge bias in the NOAA-ET model, with the NOAA-ET-BC having a similar level of accuracy as the SIT-NYHOPS-BC for positive surges. A multimodel surge ensemble (ENS-3) comprising the SBSS control member, SIT-NYHOPS, and NOAA-ET models has a better degree of deterministic accuracy than any individual member. Probabilistically, the ALL ensemble (eight SBSS members, SIT-NYHOPS, and NOAA-ET) is underdispersed and does not improve after applying a bias correction. The ENS-3 improves the Brier skill score (BSS) relative to the best deterministic member (SIT-NYHOPS), and the ENS-3 has a larger BSS and better reliability than the SBSS and ALL ensembles, thus illustrating the benefits of a multimodel storm surge ensemble.

Current affiliation: NOAA/CPC/Wyle, Camp Springs, Maryland.

Corresponding author address: Dr. Brian A. Colle, School of Marine and Atmospheric Sciences, Stony Brook University, Stony Brook, NY 11794-5000. E-mail: brian.colle@stonybrook.edu

Abstract

Three real-time storm surge forecasting systems [the eight-member Stony Brook ensemble (SBSS), the Stevens Institute of Technology’s New York Harbor Observing and Prediction System (SIT-NYHOPS), and the NOAA Extratropical Storm Surge (NOAA-ET) model] are verified for 74 available days during the 2007–08 and 2008–09 cool seasons for five stations around the New York City–Long Island region. For the raw storm surge forecasts, the SIT-NYHOPS model has the lowest root-mean-square errors (RMSEs) on average, while the NOAA-ET has the largest RMSEs after hour 24 as a result of a relatively large negative surge bias. The SIT-NYHOPS and SBSS also have a slight negative surge bias after hour 24. Many of the underpredicted surges in the SBSS ensemble are associated with large waves at an offshore buoy, thus illustrating the potential importance of nearshore wave breaking (radiation stresses) on the surge predictions. A bias correction using the last 5 days of predictions (BC) removes most of the surge bias in the NOAA-ET model, with the NOAA-ET-BC having a similar level of accuracy as the SIT-NYHOPS-BC for positive surges. A multimodel surge ensemble (ENS-3) comprising the SBSS control member, SIT-NYHOPS, and NOAA-ET models has a better degree of deterministic accuracy than any individual member. Probabilistically, the ALL ensemble (eight SBSS members, SIT-NYHOPS, and NOAA-ET) is underdispersed and does not improve after applying a bias correction. The ENS-3 improves the Brier skill score (BSS) relative to the best deterministic member (SIT-NYHOPS), and the ENS-3 has a larger BSS and better reliability than the SBSS and ALL ensembles, thus illustrating the benefits of a multimodel storm surge ensemble.

Current affiliation: NOAA/CPC/Wyle, Camp Springs, Maryland.

Corresponding author address: Dr. Brian A. Colle, School of Marine and Atmospheric Sciences, Stony Brook University, Stony Brook, NY 11794-5000. E-mail: brian.colle@stonybrook.edu
Save
Cover Weather and Forecasting
Weather and Forecasting

  • Atallah, E. H., and Bosart L. F. , 2003: The extratropical transition and precipitation distribution of Hurricane Floyd (1999). Mon. Wea. Rev., 131, 1063–1081.

    • Search Google Scholar
    • Export Citation

  • Betts, A. K., and Miller M. J. , 1993: The Betts–Miller scheme. The Representation of Cumulus Convection in Numerical Models, Meteor. Monogr., No. 46, Amer. Meteor. Soc., 107–121.

    • Search Google Scholar
    • Export Citation

  • Blier, W., Keefe S. , Shaffer W. , and Kim S. , 1997: Storm surge in the region of western Alaska. Mon. Wea. Rev., 125, 3094–3108.

  • Blumberg, A. F., Khan L. A. , and St. John J. P. , 1999: Three-dimensional hydrodynamic model of New York Harbor region. J. Hydrol. Eng., 125, 799–816.

    • Search Google Scholar
    • Export Citation

  • Bowman, M. J., Colle B. A. , Flood R. , Hill D. , Wilson R. E. , Buonaiuto F. , Cheng P. , and Zheng Y. , 2005: Hydrologic feasibility of storm surge barriers to protect the metropolitan New York–New Jersey region. Marine Sciences Research Center Tech. Rep., Stony Brook University, 28 pp.

    • Search Google Scholar
    • Export Citation

  • Bruno, M. S., Blumber A. F. , and Herrington T. O. , 2006: The urban ocean observatory – coastal ocean observations and forecasting in the New York Bight. J. Mar. Sci. Environ., C4, 31–39.

    • Search Google Scholar
    • Export Citation

  • Burroughs, L. B., and Shaffer W. A. , 1997: East Coast extratropical storm surge and beach erosion guidance. NWS Tech. Procedures Bull. 436, National Oceanic and Atmospheric Administration, 24 pp.

    • Search Google Scholar
    • Export Citation

  • Colle, B. A., 2003: Numerical simulations of the extratropical transition of Floyd (1999): Structural evolution and responsible mechanisms for the heavy rainfall over the northeast United States. Mon. Wea. Rev., 131, 2905–2926.

    • Search Google Scholar
    • Export Citation

  • Colle, B. A., Olson J. B. , and Tongue J. S. , 2003: Multiseason verification of the MM5. Part I: Comparison with the Eta Model over the central and eastern United States and impact of MM5 resolution. Wea. Forecasting, 18, 431–457.

    • Search Google Scholar
    • Export Citation

  • Colle, B. A., Buonaiuto F. , Bowman M. J. , Wilson R. E. , Flood R. , Hunter R. , Mintz A. , and Hill D. , 2008: Simulations of past cyclone events to explore New York City’s vulnerability to coastal flooding and storm surge model capabilities. Bull. Amer. Meteor. Soc., 89, 829–841.

    • Search Google Scholar
    • Export Citation

  • Colle, B. A., Rojowsky K. , and Buonaiuto F. , 2010: New York City storm surges: Climatology and an analysis of the wind and cyclone evolution. J. Appl. Meteor. Climatol., 49, 85–100.

    • Search Google Scholar
    • Export Citation

  • Di Liberto, T., 2009: Verification of a storm surge modeling system for the New York City–Long Island region. M.S. thesis, School of Marine and Atmospheric Sciences, Stony Brook University, 135 pp. [Available from MSRC, Stony Brook University, Stony Brook, NY 11794-5000.]

    • Search Google Scholar
    • Export Citation

  • Dudhia, J., 1989: Numerical study of convection observed during the Winter Monsoon Experiment using mesoscale two-dimensional model. J. Atmos. Sci., 46, 3077–3107.

    • Search Google Scholar
    • Export Citation

  • Eckel, F. A., and Mass C. F. , 2005: Aspects of effective short-range ensemble forecasting. Wea. Forecasting, 20, 328–350.

  • Ferrier, B., Jin Y. , Lin Y. , Black T. , Rogers E. , and DiMego G. , 2002: Implementation of a new grid-scale cloud and precipitation scheme in the NCEP Eta model. Preprints, 19th Conf. on Weather Analysis and Forecasting/15th Conf. on Numerical Weather Prediction, San Antonio, TX, Amer. Meteor. Soc., 10.1. [Available online at http://ams.confex.com/ams/SLS_WAF_NWP/techprogram/paper_47241.htm.]

    • Search Google Scholar
    • Export Citation

  • Garratt, J. R., 1977: Review of drag coefficients over oceans and continents. Mon. Wea. Rev., 105, 915–929.

  • Georgas, N., 2010: Establishing confidence in marine forecast systems: The design of a high fidelity marine forecast model for the NY/NJ Harbor Estuary and its adjoining waters. Ph.D. dissertation, Stevens Institute of Technology, 272 pp.

    • Search Google Scholar
    • Export Citation

  • Georgas, N., and Blumberg A. F. , 2010: Establishing confidence in marine forecast systems: The design and skill assessment of the New York Harbor Observation and Prediction System, version 3 (NYHOPS v3). Estuarine and Coastal Modeling: Proceedings of the Eleventh International Conference, M. L. Spaulding, Ed., American Society of Civil Engineers, 660–685.

    • Search Google Scholar
    • Export Citation

  • Glickman, T. S., 2000: Glossary of Meteorology. 2nd ed. Amer. Meteor. Soc., 855 pp.

  • Grell, G. A., 1993: Prognostic evaluation of assumptions used by cumulus parameterizations. Mon. Wea. Rev., 121, 764–787.

  • Grell, G. A., Dudhia J. , and Stauffer D. R. , 1995: A description of the fifth-generation Penn State/NCAR Mesoscale Model (MM5). NCAR Tech. Note NCAR/TN-398+STR, 122 pp.

    • Search Google Scholar
    • Export Citation

  • Hack, J. J., Boville B. A. , Briegleb B. P. , Kiehl J. T. , Rasch P. J. , and Williamson D. L. , 1993: Description of the NCAR Community Climate Model (CCM2). NCAR Tech. Note NCAR/TN-382+STR, 108 pp.

    • Search Google Scholar
    • Export Citation

  • Hamill, T. M., 2001: Interpretation of rank histograms for verifying ensemble forecasts. Mon. Wea. Rev., 129, 550–560.

  • Hoeting, J. A., Madigan D. , Raftery A. E. , and Volinsky C. T. , 1999: Bayesian model averaging: A tutorial (with discussion). Stat. Sci., 14, 382–401.

    • Search Google Scholar
    • Export Citation

  • Hong, S.-Y., and Pan H.-L. , 1996: Nonlocal boundary layer vertical diffusion in a medium-range forecast model. Mon. Wea. Rev., 124, 2322–2339.

    • Search Google Scholar
    • Export Citation

  • Hong, S.-Y., Dudhia J. , and Chen S.-H. , 2004: A revised approach to ice-microphysical processes for the bulk parameterization of cloud and precipitation. Mon. Wea. Rev., 132, 103–120.

    • Search Google Scholar
    • Export Citation

  • Hong, S.-Y., Noh Y. , and Dudhia J. , 2006: A new vertical diffusion package with an explicit treatment of entrainment processes. Mon. Wea. Rev., 134, 2318–2341.

    • Search Google Scholar
    • Export Citation

  • Janjić, Z. I., 2002: Nonsingular implementation of the Mellor-Yamada level 2.5 scheme in the NCEP Meso Model. NCEP Office Note 437, 61 pp.

    • Search Google Scholar
    • Export Citation

  • Jelesnianski, C., Chen J. , and Shaffer W. , 1992: SLOSH: Sea, Lake, and Overland Surges from Hurricanes. NOAA Tech. Rep. NWS 48, 71 pp.

  • Jones, M., Colle B. A. , and Tongue J. , 2007: Evaluation of a short-range ensemble forecast system over the northeast United States. Wea. Forecasting, 22, 36–55.

    • Search Google Scholar
    • Export Citation

  • Kain, J. S., 2004: The Kain–Fritsch convective parameterization: An update. J. Appl. Meteor., 43, 170–181.

  • Kistler, R., and Coauthors, 2001: The NCEP–NCAR 50-Year Reanalysis: Monthly means CD-ROM and documentation. Bull. Amer. Meteor. Soc., 82, 247–268.

    • Search Google Scholar
    • Export Citation

  • Large, W. G., and Pond S. , 1982: Sensible and latent heat flux measurements over the ocean. J. Phys. Oceanogr., 12, 464–482.

  • Mlawer, E. J., Taubman S. J. , Brown P. D. , Iacono M. J. , and Clough S. A. , 1997: Radiative transfer for inhomogeneous atmosphere: RRTM, a validate correlated-k model for the longwave. J. Geophys. Res., 102, 16 663–16 682.

    • Search Google Scholar
    • Export Citation

  • Mukai, A., Westerink J. , Luettich R. , and Mark D. , 2002: Eastcoast 2001: A tidal constituent database for the western North Atlantic, Gulf of Mexico and Caribbean Sea. Coastal and Hydraulics Laboratory Tech. Rep. ERDC/CHL TR-02-24, U.S. Army Engineer Research and Development Center, 210 pp.

    • Search Google Scholar
    • Export Citation

  • Mylne, K., Evans R. , and Clark R. , 2002: Multi-model multi-analysis ensembles in quasi-operational medium-range forecasting. Quart. J. Roy. Meteor. Soc., 128, 361–384.

    • Search Google Scholar
    • Export Citation

  • Pawlowicz, R., Beardsley B. , and Lentz S. , 2002: Classical tidal harmonic analysis including error estimates in MATLAB using T_TIDE. Comput. Geosci., 28, 929–937.

    • Search Google Scholar
    • Export Citation

  • Reisner, J., Rasmussen R. M. , and Bruintjes R. T. , 1998: Explicit forecasting of supercooled liquid water in winter storms using the MM5 mesoscale model. Quart. J. Roy. Meteor. Soc., 124, 1071–1107.

    • Search Google Scholar
    • Export Citation

  • Resio, D. T., and Westerink J. J. , 2008: Hurricanes and the physics of surges. Phys. Today, 61, 33–38.

  • Shen, J., Gong W. , and Wang H. , 2005: Simulation of Hurricane Isabel using the Advanced Circulation Model (ADCIRC). Hurricane Isabel in Perspective, K. G. Sellner, Ed., Chesapeake Research Consortium, 107–116.

    • Search Google Scholar
    • Export Citation

  • Skamarock, W. C., Klemp J. B. , Dudhia J. , Gill D. O. , Barker D. M. , Wang W. , and Powers J. G. , 2005: A description of the Advanced Research WRF version 2. NCAR Tech. Note NCAR/TN-468+STR, 113 pp.

    • Search Google Scholar
    • Export Citation

  • Sloughter, J. M., Raftery A. E. , and Gneiting T. , 2007: Probabilistic quantitative precipitation forecasting using Bayesian model averaging. Mon. Wea. Rev., 135, 3209–3220.

    • Search Google Scholar
    • Export Citation

  • Tilburg, C. E., and Garvine R. W. , 2004: A simple model for coastal sea level prediction. Wea. Forecasting, 19, 511–519.

  • Weisberg, R. H., and Zheng L. , 2006: Hurricane storm surge simulations for Tampa Bay. Estuaries Coasts, 29, 899–913.

  • Weisberg, R. H., and Zheng L. , 2008: Hurricane storm surge simulations comparing three-dimensional with two-dimensional formulations based on an Ivan-like storm over the Tampa Bay, Florida region. J. Geophys. Res., 113, C12001, doi:10.1029/2008JC005115.

    • Search Google Scholar
    • Export Citation

  • Westerink, J. J., Luettich R. A. Jr., and Scheffner N. W. , 1993: ADCIRC: An advanced three-dimensional circulation model for shelves coasts and estuaries. Report 3: Development of a tidal constituent data base for the western North Atlantic and Gulf of Mexico. Dredging Research Program Tech. Rep. DRP-92-6, U.S. Army Engineers Waterways Experiment Station, 154 pp.

    • Search Google Scholar
    • Export Citation

  • Westerink, J. J., and Coauthors, 2008: A basin- to channel-scale unstructured grid hurricane storm surge model applied to southern Louisiana. Mon. Wea. Rev., 136, 833–864.

    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 627 pp.

  • Wilson, L. J., Beauregard S. , Raftery A. E. , and Verret R. , 2007: Calibrated surface temperature forecasts from the Canadian Ensemble Prediction System using Bayesian model averaging. Mon. Wea. Rev., 135, 1364–1385.

    • Search Google Scholar
    • Export Citation

  • Woodcock, F., and Engel C. , 2005: Operational consensus forecasts. Wea. Forecasting, 20, 101–111.

  • Zhang, D., and Anthes R. A. , 1982: A high-resolution model of the planetary boundary layer—Sensitivity tests and comparisons with SESAME-79 data. J. Appl. Meteor., 21, 1594–1609.

    • Search Google Scholar
    • Export Citation

  • Zilkoski, D. B., Richards J. H. , and Young G. M. , 1992: Results of the general adjustment of the North American Vertical Datum of 1988. Surv. Land Info. Syst., 52, 133–149.

    • Search Google Scholar
    • Export Citation

  • Zwiers, F. W., 1990: The effect of serial correlation on statistical inferences made with resampling procedures. J. Climate, 3, 1452–1461.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 290 146 6
PDF Downloads 160 67 7