A Containerized Mesoscale Model and Analysis Toolkit to Accelerate Classroom Learning, Collaborative Research, and Uncertainty Quantification

Joshua P. Hacker Research Applications Laboratory, National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by Joshua P. Hacker in
Current site
Google Scholar
PubMed
Close
,
John Exby Research Applications Laboratory, National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by John Exby in
Current site
Google Scholar
PubMed
Close
,
David Gill Research Applications Laboratory, National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by David Gill in
Current site
Google Scholar
PubMed
Close
,
Ivo Jimenez Computer Science Department, University of California, Santa Cruz, Santa Cruz, California

Search for other papers by Ivo Jimenez in
Current site
Google Scholar
PubMed
Close
,
Carlos Maltzahn Computer Science Department, University of California, Santa Cruz, Santa Cruz, California

Search for other papers by Carlos Maltzahn in
Current site
Google Scholar
PubMed
Close
,
Timothy See Department of Atmospheric Sciences, University of North Dakota, Grand Forks, North Dakota

Search for other papers by Timothy See in
Current site
Google Scholar
PubMed
Close
,
Gretchen Mullendore Department of Atmospheric Sciences, University of North Dakota, Grand Forks, North Dakota

Search for other papers by Gretchen Mullendore in
Current site
Google Scholar
PubMed
Close
, and
Kathryn Fossell Mesoscale and Microscale Meteorology Laboratory, National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by Kathryn Fossell in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Numerical weather prediction (NWP) experiments can be complex and time consuming; results depend on computational environments and numerous input parameters. Delays in learning and obtaining research results are inevitable. Students face disproportionate effort in the classroom or beginning graduate-level NWP research. Published NWP research is generally not reproducible, introducing uncertainty and slowing efforts that build on past results. This work exploits the rapid emergence of software container technology to produce a transformative research and education environment. The Weather Research and Forecasting (WRF) Model anchors a set of linked Linux-based containers, which include software to initialize and run the model, to analyze results, and to serve output to collaborators. The containers are demonstrated with a WRF simulation of Hurricane Sandy. The demonstration illustrates the following: 1) how the often-difficult exercise in compiling the WRF and its many dependencies is eliminated, 2) how sharing containers provides identical environments for conducting research, 3) that numerically reproducible results are easily obtainable, and 4) how uncertainty in the results can be isolated from uncertainty arising from computing system differences. Numerical experiments designed to simultaneously measure numerical reproducibility and sensitivity to compiler optimization provide guidance for interpreting NWP research. Reproducibility is independent from the operating system and hardware. Results here show numerically identical output on all computing platforms tested. Performance reproducibility is also demonstrated. The result is an infrastructure capable of accelerating classroom learning, graduate research, and collaborative science.

© 2017 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CORRESPONDING AUTHOR: Joshua P. Hacker, hacker@ucar.edu

Abstract

Numerical weather prediction (NWP) experiments can be complex and time consuming; results depend on computational environments and numerous input parameters. Delays in learning and obtaining research results are inevitable. Students face disproportionate effort in the classroom or beginning graduate-level NWP research. Published NWP research is generally not reproducible, introducing uncertainty and slowing efforts that build on past results. This work exploits the rapid emergence of software container technology to produce a transformative research and education environment. The Weather Research and Forecasting (WRF) Model anchors a set of linked Linux-based containers, which include software to initialize and run the model, to analyze results, and to serve output to collaborators. The containers are demonstrated with a WRF simulation of Hurricane Sandy. The demonstration illustrates the following: 1) how the often-difficult exercise in compiling the WRF and its many dependencies is eliminated, 2) how sharing containers provides identical environments for conducting research, 3) that numerically reproducible results are easily obtainable, and 4) how uncertainty in the results can be isolated from uncertainty arising from computing system differences. Numerical experiments designed to simultaneously measure numerical reproducibility and sensitivity to compiler optimization provide guidance for interpreting NWP research. Reproducibility is independent from the operating system and hardware. Results here show numerically identical output on all computing platforms tested. Performance reproducibility is also demonstrated. The result is an infrastructure capable of accelerating classroom learning, graduate research, and collaborative science.

© 2017 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CORRESPONDING AUTHOR: Joshua P. Hacker, hacker@ucar.edu
Save
  • Baker, A. H., and Coauthors, 2015: A new ensemble-based consistency test for the Community Earth System Model (pyCECTv1.0). Geosci. Model Dev., 8, 28292840, doi:10.5194/gmd-8-2829-2015.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Felter, W., A. Ferreira, R. Rajamony, and J. Rubio, 2014: An updated performance comparison of virtual machines and Linux containers. IBM Research Rep. RC25482, 12 pp. [Available online at http://domino.research.ibm.com/library/cyberdig.nsf/papers/0929052195DD819C85257D2300681E7B/$File/rc25482.pdf.]

    • Crossref
    • Export Citation
  • Jimenez, I., C. Maltzahn, J. Lofstead, A. Moody, K. Mohror, R. Arpaci-Dusseau, and A. Arpaci-Dusseau, 2016: Characterizing and reducing cross-platform performance variability using OS-level virtualization. Proc. 2016 Int. Parallel and Distributed Processing Symp. Workshops (IPDPSW 2016), Chicago, IL, IEEE, 1077–1080, doi:10.1109/IPDPSW.2016.97.

    • Crossref
    • Export Citation
  • Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130141, doi:10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lorenz, E. N., 1969: The predictability of a flow which possesses many scales of motion. Tellus, 21A, 289307, doi:10.3402/tellusa.v21i3.10086.

    • Search Google Scholar
    • Export Citation
  • Skamarock, W. C., and Coauthors, 2008: A description of the Advanced Research WRF version 3. NCAR Tech. Note NCAR/TN-475+STR, 113 pp., doi:10.5065/D68S4MVH.

    • Crossref
    • Export Citation
  • Thomas, S., J. P. Hacker, M. Desgagné, and R. B. Stull, 2002: An ensemble analysis of forecast errors related to floating point performance. Wea. Forecasting, 17, 898906, doi:10.1175/1520-0434(2002)017<0898:AEAOFE>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 2201 1151 97
PDF Downloads 734 66 4