Search Results
You are looking at 1 - 3 of 3 items for :
- Author or Editor: Danielle R. B. Coleman x
- Bulletin of the American Meteorological Society x
- Refine by Access: All Content x
Abstract
Process-oriented diagnostics (PODs) aim to provide feedback for model developers through model analysis based on physical hypotheses. However, the step from a diagnostic based on relationships among variables, even when hypothesis driven, to specific guidance for revising model formulation or parameterizations can be substantial. The POD may provide more information than a purely performance-based metric, but a gap between POD principles and providing actionable information for specific model revisions can remain. Furthermore, in coordinating diagnostics development, there is a trade-off between freedom for the developer, aiming to capture innovation, and near-term utility to the modeling center. Best practices that allow for the former, while conforming to specifications that aid the latter, are important for community diagnostics development that leads to tangible model improvements. Promising directions to close the gap between principles and practice include the interaction of PODs with perturbed physics experiments and with more quantitative process models as well as the inclusion of personnel from modeling centers in diagnostics development groups for immediate feedback during climate model revisions. Examples are provided, along with best-practice recommendations, based on practical experience from the NOAA Model Diagnostics Task Force (MDTF). Common standards for metrics and diagnostics that have arisen from a collaboration between the MDTF and the Department of Energy’s Coordinated Model Evaluation Capability are advocated as a means of uniting community diagnostics efforts.
Abstract
Process-oriented diagnostics (PODs) aim to provide feedback for model developers through model analysis based on physical hypotheses. However, the step from a diagnostic based on relationships among variables, even when hypothesis driven, to specific guidance for revising model formulation or parameterizations can be substantial. The POD may provide more information than a purely performance-based metric, but a gap between POD principles and providing actionable information for specific model revisions can remain. Furthermore, in coordinating diagnostics development, there is a trade-off between freedom for the developer, aiming to capture innovation, and near-term utility to the modeling center. Best practices that allow for the former, while conforming to specifications that aid the latter, are important for community diagnostics development that leads to tangible model improvements. Promising directions to close the gap between principles and practice include the interaction of PODs with perturbed physics experiments and with more quantitative process models as well as the inclusion of personnel from modeling centers in diagnostics development groups for immediate feedback during climate model revisions. Examples are provided, along with best-practice recommendations, based on practical experience from the NOAA Model Diagnostics Task Force (MDTF). Common standards for metrics and diagnostics that have arisen from a collaboration between the MDTF and the Department of Energy’s Coordinated Model Evaluation Capability are advocated as a means of uniting community diagnostics efforts.
Abstract
The last decade has seen the success of stochastic parameterizations in short-term, medium-range, and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to represent model inadequacy better and to improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not only provides better estimates of uncertainty, but it is also extremely promising for reducing long-standing climate biases and is relevant for determining the climate response to external forcing. This article highlights recent developments from different research groups that show that the stochastic representation of unresolved processes in the atmosphere, oceans, land surface, and cryosphere of comprehensive weather and climate models 1) gives rise to more reliable probabilistic forecasts of weather and climate and 2) reduces systematic model bias. We make a case that the use of mathematically stringent methods for the derivation of stochastic dynamic equations will lead to substantial improvements in our ability to accurately simulate weather and climate at all scales. Recent work in mathematics, statistical mechanics, and turbulence is reviewed; its relevance for the climate problem is demonstrated; and future research directions are outlined.
Abstract
The last decade has seen the success of stochastic parameterizations in short-term, medium-range, and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to represent model inadequacy better and to improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not only provides better estimates of uncertainty, but it is also extremely promising for reducing long-standing climate biases and is relevant for determining the climate response to external forcing. This article highlights recent developments from different research groups that show that the stochastic representation of unresolved processes in the atmosphere, oceans, land surface, and cryosphere of comprehensive weather and climate models 1) gives rise to more reliable probabilistic forecasts of weather and climate and 2) reduces systematic model bias. We make a case that the use of mathematically stringent methods for the derivation of stochastic dynamic equations will lead to substantial improvements in our ability to accurately simulate weather and climate at all scales. Recent work in mathematics, statistical mechanics, and turbulence is reviewed; its relevance for the climate problem is demonstrated; and future research directions are outlined.
Abstract
Realistic climate and weather prediction models are necessary to produce confidence in projections of future climate over many decades and predictions for days to seasons. These models must be physically justified and validated for multiple weather and climate processes. A key opportunity to accelerate model improvement is greater incorporation of process-oriented diagnostics (PODs) into standard packages that can be applied during the model development process, allowing the application of diagnostics to be repeatable across multiple model versions and used as a benchmark for model improvement. A POD characterizes a specific physical process or emergent behavior that is related to the ability to simulate an observed phenomenon. This paper describes the outcomes of activities by the Model Diagnostics Task Force (MDTF) under the NOAA Climate Program Office (CPO) Modeling, Analysis, Predictions and Projections (MAPP) program to promote development of PODs and their application to climate and weather prediction models. MDTF and modeling center perspectives on the need for expanded process-oriented diagnosis of models are presented. Multiple PODs developed by the MDTF are summarized, and an open-source software framework developed by the MDTF to aid application of PODs to centers’ model development is presented in the context of other relevant community activities. The paper closes by discussing paths forward for the MDTF effort and for community process-oriented diagnosis.
Abstract
Realistic climate and weather prediction models are necessary to produce confidence in projections of future climate over many decades and predictions for days to seasons. These models must be physically justified and validated for multiple weather and climate processes. A key opportunity to accelerate model improvement is greater incorporation of process-oriented diagnostics (PODs) into standard packages that can be applied during the model development process, allowing the application of diagnostics to be repeatable across multiple model versions and used as a benchmark for model improvement. A POD characterizes a specific physical process or emergent behavior that is related to the ability to simulate an observed phenomenon. This paper describes the outcomes of activities by the Model Diagnostics Task Force (MDTF) under the NOAA Climate Program Office (CPO) Modeling, Analysis, Predictions and Projections (MAPP) program to promote development of PODs and their application to climate and weather prediction models. MDTF and modeling center perspectives on the need for expanded process-oriented diagnosis of models are presented. Multiple PODs developed by the MDTF are summarized, and an open-source software framework developed by the MDTF to aid application of PODs to centers’ model development is presented in the context of other relevant community activities. The paper closes by discussing paths forward for the MDTF effort and for community process-oriented diagnosis.
