The Cloud Hunter’s Problem: An Automated Decision Algorithm to Improve the Productivity of Scientific Data Collection in Stochastic Environments

Arthur A. Small III Venti Risk Management, State College, Pennsylvania

Search for other papers by Arthur A. Small III in
Current site
Google Scholar
PubMed
Close
,
Jason B. Stefik Department of Meteorology, The Pennsylvania State University, University Park, Pennsylvania

Search for other papers by Jason B. Stefik in
Current site
Google Scholar
PubMed
Close
,
Johannes Verlinde Department of Meteorology, The Pennsylvania State University, University Park, Pennsylvania

Search for other papers by Johannes Verlinde in
Current site
Google Scholar
PubMed
Close
, and
Nathaniel C. Johnson International Pacific Research Center, University of Hawaii at Manoa, Honolulu, Hawaii

Search for other papers by Nathaniel C. Johnson in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

A decision algorithm is presented that improves the productivity of data collection activities in stochastic environments. The algorithm was developed in the context of an aircraft field campaign organized to collect data in situ from boundary layer clouds. Required lead times implied that aircraft deployments had to be scheduled in advance, based on imperfect forecasts regarding the presence of conditions meeting specified requirements. Given an overall cap on the number of flights, daily fly/no-fly decisions were taken traditionally using a discussion-intensive process involving heuristic analysis of weather forecasts by a group of skilled human investigators. An alternative automated decision process uses self-organizing maps to convert weather forecasts into quantified probabilities of suitable conditions, together with a dynamic programming procedure to compute the opportunity costs of using up scarce flights from the limited budget. Applied to conditions prevailing during the 2009 Routine ARM Aerial Facility (AAF) Clouds with Low Optical Water Depths (CLOWD) Optical Radiative Observations (RACORO) campaign of the U.S. Department of Energy’s Atmospheric Radiation Measurement Program, the algorithm shows a 21% increase in data yield and a 66% improvement in skill over the heuristic decision process used traditionally. The algorithmic approach promises to free up investigators’ cognitive resources, reduce stress on flight crews, and increase productivity in a range of data collection applications.

Current affiliation: Risk Management Solutions, Inc., Hackensack, New Jersey.

Corresponding author address: Arthur A. Small III, Venti Risk Management, 200 Innovation Blvd., Suite 253, State College, PA 16803. E-mail: arthur.small@ventirisk.com

Abstract

A decision algorithm is presented that improves the productivity of data collection activities in stochastic environments. The algorithm was developed in the context of an aircraft field campaign organized to collect data in situ from boundary layer clouds. Required lead times implied that aircraft deployments had to be scheduled in advance, based on imperfect forecasts regarding the presence of conditions meeting specified requirements. Given an overall cap on the number of flights, daily fly/no-fly decisions were taken traditionally using a discussion-intensive process involving heuristic analysis of weather forecasts by a group of skilled human investigators. An alternative automated decision process uses self-organizing maps to convert weather forecasts into quantified probabilities of suitable conditions, together with a dynamic programming procedure to compute the opportunity costs of using up scarce flights from the limited budget. Applied to conditions prevailing during the 2009 Routine ARM Aerial Facility (AAF) Clouds with Low Optical Water Depths (CLOWD) Optical Radiative Observations (RACORO) campaign of the U.S. Department of Energy’s Atmospheric Radiation Measurement Program, the algorithm shows a 21% increase in data yield and a 66% improvement in skill over the heuristic decision process used traditionally. The algorithmic approach promises to free up investigators’ cognitive resources, reduce stress on flight crews, and increase productivity in a range of data collection applications.

Current affiliation: Risk Management Solutions, Inc., Hackensack, New Jersey.

Corresponding author address: Arthur A. Small III, Venti Risk Management, 200 Innovation Blvd., Suite 253, State College, PA 16803. E-mail: arthur.small@ventirisk.com
Save
  • Bellman, R., 1957: Dynamic Programming. Princeton University Press, 342 pp.

  • Berg, L. K., and E. I. Kassianov, 2008: Temporal variability of fair-weather cumulus statistics at the ACRF SGP site. J. Climate, 21, 33443358.

    • Search Google Scholar
    • Export Citation
  • Berger, J. O., 1993: Statistical Decision Theory and Bayesian Analysis. 2nd ed. Springer, xvi + 617 pp.

  • Clothiaux, E. E., T. P. Ackerman, G. G. Mace, K. P. Moran, R. T. Marchand, M. Miller, and B. E. Martner, 2000: Objective determination of cloud heights and radar reflectivities using a combination of active remote sensors at the ARM CART sites. J. Appl. Meteor., 39, 645665.

    • Search Google Scholar
    • Export Citation
  • Clothiaux, E. E., and Coauthors, 2001: The ARM millimeter wave cloud radars (MMCRs) and the active remote sensing of clouds (ARSCL) value added product (VAP). DOE Tech. Memo. ARM VAP-002.1, U.S. Department of Energy, Washington, DC, vii + 49 pp.

    • Search Google Scholar
    • Export Citation
  • Dixit, A., and R. Pindyck, 1994: Investment under Uncertainty. Princeton University Press, xiv + 468 pp.

  • Hewitson, B., and R. Crane, 2002: Self-organizing maps: Applications to synoptic climatology. Climate Res., 22, 1326.

  • Johnson, N., S. Feldstein, and B. Tremblay, 2008: The continuum of Northern Hemisphere teleconnection patterns and a description of the NAO shift with the use of self-organizing maps. J. Climate, 21, 63546371.

    • Search Google Scholar
    • Export Citation
  • Kamien, M. I., and N. L. Schwartz, 1991: Dynamic Optimization: The Calculus of Variations and Optimal Control in Economics and Management. 2nd ed. North-Holland, xvii + 377 pp.

    • Search Google Scholar
    • Export Citation
  • Kanamitsu, M., and Coauthors, 1991: Recent changes implemented into the Global Forecast System at NMC. Wea. Forecasting, 6, 425435.

  • Kohonen, T., 2001: Self-Organizing Maps. 3rd ed. Springer, 501 pp.

  • Langland, R., 2005: Issues in targeted observing. Quart. J. Roy. Meteor. Soc., 131, 34093429.

  • Lorenz, E. N., and K. A. Emanuel, 1998: Optimal sites for supplementary weather observations: Simulation with a small model. J. Atmos. Sci., 55, 399414.

    • Search Google Scholar
    • Export Citation
  • Majumdar, S. J., C. H. Bishop, B. J. Etherton, I. Szunyogh, and Z. Toth, 2001: Can an Ensemble Transform Kalman Filter predict the reduction in forecast error variance produced by targeted observations? Quart. J. Roy. Meteor. Soc., 127, 28032820.

    • Search Google Scholar
    • Export Citation
  • Mesinger, F., and Coauthors, 2006: North American Regional Reanalysis. Bull. Amer. Meteor. Soc., 87, 343360.

  • Murphy, A. H., 1997: Forecast verification. Economic Value of Weather and Climate Forecasts, R. W. Katz and A. H. Murphy, Eds., Cambridge University Press, 19–74.

    • Search Google Scholar
    • Export Citation
  • Regnier, E., 2008: Doing something about the weather. Omega-Int. J. Manage. Sci., 36, 2232, doi:10.1016/j.omega.2005.07.011.

  • Regnier, E., and P. A. Harr, 2006: A dynamic decision model applied to hurricane landfall. Wea. Forecasting, 21, 764780.

  • Romer, D., 2006: Do firms maximize? Evidence from professional football. J. Political Econ., 114, 340365, doi:10.1086/501171.

  • Stedinger, J., B. Sule, and D. Loucks, 1984: Stochastic dynamic programming models for reservoir operation optimization. Water Resour. Res., 20 (11), 14991505.

    • Search Google Scholar
    • Export Citation
  • Stefik, J. B., 2010: A decision algorithm to improve data collection in stochastic environments. M. S. thesis, Department of Meteorology, The Pennsylvania State University, University Park, PA, ix + 36 pp.

  • Vogelmann, A. M., 2008: RACORO Science and Operations Plan. DOE/SC-ARM-0806, U.S. Department of Energy, Office of Science, Office of Biological and Environmental Research, 39 pp. [Available online at http://www.arm.gov/publications/programdocs/doe-sc-arm-0806.pdf?id=29.]

    • Search Google Scholar
    • Export Citation
  • Xie, S., and Coauthors, 2010: Clouds and more: ARM climate modeling best estimate data— A new data product for climate studies. Bull. Amer. Meteor. Soc., 91, 1320.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 115 42 5
PDF Downloads 56 26 2