Hybrid Cloud Detection Algorithm Based on Intelligent Scene Recognition

Fang-Fang Li aCollege of Water Resources and Civil Engineering, China Agricultural University, Beijing, China

Search for other papers by Fang-Fang Li in
Current site
Google Scholar
PubMed
Close
,
Hui-Min Zuo aCollege of Water Resources and Civil Engineering, China Agricultural University, Beijing, China

Search for other papers by Hui-Min Zuo in
Current site
Google Scholar
PubMed
Close
,
Ying-Hui Jia aCollege of Water Resources and Civil Engineering, China Agricultural University, Beijing, China

Search for other papers by Ying-Hui Jia in
Current site
Google Scholar
PubMed
Close
,
Qi Wang bSchool of Environmental Science and Engineering, Suzhou University of Science and Technology, Suzhou, China

Search for other papers by Qi Wang in
Current site
Google Scholar
PubMed
Close
, and
Jun Qiu cState Key Laboratory of Hydroscience and Engineering, Tsinghua University, Beijing, China

Search for other papers by Jun Qiu in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

All-sky images derived from ground-based imaging equipment have become an important means of recognizing and quantifying cloud information. Accurate cloud detection is a prerequisite for obtaining important cloud information from an all-sky image. Existing cloud segmentation algorithms can achieve high accuracy. However, for different scenes, such as completely cloudy with obscured sun and partly cloudy with unobscured sun, the use of specific algorithms can further improve segmentation. In this study, a hybrid cloud detection algorithm based on intelligent scene recognition (HCD-ISR) is proposed. It uses suitable cloud segmentation algorithms for images in different scenes recognized by ISR, so as to utilize the various algorithms to their full potential. First, we developed an ISR method to automatically classify the all-sky images into three scenes. In scene A, the sky is completely clear; in scene B, the sky is partly cloudy with unobscured sun; and in scene C, the sun is completely obscured by clouds. The experimental results show that the ISR method can correctly identify 93% of the images. The most suitable cloud detection algorithm was selected for each scene based on the relevant features of the images in that scene. A fixed thresholding (FT) method was used for the images in scene C. For the most complicated scene, that is, scene B, the clear-sky background difference (CSBD) method was used to identify cloud pixels based on a clear-sky library (CSL). The images in the CSL were automatically filtered by ISR. Compared to FT, adaptive thresholding (AT), and CSBD methods, the proposed HCD-ISR method has the highest accuracy (95.62%). The quantitative evaluation and visualization results show that the proposed HCD-ISR algorithm makes full use of the advantages of different cloud detection methods, and is more flexible and robust.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Qiu Jun, aeroengine@tsinghua.edu.cn

Abstract

All-sky images derived from ground-based imaging equipment have become an important means of recognizing and quantifying cloud information. Accurate cloud detection is a prerequisite for obtaining important cloud information from an all-sky image. Existing cloud segmentation algorithms can achieve high accuracy. However, for different scenes, such as completely cloudy with obscured sun and partly cloudy with unobscured sun, the use of specific algorithms can further improve segmentation. In this study, a hybrid cloud detection algorithm based on intelligent scene recognition (HCD-ISR) is proposed. It uses suitable cloud segmentation algorithms for images in different scenes recognized by ISR, so as to utilize the various algorithms to their full potential. First, we developed an ISR method to automatically classify the all-sky images into three scenes. In scene A, the sky is completely clear; in scene B, the sky is partly cloudy with unobscured sun; and in scene C, the sun is completely obscured by clouds. The experimental results show that the ISR method can correctly identify 93% of the images. The most suitable cloud detection algorithm was selected for each scene based on the relevant features of the images in that scene. A fixed thresholding (FT) method was used for the images in scene C. For the most complicated scene, that is, scene B, the clear-sky background difference (CSBD) method was used to identify cloud pixels based on a clear-sky library (CSL). The images in the CSL were automatically filtered by ISR. Compared to FT, adaptive thresholding (AT), and CSBD methods, the proposed HCD-ISR method has the highest accuracy (95.62%). The quantitative evaluation and visualization results show that the proposed HCD-ISR algorithm makes full use of the advantages of different cloud detection methods, and is more flexible and robust.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Qiu Jun, aeroengine@tsinghua.edu.cn
Save
  • Alonso, J., F. J. Batlles, G. López, and A. Ternero, 2014: Sky camera imagery processing based on a sky classification using radiometric data. Energy, 68, 599608, https://doi.org/10.1016/j.energy.2014.02.035.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Caldas, M., and R. Alonso-Suárez, 2019: Very short-term solar irradiance forecast using all-sky imaging and real-time irradiance measurements. Renewable Energy, 143, 16431658, https://doi.org/10.1016/j.renene.2019.05.069.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cazorla, A., F. J. Olmo, and L. Alados-Arboledas, 2008: Using a sky imager for aerosol characterization. Atmos. Environ., 42, 27392745, https://doi.org/10.1016/j.atmosenv.2007.06.016.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chauvin, R., J. Nou, S. Thil, A. Traoré, and S. Grieu, 2015: Cloud detection methodology based on a sky-imaging system. Energy Procedia, 69, 19701980, https://doi.org/10.1016/j.egypro.2015.03.198.

    • Search Google Scholar
    • Export Citation
  • Cheng, H.-Y., and C.-L. Lin, 2017: Cloud detection in all-sky images via multi-scale neighborhood features and multiple supervised learning techniques. Atmos. Meas. Tech., 10, 199208, https://doi.org/10.5194/amt-10-199-2017.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chu, Y., H. T. C. Pedro, L. Nonnenmacher, R. H. Inman, Z. Liao, and C. F. M. Coimbra, 2014: A smart image-based cloud detection system for intrahour solar irradiance forecasts. J. Atmos. Oceanic Technol., 31, 19952007, https://doi.org/10.1175/JTECH-D-13-00209.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fabel, Y., and Coauthors, 2021: Applying self-supervised learning for semantic cloud segmentation of all-sky images. Atmos. Meas. Tech., 15, 797809, https://doi.org/10.5194/amt-15-797-2022.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ghonima, M. S., B. Urquhart, C. W. Chow, J. E. Shields, A. Cazorla, and J. Kleissl, 2012: A method for cloud detection and opacity classification based on ground based sky imagery. Atmos. Meas. Tech., 5, 28812892, https://doi.org/10.5194/amt-5-2881-2012.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ghosh, A., N. R. Pal, and J. Das, 2006: A fuzzy rule based approach to cloud cover estimation. Remote Sens. Environ., 100, 531549, https://doi.org/10.1016/j.rse.2005.11.005.

    • Search Google Scholar
    • Export Citation
  • Hasenbalg, M., P. Kuhn, S. Wilbert, B. Nouri, and A. Kazantzidis, 2020: Benchmarking of six cloud segmentation algorithms for ground-based all-sky imagers. Sol. Energy, 201, 596614, https://doi.org/10.1016/j.solener.2020.02.042.

    • Search Google Scholar
    • Export Citation
  • Heinle, A., A. Macke, and A. Srivastav, 2010: Automatic cloud classification of whole sky images. Atmos. Meas. Tech., 3, 557567, https://doi.org/10.5194/amt-3-557-2010.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • IPCC, 2007: Climate Change 2007: The Physical Science Basis. Cambridge University Press, 996 pp.

    • Crossref
    • Export Citation
  • Johnson, R. W., W. S. Hering, and J. E. Shields, 1989: Automated visibility and cloud cover measurements with a solid state imaging system. Scripps Institution of Oceanography Marine Physical Laboratory Final Rep. 89-7, 127 pp.

    • Crossref
    • Export Citation
  • Kuhn, P., and Coauthors, 2018: Validation of an all-sky imager–based nowcasting system for industrial PV plants. Prog. Photovoltaics Res. Appl., 26, 608621, https://doi.org/10.1002/pip.2968.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Li, C. H., and C. K. Lee, 1993: Minimum cross entropy thresholding. Pattern Recognit., 26, 617625, https://doi.org/10.1016/0031-3203(93)90115-D.

  • Li, Q., W. Lu, and J. Yang, 2011: A hybrid thresholding algorithm for cloud detection on ground-based color images. J. Atmos. Oceanic Technol., 28, 12861296, https://doi.org/10.1175/JTECH-D-11-00009.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Li, X., Z. Lu, Q. Zhou, and Z. Xu, 2019: A cloud detection algorithm with reduction of sunlight interference in ground-based sky images. Atmosphere, 10, 640, https://doi.org/10.3390/atmos10110640.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Long, C. N., J. M. Sabburg, J. Calbó, and D. Pagès, 1998: Development of an automated hemispheric sky imager for cloud fraction retrievals. Proc. 10th Symp. on Meteorological Observations and Instrumentation, Phoenix, AZ, Amer. Meteor. Soc., 171174.

    • Crossref
    • Export Citation
  • Long, C. N., J. M. Sabburg, J. Calbó, and D. Pagès, 2006: Retrieving cloud characteristics from ground-based daytime color all-sky images. J. Atmos. Oceanic Technol., 23, 633652, https://doi.org/10.1175/JTECH1875.1.

    • Search Google Scholar
    • Export Citation
  • Otsu, N., 1979: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern., 9, 6266, https://doi.org/10.1109/TSMC.1979.4310076.

    • Crossref
    • Export Citation
  • Paulescu, M., and Coauthors, 2014: Nowcasting solar irradiance using the sunshine number. Energy Convers. Manage., 79, 690697, https://doi.org/10.1016/j.enconman.2013.12.048.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pawar, P., C. Cortés, K. Murray, and J. Kleissl, 2019: Detecting clear sky images. Sol. Energy, 183, 5056, https://doi.org/10.1016/j.solener.2019.02.069.

    • Search Google Scholar
    • Export Citation
  • Reda, I., and A. Andreas, 2004: Solar position algorithm for solar radiation applications. Sol. Energy, 76, 577589, https://doi.org/10.1016/j.solener.2003.12.003.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Shields, J., R. Johnson, and T. Koehler, 1993: Automated whole sky imaging systems for cloud field assessment. Fourth Symp. on Global Change Studies, Boston, MA, Amer. Meteor. Soc., 1722.

  • Souza-Echer, M. P., E. B. Pereira, L. Bins, and M. A. R. Andrade, 2006: A simple method for the assessment of the cloud cover state in high-latitude regions by a ground-based digital camera. J. Atmos. Oceanic Technol., 23, 437447, https://doi.org/10.1175/JTECH1833.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Stoffel, T. and A. Andreas, 1981: NREL Solar Radiation Research Laboratory (SRRL): Baseline Measurement System (BMS). NREL MIDC, accessed 15 October, 2020, https://doi.org/10.7799/1052221.

    • Crossref
    • Export Citation
  • Tapakis, R., and A. G. Charalambides, 2013: Equipment and methodologies for cloud detection and classification: A review. Sol. Energy, 95, 392430, https://doi.org/10.1016/j.solener.2012.11.015.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wilbert, S., and Coauthors, 2016: Wolkenkamera-basierte Kürzestfristvorhersage der Direktstrahlung. Kölner Sonnenkolloquium, Cologne, Germany, DLR.

    • Crossref
    • Export Citation
  • Xie, W., and Coauthors, 2020: SegCloud: A novel cloud image segmentation model using a deep convolutional neural network for ground-based all-sky-view camera observation. Atmos. Meas. Tech., 13, 19531961, https://doi.org/10.5194/amt-13-1953-2020.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yamashita, M., M. Yoshimura, and K. Iwao, 2005: Monitoring and discrimination for sky conditions using multi-temporal whole sky imageries. ACRS Proc., Hanoi, Vietnam, AARS, https://a-a-r-s.org/proceeding/ACRS2005/Papers/CEN1-1.pdf.

  • Yang, H., B. Kurtz, D. Nguyen, B. Urquhart, C. W. Chow, M. Ghonima, and J. Kleissl, 2014: Solar irradiance forecasting using a ground-based sky imager developed at UC San Diego. Sol. Energy, 103, 502524, https://doi.org/10.1016/j.solener.2014.02.044.

    • Search Google Scholar
    • Export Citation
  • Yang, J., Q. Min, W. Lu, W. Yao, Y. Ma, J. Du, T. Lu, and G. Liu, 2015: An automated cloud detection method based on the green channel of total-sky visible images. Atmos. Meas. Tech., 8, 46714679, https://doi.org/10.5194/amt-8-4671-2015.

    • Search Google Scholar
    • Export Citation
  • Yang, J., Q. Min, W. Lu, Y. Ma, W. Yao, T. Lu, J. Du, and G. Liu, 2016: A total sky cloud detection method using real clear sky background. Atmos. Meas. Tech., 9, 587597, https://doi.org/10.5194/amt-9-587-2016.

    • Search Google Scholar
    • Export Citation
  • Ye, L., Z. Cao, Y. Xiao, and Z. Yang, 2019: Supervised fine-grained cloud detection and recognition in whole-sky images. IEEE Trans. Geosci. Remote Sens., 57, 79727985, https://doi.org/10.1109/TGRS.2019.2917612.

    • Search Google Scholar
    • Export Citation
  • Zhu, T., H. Zhou, H. Wei, X. Zhao, K. Zhang, and J. Zhang, 2019: Inter-hour direct normal irradiance forecast with multiple data types and time-series. J. Mod. Power Syst. Clean Energy, 7, 13191327, https://doi.org/10.1007/s40565-019-0551-4.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 386 0 0
Full Text Views 1953 1724 684
PDF Downloads 407 184 4