## 1. Introduction

The representation of the vertical overlap of cloud in climate and numerical weather forecast models is key for their radiative transfer calculations (Morcrette and Fouquart 1986; Slingo and Slingo 1991; Morcrette and Jakob 2000; Chen et al. 2000; Wu and Liang 2005). Zhang et al. (2013) recently demonstrated that one of the important causes of differences between global model radiation schemes was their treatment of cloud overlap. The cloud overlap schemes in models are derived and evaluated using available ground-based or satellite observations; thus, it is important to have a clear understanding of the latter.

Cloud overlap is usually defined in terms of three basic idealized assumptions: maximum, random, or minimum. One can consider clouds in two layers to be formed from a coherent dynamical process and, thus, to be maximally overlapped (MAX). If the cloud cover in two layers is given by *C*_{i} and *C*_{j}, respectively, this assumption minimizes their combined total cloud cover

*α*will assume a negative value. Barker et al. (1999) used cloud-resolving model output to show that the overlap of continuous clouds often lies between MAX and RAN for the scenes studied. This possibility was formalized in an overlap scheme suggested by HI00, who used cloud retrievals from the Chilbolton radar in the United Kingdom for its derivation. The data showed that clouds separated by clear layers (referred to as discontinuous) were approximately randomly correlated, although

*α*was negative for large layer separations, while vertically continuous cloudy layers were maximally overlapped at small separation distances but steadily decorrelated as the separation distance between the layers increased. HI00 fitted an exponential function to the reduction in

*α*with layer separation distance

*D*:

The analysis of HI00 revealed several characteristics of the cloud overlap statistics that have since been reproduced in further observational studies but, to date, have not been fully explained. First, in their data analysis, HI00 translated the temporally continuous data stream of the radar observations into an effective spatial scale, assuming a constant horizontal wind speed, and then divided these data into finite segments of various lengths, ranging in size from 24 to 216 km. We will refer to this as the *sampling scale*. This range of sampling scales was chosen to reflect typical grid lengths used in atmospheric models employed for numerical weather predictions or climate studies. HI00 reported that the decorrelation length scale of clouds was sensitive to the sampling scale employed, with shorter decorrelation length scales diagnosed when using shorter sampling scales, indicating a greater tendency toward random overlap. A second characteristic of the data analysis was that, for large cloud separations of clouds separated by clear layers, negative values of *α* were found, indicating a tendency for minimum overlap.

These conclusions have been confirmed in other, more recent observation-based studies, with a significant sensitivity of *α* and its decorrelation length scale for continuous clouds also reported in the studies of Naud et al. (2008), Willén et al. (2005), and Oreopoulos and Norris (2011). Mace and Benson-Troth (2002) also found this behavior in three of the four Atmospheric Radiation Measurement Program (ARM) study sites. Additionally, Naud et al. (2008) found that discontinuous cloud scenes always tended toward minimal overlap in that study, with negative *α* values of up to −0.2. Shonk et al. (2010) also documented a (weaker) sampling-scale sensitivity.

To demonstrate these characteristics here, we show an analysis of *α* derived for continuous and discontinuous clouds using *CloudSat*–*CALIPSO* data (see methods section for details of the data and calculation) divided into respective sampling scales of 10, 100, and 1000 km (Fig. 1). For clouds separated by a clear layer, *α* is close to zero, indicating random overlap, in agreement with HI00 and subsequent work. It is mostly positive when calculated for a sampling scale of 1000 km and mostly negative for 10- and 100-km sampling scales. Although the magnitude of the negative *α* values is small, the negative mean value for 10- and 100-km sampling scales is significantly different from zero at the 99% level using a two-tail Student’s *t* test, because of the large number of scenes (exceeding 10^{6} for 100 km) that contribute to the statistic. By fitting an exponential curve to the *α* values of continuous clouds (see methods and the first column of Table 3),

Previous studies, using both ground-based and satellite-based instrumentation of varying sensitivities, have thus shown a consistent picture of cloud overlap properties, confirmed here. An explanation of these overlap characteristics—in particular, the scene length sensitivity of the diagnosed *α* and *α* with respect to the observed cloud cover, *α* must decrease as the sampling scale decreases. However, as pointed out by Mace and Benson-Troth (2002) themselves, the above argument may not hold more generally, since, as the sampling scale increases, scenes will likely include further cloud elements.

Astin and Di Girolamo (2014) recently conducted an analytical study of the scale dependence of *α*, considering the case of two cloud scenes that are subsequently merged into one single scene of twice the size, suggesting as a result that *α* should increase with sampling scale. However, their analysis was based on the restrictive assumption that the cloud fraction of the two layers is identical in each box [derivation of their Eq. (11)]. If this assumption is relaxed to allow differing cloud fractions in the two scenes, *α* may increase or decrease when merging, depending on the cloud configuration of the two scenes.

The negative *α* values often diagnosed for discontinuous clouds have also not been justified. Naud et al. (2008) highlighted, but did not offer an explanation for, the negative *α* values found for discontinuous clouds. HI00 suggested that the negative values of *α*, indicating a tendency toward minimum overlap, were a chance outcome of the scene length used and the typical horizontal wind profile over their observation site in the southern United Kingdom.

In this paper, we attempt to explain the above observational characteristics of overlap statistics by considering how they will change as the data sampling scale changes relative to the typical cloud system scale. After introducing the data sources used in the paper in the next section, we will offer a simple heuristic argument that data truncation could potentially lead to negative biases in the diagnosed *α* at larger cloud separations, shorter diagnosed decorrelation length scales and negative *α* values for clouds that are actually randomly overlapped. We next demonstrate that this argument holds using simple cyclic cloud fields as well as realistic fractal clouds, and we offer a simple cloud filter for cloud observations that results in a scale-invariant diagnosis of the overlap statistics.

## 2. Method

### a. Overlap statistics

For each data source outlined below, we divide up the cloud scene into segments of a fixed length scale, which will be referred to as the sampling scale *α* parameter is calculated for each segment according to Eq. (1) and then averaged over all scenes. As discussed by Pincus et al. (2005), an alternative approach is to average *α* from the average; they showed that there is limited sensitivity to the averaging order. We choose to average *α*, since *α* using averaged cloud values (as in HI00) is not physically based.

Astin and Di Girolamo (2014) point out that *α* will be sensitive to *α* is not systematic and depends on the cloud configuration. Moreover, we note that similar sensitivities to scene length occur when *α* calculation on averaged cloud properties also truncate data and remove scenes with zero or overcast cloud layers, implying that the truncation arguments given in the present manuscript equally apply. As in previous analyses, the calculation excludes layers that are either overcast or cloud-free, since cloud cover overlap is ill-defined in these cases, and *α* is undefined. This truncation of statistics has received limited attention to date, but we will claim that it is, in fact, central to the sampling-scale dependence of the overlap statistics.

### b. Cloud data

Three sources of cloud data are used in this analysis, which are introduced in turn.

#### 1) Idealized cyclic clouds

We consider a very simple cloud system that consists of a single cloud element of a fixed length *X* consists of *nX*, where *X*, then other cloud fraction values are obtained in each segment. The length scale *X* on which the cloud is periodic is be referred to as the *cloud system scale*. In general, we will use *X* to represent the cloud system scale for all cloud data sources.

Schematic of the overlap of two adjacent clouds that form a plane-parallel cloud system, which repeats.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Schematic of the overlap of two adjacent clouds that form a plane-parallel cloud system, which repeats.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Schematic of the overlap of two adjacent clouds that form a plane-parallel cloud system, which repeats.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

The cyclic cloud is repeated in a second layer, which can be offset (shifted) with respect to the first layer. If the offset is zero pixels, then the cloud layers are maximally overlapped, while if the offset distance is *X* and decreasing by one column at a time until the scene length is equal to *sampling resolution*.

The difference in the overlap parameter sampled at *X* provides the bias in *α*. We may not sample the clouds at scene length exceeding *X* because of the issue of aliasing when using periodically repeating cloud systems. A summary of the symbols used in the following analysis is reported in Table 1.

Definition of symbols.

#### 2) Idealized fractal clouds

*β*defines the slope of the power spectra, which is set to

*X*is related to the wavenumber peak

*X*= 100 km. A spatially constant value for the saturation mixing ratio provides a cloud fraction of 50%, assuming no supersaturation can exist.

We generate 50 random scenes of 2000 km × 2000 km using SITCOM with a horizontal resolution of 1 km, similar to *CloudSat* observations, and each one is sampled with horizontal lines spaced 500 km apart to ensure the transects are uncorrelated. A sample scene is shown in Fig. 3, which also shows how the liquid water mixing ratio is converted to a simple cloud mask. As with the cyclic clouds, a two-layer system is constructed by repeating the transects in a second layer placed above the first, and a series of overlap scenarios is generated by progressively shifting one layer with respect to the other. The two cloud layers are first aligned to give maximum overlap (*α* below 1. As the top cloud layer is progressively shifted, the two layers will eventually become decorrelated, and *X*′ = 0.2*X* to *X*′ = 2*X*. The difference in *α* diagnosed at these scene lengths to the value obtained using the whole 2000 km (=20*X*) cloud tract is referred to as the *α* bias. In the initial case of zero shift distance and maximum overlap, the bias in *α* is identically zero for all scene lengths.

(left) Example SITCOM-generated field with horizontal lines showing sample trajectories. (top right) A zoom in of a 200 km × 200 km subscene shown to emphasize the cloud system scale of *X* = 100 km; (bottom right) the resulting cloud mask. This cloud mask is repeated in two vertical layers in the experiment, and then one layer is shifted with respect to the other to provide a range of overlap situations in each sampled scene (see text for details).

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

(left) Example SITCOM-generated field with horizontal lines showing sample trajectories. (top right) A zoom in of a 200 km × 200 km subscene shown to emphasize the cloud system scale of *X* = 100 km; (bottom right) the resulting cloud mask. This cloud mask is repeated in two vertical layers in the experiment, and then one layer is shifted with respect to the other to provide a range of overlap situations in each sampled scene (see text for details).

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

(left) Example SITCOM-generated field with horizontal lines showing sample trajectories. (top right) A zoom in of a 200 km × 200 km subscene shown to emphasize the cloud system scale of *X* = 100 km; (bottom right) the resulting cloud mask. This cloud mask is repeated in two vertical layers in the experiment, and then one layer is shifted with respect to the other to provide a range of overlap situations in each sampled scene (see text for details).

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

#### 3) Observed clouds

*CloudSat* and *CALIPSO* data for the period January–July 2008 are used. The *CloudSat* level 2B Cloud Geometrical Profile (2B-GEOPROF; Marchand et al. 2008; CSU 2013, 2014, 2015), available at approximately 240-m vertical and 1.1-km horizontal resolution provides a 0–40 range for the cloud-mask value. Each profile is interpolated to a regular 250-m grid, and then cloud is assumed present for values exceeding 20 (Stein et al. 2011; Tompkins and Adebiyi 2012). This is supplemented by *CALIPSO* information using the 2B-GEOPROF-LIDAR product (Mace 2007; Mace et al. 2009), assuming a cloudy pixel if the lidar-identified cloud fraction exceeds 99% (Barker 2008; Di Giuseppe and Tompkins 2015). For brevity, we will refer to the final retrieved product as *CloudSat* data. For an example of the *CloudSat* scene and the processed masks that results, refer to Fig. 1 of Di Giuseppe and Tompkins (2015).

The *CloudSat* overpasses are divided into segments of varying scene lengths for the analysis. For any two cloud layers, the overlap can be calculated using the definition of *α* given in Eq. (1). Nonadjacent layers are considered to belong to a continuous cloud block if all layers found between are also classified as cloudy. The existence of any clear (cloud free) layers between the two layers in question will instead classify them as discontinuous.

For continuous cloud, the overlap is maximum (*α* = 1) for a separation of zero, since this is the trivial case of the overlap of a cloud with itself. The value of *α* will reduce with separation distance, and the decorrelation length scale is calculated using a least squares best-fit exponential decay using all data points that are contributed to by at least 100 cloud scenes to prevent the fit being biased by small samples. Some previous studies have only used contiguous layers for the calculation of

## 3. A heuristic argument for scene length dependency

The studies of HI00, Mace and Benson-Troth (2002), Naud et al. (2008), and Oreopoulos and Norris (2011) showed a considerable sensitivity to the scene length chosen for the analysis, with decorrelation length scale increasing with scene length, which has been confirmed in the introduction. As stated in the literature review, while Mace and Benson-Troth (2002) and HI00 offered simple arguments to explain this based on a single cloud element, Mace and Benson-Troth (2002) also admitted that these arguments would likely not hold in real scenes where multiple cloud elements would need to be considered.

Here, the arguments of Mace and Benson-Troth (2002) and HI00, which only considered idealized cloud systems that were fully contained within a scene, will be generalized to include the case when the sampling scale employed is below the typical scale of cloud systems. As an example, HI00 state categorically that the degree of overlap must decrease monotonically with decreasing scene length. Consideration of the schematic in Fig. 4 shows that the assertion of HI00 does not necessarily hold once it falls below the cloud system scale, because of the issue of data truncation briefly discussed in Astin and Di Girolamo (2014). In the schematic, a simple cloud system of overlapping clouds close to maximum overlap is sampled at four sampling scales (

Schematic of the overlap of two adjacent clouds (gray), which are sampled at four sampling scales (denoted A, B, C, and D). The vertical dotted lines demark the scene boundaries, and the lengths of the scenes are indicated with the double-headed arrows below the schematic for clarity.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Schematic of the overlap of two adjacent clouds (gray), which are sampled at four sampling scales (denoted A, B, C, and D). The vertical dotted lines demark the scene boundaries, and the lengths of the scenes are indicated with the double-headed arrows below the schematic for clarity.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Schematic of the overlap of two adjacent clouds (gray), which are sampled at four sampling scales (denoted A, B, C, and D). The vertical dotted lines demark the scene boundaries, and the lengths of the scenes are indicated with the double-headed arrows below the schematic for clarity.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

At sampling scale *α* is undefined, as all overlap assumptions give the same total cloud-cover diagnosis of unity, and such scenes are neglected from the analysis. This is an example of the obvious effect of reducing the sampling scale; namely, a greater proportion of the cloud layers will be overcast and rejected from the analysis [e.g., see the cloud fraction PDF derived from aircraft data over different sampling scales in Tompkins (2003)]. Following Astin and Di Girolamo (2014), we refer to this as data truncation. Thus, in this simple example, it is seen that the average value of *α* that would be diagnosed for this transect decreases toward random, while the cloud system is completely contained within a scene by the sampling scale chosen (A and B) but then increases to maximum overlap once the cloud system is divided into a number of separate scenes by using shorter sampling scales (C and D). In this latter case, *α* has a positive bias when *X*.

It is also possible to consider a two-layer cloud, such as depicted in the example of Fig. 5, which is close to minimum overlap. For such cloud systems, in an arrangement where the extent of the cloud in each layer exceeds that of the overlapping portion and thus *α* is negative, it is clear that as

Schematic of the overlap of two adjacent clouds that are substantially minimally overlapped, showing that as *X*, only the scene containing the overlapping portion will contribute to the derivation of *α*.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Schematic of the overlap of two adjacent clouds that are substantially minimally overlapped, showing that as *X*, only the scene containing the overlapping portion will contribute to the derivation of *α*.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Schematic of the overlap of two adjacent clouds that are substantially minimally overlapped, showing that as *X*, only the scene containing the overlapping portion will contribute to the derivation of *α*.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

*α*is negative, its sampling bias will be negative in the case of data truncation at small sampling scales, while positive

*α*scenes will be subject to positive biases. To determine which, if any, of the two biases may dominate, we consider the limit of

*α*as the sampling scale

^{1}If the cloud cover in the respective layers are

*α*is unbounded for negative numbers but has an upper bound of 1. For minimal overlap cloud configurations with a finite overlap between the clouds, if

As a result of the asymmetry in the *α* bias, one can therefore expect that if a set of cloud systems that are randomly overlapped are sampled at length scales shorter than the typical cloud system scale, the negative bias resulting from scenes that contain cloud segments that are minimally overlapped could dominate the positive bias occurring in sections that are close to being maximally overlapped, assuming each arrangement occurs equally frequently. In these cases, the mean value *α* will be negative as observed for discontinuous cloud layers reported in previous studies. Moreover, for continuous cloud layers, the overlap at zero separation distance is unity by definition, but, at larger separation distances, the *α* value diagnosed will be more negative at shorter sampling scales. This would result in shorter

## 4. Evaluation with cyclic clouds

We test the hypothesis outlined in the previous section using the controlled framework of two-layer cyclic clouds, which are sampled at a range of sampling scales, as illustrated in Fig. 2. The results of this simple idealized case are shown in Fig. 6. By definition, if *X*, and the sampling resolution is unity, the bias in *α* is identically zero. Figure 6a shows that as *α* can be of either sign, depending on the value of *α* itself. If *α* lies between maximal (

Results of the idealized cloud sampling test illustrated in Fig. 2. (a) Bias in *α* as a function of the true overlap for individual cloud combinations and sampling length scale. (b) Bias in *α* averaged over all cloud combinations that give

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Results of the idealized cloud sampling test illustrated in Fig. 2. (a) Bias in *α* as a function of the true overlap for individual cloud combinations and sampling length scale. (b) Bias in *α* averaged over all cloud combinations that give

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Results of the idealized cloud sampling test illustrated in Fig. 2. (a) Bias in *α* as a function of the true overlap for individual cloud combinations and sampling length scale. (b) Bias in *α* averaged over all cloud combinations that give

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

If we now consider a set of cloud systems that, on average, are randomly overlapped, what would be the resulting sign of the bias at small sampling scales? Figure 6a would appear to show that randomly overlapped clouds would be subject to a positive bias in *α* when the true *α* is zero. However, it is recalled that the overlap for a large set of observations is an average statistical property. For example, if we were to assume that discontinuous clouds are randomly overlapped, this does not imply that the total cover of any two cloud layers separated by a clear layer will be exactly random. Instead, the overlap can take any value from maximum to minimum overlap, and the random overlap results from the averaging of many scenes. Indeed, for this idealized case of two layers of 50% cloud cover, all overlap possibilities from minimum through random to maximum would be equally likely.

Thus, it is more appropriate to examine the mean overlap bias for all overlap cases that lead to the mean *α* = 1) to minimum (*α* = −1), while *α* = 1) to random (*α* = 0), for example. The averaged *α* bias calculation (Fig. 6b) appears to support the heuristic argument above, and previous observational investigations of overlap can potentially be explained. Although the *α* bias is positive for a wider range of *α* values when *α* values exceeding approximately *α* values between 0 and −0.2 when using sampling resolutions between 0.5 and 1.0, based on this simple cyclic cloud system study. This range of negative *α* values is consistent with the values previously reported for discontinuous clouds, such as in the work of Naud et al. (2008). Here, the hypothesis is that these scenes are, in fact, randomly overlapped, and the negative overlap parameter is a result of the scene lengths used being less than the typical cloud system scale. In addition, the decorrelation length scale should reduce with higher resolution and/or shorter averaging periods, as observed previously.

## 5. Evaluation with idealized fractal clouds

The results in the previous section were informative but relied on a highly idealized arrangement of clouds that were cyclic, with a cloud cover of exactly 50% in each layer. In this section, we therefore repeat the idealized experiment, but using the fractal cloud scenes generated by SITCOM. In this way, individual scenes may include numerous cloud elements of various sizes with a realistic power spectrum that is known and controllable.

With a fractal cloud scene, sampling at any specific *α* bias and some to negative *α* bias. The prediction is that, overall, the negative biases will dominate. Taking one sampling resolution as an example with *α*. The graph shows that individual scenes are indeed subject to both positive and negative biases, both of which can exceed a magnitude of unity. A positive bias greater than unity can occur if a particular field has an overlap between random and minimum, but *α* is close to maximum overlap with this sampling scale. Negative biases occur more frequently, and the magnitude of the negative biases is greater, as expected because they are unbounded. The result is that the mean of the PDF is negative, as expected for this scene resolution.

Normalized probability density function of the bias in *α* for over 10^{6} separate cloud scenes of length

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Normalized probability density function of the bias in *α* for over 10^{6} separate cloud scenes of length

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Normalized probability density function of the bias in *α* for over 10^{6} separate cloud scenes of length

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Repeating the calculation for all scene resolutions between 0.2 and 2 with the fractal clouds indicates that the mean bias in *α* due to scene truncation is, in fact, always negative (Fig. 8). This is a consequence of the cloud cover of 50% used for the fractal field. Using scenes of higher mean cloud fraction can result in positive *α* biases occurring for high *α* values (not shown). If the sampling scale exceeds the cloud system scale, the bias is small (less than 0.02 for *α* bias increases in magnitude, exceeding −0.2 for sampling lengths that are less than a third of the cloud system scale. The overall magnitude of the estimated bias appears to agree quite well with those diagnosed from previous observational studies. For example, Naud et al. (2008) found that discontinuous clouds had overlap parameters that varied between −0.1 and −0.2 depending on the ground-based site location. Assuming these clouds were actually randomly overlapped, this suggests that their sampling scale approximately ranged from a factor of 0.3 to a factor of 0.8 of the cloud system scale, assuming that the mean cloud fraction at the location is not too dissimilar to 50%.

Bias in *α* derived from repeatedly sampling 200 individual fractal cloud transects of 2000-km length generated by SITCOM at *X* to 2*X*, where *X* is the cloud system scale. The *α* bias is binned as a function of the true *α* obtained at a much larger scale of 20*X*.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Bias in *α* derived from repeatedly sampling 200 individual fractal cloud transects of 2000-km length generated by SITCOM at *X* to 2*X*, where *X* is the cloud system scale. The *α* bias is binned as a function of the true *α* obtained at a much larger scale of 20*X*.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Bias in *α* derived from repeatedly sampling 200 individual fractal cloud transects of 2000-km length generated by SITCOM at *X* to 2*X*, where *X* is the cloud system scale. The *α* bias is binned as a function of the true *α* obtained at a much larger scale of 20*X*.

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

## 6. A simple filter for scale-invariant overlap statistics

As a result of the above considerations, we suggest a minor modification to the analysis method previously employed to subsample cloud scenes. As stated earlier, when considering the total cloud cover resulting from the vertical overlap of two cloudy layers, if either of the two layers is overcast, then the total cloud cover is also trivially unity, and *α* is undefined. As a result, HI00, Naud et al. (2008), and Willén et al. (2005) only considered cloud layers in the analysis for which the layer cloud cover *α* should increase, since we are retaining cloud systems that are more likely to be well resolved. Thus, data will still be truncated with this filter; indeed, truncation will be stronger at shorter sampling scales than using the standard method, but the sensitivity of the results to the truncation should be reduced.

We test this new filter by analyzing the *CloudSat* data using sampling scales of *X*′ = 10, 30, 100, 300 and 1000 km and applying values of *X*′ = 100 km are shown in Fig. 9. For discontinuous clouds, it is seen that *α* increases as *α* is always positive. The mean value of *α* for all *X*′ and *α* for discontinuous cloud is much reduced, with values ranging from 0.05 to 0.08 with

Overlap parameter for continuous and discontinuous cloud scenes derived from *CloudSat*–*CALIPSO* data using *X*′ = 100 km and a

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Overlap parameter for continuous and discontinuous cloud scenes derived from *CloudSat*–*CALIPSO* data using *X*′ = 100 km and a

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Overlap parameter for continuous and discontinuous cloud scenes derived from *CloudSat*–*CALIPSO* data using *X*′ = 100 km and a

Citation: Journal of the Atmospheric Sciences 72, 8; 10.1175/JAS-D-14-0278.1

Mean *α* for discontinuous clouds observed by *CloudSat* as a function of

For continuous scenes, *α* also increases as

Decorrelation length scale of *α* for continuous clouds as a function of

## 7. Discussion

Are cloud systems likely to be underresolved by the spatial sampling scales of 50–150 km typically used in previous analyses? This will depend on the season and location. Isolated convective events may be completely contained within a single scene, even with sampling scales of 50 km, but if the cloud events are predominantly caused by frontal systems, then this is likely not to be the case. Indeed, it was explicitly stated by Willén et al. (2005) that many frontal systems were larger than the sampling scale and that only the system boundaries contribute to the calculation of overlap. Referring to the example scene given in Fig. 2 of HI00, it is clear that the cloud system scale significantly exceeds the middle sampling time scale of 1 h illustrated, which translated to a spatial sampling scale of 72 km using the assumed horizontal advection speed. In their Fig. 2, HI00 draw a box to highlight an example subscene in which a single cloud element is fully contained for the purposes of their discussion. Examining the radar retrieval of the full figure, it is clear that this example is an exception, and the vast majority of the layer combinations that would contribute to the statistics consist of cloud edges.

In the analysis of Wood and Field (2011), the mean length scale at which clouds contributed to half of the cloud cover was 200 km. This significantly exceeds the sampling scales used for overlap statistics and would result in significant *α* biases, although the analysis examined total cloud cover from MODIS, and the cloud lengths in individual layers of the atmosphere could be shorter. Zhang et al. (2014) found altocumulus layers, for example, were, on average, approximately 40 km, while Kiemle et al. (2015) has recently made an analysis of *CALIPSO* data in 2007 and shows similar cloud lengths to Wood and Field (2011).

The study of Wood and Field (2011) raises another interesting issue, as they find a strong latitudinal dependence of the typical cloud length diagnosed (see their Fig. 8), with cloud length scales increasing by more than an order of magnitude between the equator and midlatitudes for many longitudes. This implies that, for a given fixed *α* parameter for continuous clouds at higher latitudes. While this latitudinal dependency may have physical origins, because of wind shear or differing ice crystal properties, for example, the analysis indicates that it could also be an artifact of sampling diverse system sizes with a fixed sampling length scale. We test this by sampling the *CloudSat* data as a function of latitude with

Considering that sampling at scales smaller than the cloud system scale affects the diagnosed decorrelation length scale applied to continuous clouds,^{2} which value should be applied in a radiation scheme that uses an EXP-RAN approach if the host atmospheric model employs horizontal resolutions that are smaller than typical cloud system scales? One could argue that the

## 8. Conclusions

This paper has returned to the issue of cloud overlap, as defined by the parameter *α* that describes the proportion of maximum and random overlap observed in a cloud scene. We have attempted to offer a simple argument to explain the commonly observed characteristics of the cloud overlap parameter derived when dividing a cloud observation source (from satellite, aircraft, or model, for example) into a set of cloud scenes of a given length scale, referred to as the cloud sampling scale *α* for vertically continuous cloud layers increases with sampling scale.

A simple heuristic argument was offered to explain these characteristics as a result of data truncation: that is, the effect of necessarily discarding cloud scenes that are overcast or cloud-free when compiling cloud statistics, as *α* is undefined in these cases. If *X*, increasing numbers of cloud scenes will be discarded, and the overlap statistics will be based on the remaining cloud fragments that will be either maximally or minimally overlapped. This results in an increased magnitude of *α* when diagnosed with small sampling scales: that is, negative biases in *α* when *α* is negative, and positive biases in *α* when *α* is positive. As a direct consequence, the decorrelation length scale for continuous clouds would decrease with sampling scale.

Using a simple cyclic cloud system, we confirm the basic predictions of the truncation theory: namely, that the *α* bias is positive for a scene that is between random and maximum overlap and negative for a scene that is considerably minimally overlapped. Because of the definition of *α*, the negative bias can be considerably larger in magnitude; thus, averaging over many scenes of varying configurations, the theory predicts that clouds that are randomly overlapped will be diagnosed as slightly minimally overlapped (i.e., with negative *α)*. We subsequently attempted to overcome the drawbacks of the idealized cyclic cloud framework by repeating the analysis with realistic fractal clouds with a *α* bias is always negative but increases in magnitude as the sampling scale decreases. Thus, the prediction of the negative *α* values for randomly overlapped clouds is maintained for these realistic scenes. Assuming discontinuous clouds are randomly overlapped, the fractal cloud model assesses that the cloud systems analyzed by Naud et al. (2008) were sampled at scene lengths that ranged from 0.3 to 0.8 of the cloud system scale.

Based on the arguments that cloud truncation leads to an underestimation of cloud-scale decorrelation length, we suggested a simple filter for cloud scenes, where only cloud scenes with fractions smaller than a given threshold (lower than 100%) are retained in the analysis. With small thresholds applied to several months of *CloudSat* data, discontinuous clouds are diagnosed with small but positive *α* values, as expected. Thus, the minimal overlap is shown to be an artifact of data truncation. For continuous clouds, the smaller the threshold used in the filter, the lower the sensitivity to the sampling scale becomes, and using an upper limit of 50% results in an overlap decorrelation length scale that is close to being invariant to sampling scale. Using this filter with the *CloudSat*–*CALIPSO* data, the decorrelation length scale at 100 km is 3.6 km, similar to that obtained at a scale length of 1000 km, whereas a value of 3.0 km was found when all clouds were retained in the analysis.

In a discussion, it was emphasized that the cloud system scale is often larger than the sampling scale, and indeed the typical resolution employed in many global and regional atmospheric models; thus, the data truncation issue is relevant. Indeed, it is demonstrated that the strong latitudinal dependence of the overlap decorrelation length scale demonstrated in previous studies is partly a result of the data truncation and indicates that the value used in model parameterization schemes is not only a function of the model resolution but also of the cloud system type, which may or may not be well resolved at the resolution employed.

## Acknowledgments

The NASA *CloudSat* and *CALIPSO* projects are thanked for making their data freely available to the scientific community. This work was partly supported by the European Union FP7 project Quantifying Weather and Climate Impacts on Health in Developing Countries (QWeCI), Grant agreement 243964. This work was greatly improved by three reviewers’ comments, and we are particularly indebted to an anonymous reviewer of Di Giuseppe and Tompkins (2015), whose pertinent questions inspired the present submission, and who also highlighted the consequence of the latitudinal dependence of cloud system scales for our analysis.

## REFERENCES

Astin, I., and L. Di Girolamo, 2006: The relationship between

*α*and the cross-correlation of cloud fraction.,*Quart. J. Roy. Meteor. Soc.***132**, 2475–2478, doi:10.1256/qj.05.209.Astin, I., and L. Di Girolamo, 2014: Technical note: The horizontal scale-dependence of the cloud overlap parameter alpha.

,*Atmos. Chem. Phys. Discuss.***14**, 9801–9813, doi:10.5194/acpd-14-9801-2014.Barker, H. W., 2008: Overlap of fractional cloud for radiation calculations in GCMs: A global analysis using CloudSat and CALIPSO data.

,*J. Geophys. Res.***113**, D00A01, doi:10.1029/2007JD009677.Barker, H. W., G. L. Stephens, and Q. Fu, 1999: The sensitivity of domain-averaged solar fluxes to assumptions about cloud geometry.

,*Quart. J. Roy. Meteor. Soc.***125**, 2127–2152, doi:10.1002/qj.49712555810.Chen, T., Y. Zhang, and W. B. Rossow, 2000: Sensitivity of atmospheric radiative heating rate profiles to variations of cloud layer overlap.

,*J. Climate***13**, 2941–2959, doi:10.1175/1520-0442(2000)013<2941:SOARHR>2.0.CO;2.CSU, 2013: GEOPROF. CloudSat Data Processing Center, Colorado State University, accessed February 2013. [Available online at http://cswww.cira.colostate.edu/data_dist/OrderData.php.]

CSU, 2014: GEOPROF-LIDAR. CloudSat Data Processing Center, Colorado State University, accessed December 2014. [Available online at http://cswww.cira.colostate.edu/data_dist/OrderData.php.]

CSU, 2015: 2C-RAIN-PROFILE_GRANULE. CloudSat Data Processing Center, Colorado State University, accessed February 2015. [Available online at http://cswww.cira.colostate.edu/data_dist/OrderData.php.]

Di Giuseppe, F., 2005: Sensitivity of one-dimensional radiative biases to vertical cloud structure assumptions: Validation with aircraft data.

,*Quart. J. Roy. Meteor. Soc.***131**, 1655–1676, doi:10.1256/qj.03.129.Di Giuseppe, F., and A. M. Tompkins, 2003: Effect of spatial organization on solar radiative transfer in three-dimensional idealized stratocumulus cloud fields.

,*J. Atmos. Sci.***60**, 1774–1794, doi:10.1175/1520-0469(2003)060<1774:EOSOOS>2.0.CO;2.Di Giuseppe, F., and A. M. Tompkins, 2015: Generalizing cloud overlap treatment to include the effect of wind shear.

, doi:10.1175/JAS-D-14-0277.1,*J. Atmos. Sci.***72,**2865–2876.Evans, K. F., and W. J. Wiscombe, 2004: An algorithm for generating stochastic cloud fields from radar profile statistics.

,*Atmos. Res.***72**, 263–289, doi:10.1016/j.atmosres.2004.03.016.Geleyn, J. F., and A. Hollingsworth, 1979: An economical analytical method for the computation of the interaction between scattering and line absorption of radiation.

,*Contrib. Atmos. Phys.***52**, 1–16.Hogan, R. J., and A. J. Illingworth, 2000: Deriving cloud overlap statistics from radar.

,*Quart. J. Roy. Meteor. Soc.***126**, 2903–2909, doi:10.1002/qj.49712656914.Kato, S., S. Sun-Mack, W. F. Miller, F. G. Rose, Y. Chen, P. Minnis, and B. A. Wielicki, 2010: Relationships among cloud occurrence frequency, overlap, and effective thickness derived from CALIPSO and CloudSat merged cloud vertical profiles.

,*J. Geophys. Res.***115**, D00H28, doi:10.1029/2009JD012277.Kiemle, C., G. Ehret, S. Kawa, and E. Browell, 2015: The global distribution of cloud gaps in CALIPSO data.

,*J. Quant. Spectrosc. Radiat. Transfer***153**, 95–101, doi:10.1016/j.jqsrt.2014.12.001.Mace, G. G., 2007: Level 2 GEOPROF product process description and interface control document algorithm version 5.3. CloudSat Tech. Rep., 44 pp. [Available online at http://www.cloudsat.cira.colostate.edu/sites/default/files/products/files/2B-GEOPROF_PDICD.P_R04.20070628.pdf.]

Mace, G. G., and S. Benson-Troth, 2002: Cloud-layer overlap characteristics derived from long-term cloud radar data.

,*J. Climate***15**, 2505–2515, doi:10.1175/1520-0442(2002)015<2505:CLOCDF>2.0.CO;2.Mace, G. G., Q. Zhang, M. Vaughan, R. Marchand, G. Stephens, C. Trepte, and D. Winker, 2009: A description of hydrometeor layer occurrence statistics derived from the first year of merged CloudSat and CALIPSO data.

,*J. Geophys. Res.***114**, D00A26, doi:10.1029/2007JD009755.Marchand, R., G. G. Mace, T. Ackerman, and G. Stephens, 2008: Hydrometeor detection using CloudSat—An earth-orbiting 94-ghz cloud radar.

,*J. Atmos. Oceanic Technol.***25**, 519–533, doi:10.1175/2007JTECHA1006.1.Morcrette, J.-J., and Y. Fouquart, 1986: The overlapping of cloud layers in shortwave radiation parameterizations.

,*J. Atmos. Sci.***43**, 321–328, doi:10.1175/1520-0469(1986)043<0321:TOOCLI>2.0.CO;2.Morcrette, J.-J., and C. Jakob, 2000: The response of the ECMWF model to changes in the cloud overlap assumption.

,*Mon. Wea. Rev.***128**, 1707–1732, doi:10.1175/1520-0493(2000)128<1707:TROTEM>2.0.CO;2.Naud, C. M., A. Del Genio, G. G. Mace, S. Benson, E. E. Clothiaux, and P. Kollias, 2008: Impact of dynamics and atmospheric state on cloud vertical overlap.

,*J. Climate***21**, 1758–1770, doi:10.1175/2007JCLI1828.1.Oreopoulos, L., and P. Norris, 2011: An analysis of cloud overlap at a midlatitude atmospheric observation facility.

,*Atmos. Chem. Phys.***11**, 5557–5567, doi:10.5194/acp-11-5557-2011.Oreopoulos, L., D. Lee, Y. Sud, and M. Suarez, 2012: Radiative impacts of cloud heterogeneity and overlap in an atmospheric general circulation model.

,*Atmos. Chem. Phys.***12**, 9097–9111, doi:10.5194/acp-12-9097-2012.Pincus, R., C. Hannay, S. A. Klein, K.-M. Xu, and R. Hemler, 2005: Overlap assumptions for assumed probability distribution function cloud schemes in large-scale models.

*J. Geophys. Res.,***110,**D15S09, doi:10.1029/2004JD005100.Schmidt, K. S., V. Venema, F. Di Giuseppe, R. Scheirer, M. Wendisch, and P. Pilewskie, 2007: Reproducing cloud microphysical and irradiance measurements using three 3D cloud generators.

,*Quart. J. Roy. Meteor. Soc.***133**, 765–780, doi:10.1002/qj.53.Shonk, J. K., R. J. Hogan, J. M. Edwards, and G. G. Mace, 2010: Effect of improving representation of horizontal and vertical cloud structure on the Earth’s global radiation budget. Part I: Review and parametrization.

,*Quart. J. Roy. Meteor. Soc.***136**, 1191–1204, doi:10.1002/qj.647.Slingo, J. M., and A. Slingo, 1991: The response of a general-circulation model to cloud longwave radiative forcing. II: Further studies.

,*Quart. J. Roy. Meteor. Soc.***117**, 333–364, doi:10.1002/qj.49711749805.Stein, T. H. M., D. J. Parker, J. Delanoë, N. S. Dixon, R. J. Hogan, P. Knippertz, R. I. Maidment, and J. H. Marsham, 2011: The vertical cloud structure of the West African monsoon: A 4 year climatology using CloudSat and CALIPSO.

*J. Geophys. Res.,***116,**D22205, doi:10.1029/2011JD016029.Tompkins, A. M., 2003: Impact of temperature and total water variability on cloud cover assessed using aircraft data.

,*Quart. J. Roy. Meteor. Soc.***129**, 2151–2170, doi:10.1256/qj.02.190.Tompkins, A. M., and F. Di Giuseppe, 2007: Generalizing cloud overlap treatment to include solar zenith angle effects on cloud geometry.

,*J. Atmos. Sci.***64**, 2116–2125, doi:10.1175/JAS3925.1.Tompkins, A. M., and A. A. Adebiyi, 2012: Using CloudSat cloud retrievals to differentiate satellite-derived rainfall products over West Africa.

,*J. Hydrometeor.***13**, 1810–1816, doi:10.1175/JHM-D-12-039.1.Weger, R. C., J. Lee, T. Zhu, and R. M. Welch, 1992: Clustering, randomness and regularity in cloud fields: 1. Theoretical considerations.

,*J. Geophys. Res.***97**, 20 519–20 536, doi:10.1029/92JD02038.Willén, U., S. Crewell, H. K. Baltink, and O. Sievers, 2005: Assessing model predicted vertical cloud structure and cloud overlap with radar and lidar ceilometer observations for the Baltex Bridge Campaign of CLIWA-NET.

,*Atmos. Res.***75**, 227–255, doi:10.1016/j.atmosres.2004.12.008.Wood, R., and P. R. Field, 2011: The distribution of cloud horizontal sizes.

,*J. Climate***24**, 4800–4816, doi:10.1175/2011JCLI4056.1.Wu, X., and X.-Z. Liang, 2005: Radiative effects of cloud horizontal inhomogeneity and vertical overlap identified from a monthlong cloud-resolving model simulation.

,*J. Atmos. Sci.***62**, 4105–4112, doi:10.1175/JAS3565.1.Zhang, D., T. Luo, D. Liu, and Z. Wang, 2014: Spatial scales of altocumulus clouds observed with collocated CALIPSO and CloudSat measurements.

,*Atmos. Res.***149**, 58–69, doi:10.1016/j.atmosres.2014.05.023.Zhang, F., X.-Z. Liang, J. Li, and Q. Zeng, 2013: Dominant roles of subgrid-scale cloud structures in model diversity of cloud radiative effects.

,*J. Geophys. Res. Atmos.***118**, 7733–7749, doi:10.1002/jgrd.50604.Zhu, T., J. Lee, R. C. Weger, and R. M. Welch, 1992: Clustering, randomness and regularity in cloud fields: 2. Cumulus cloud fields.

,*J. Geophys. Res.***97**, 20 537–20 558, doi:10.1029/92JD02022.

^{1}

The only possible, but unlikely, exception is if the cloud position in each layer is perfectly symmetrical.

^{2}

We note that random overlap has been generally assumed for discontinuous clouds, despite the statistically significant (assumed from our own investigation, as previous studies did not conduct significance tests) negative *α* values often diagnosed.