## 1. Introduction

Large-eddy simulation (LES) has profoundly impacted the way we study the planetary boundary layer (PBL). PBLs, particularly those involving clouds, are impossible to represent with fidelity in the laboratory, and very difficult and expensive to probe observationally. In such cases LES is often used as a basis for developing our intuition and guiding our theories. This special status of LES, as a proxy for reality, stems partly from its similitude to real flows, but also because the methodology is generally thought to be insensitive to formulaic details and arbitrary parameters. Both qualities follow because the method resolves the energetics of the large eddies, which are responsible for most of the transport of momentum, energy, and mass through the bulk of the PBL. More quantitative evaluations of the method are scarce for precisely the reason that LES has become so popular—real flows are challenging to quantify. More than 30 years ago Bradshaw (1972) coined the phrase “fact gap” to describe this state of affairs, a gap which some (e.g., Wyngaard 1998) believe is widening.

In the absence of decisive measurements the principal method of evaluating LES has been through exhaustive sensitivity studies of individual models and comparisons among many models. The hope is that the robustness of the method testifies to its fidelity. For the most part such studies have cast a favorable light on LES. However, a couple of studies (e.g., Moeng et al. 1996; Stevens et al. 2001) have raised serious questions about the ability of LES to realistically represent cloud-topped PBLs capped by a strong temperature inversion. In a study by Moeng et al. (1996), 12 large-eddy simulation codes were run for identical initial conditions and forcings loosely based on a cloud layer observed during the First International Satellite Cloud Climatology Project (ISCCP) regional field study (Albrecht et al. 1988). An evaluation of the simulations revealed marked differences, with global integrals of the flow, such as liquid water path, differing by as much as an order of magnitude. The origin of these differences was conjectured to be changes in the degree to which different models entrained warm and dry air from the overlying free troposphere into the turbulent PBL. But this idea was difficult to test because of the confounding effects from different representations of important physical processes, for example, radiative transfer and thermodynamic and cloud microphysical processes.

To help isolate the origin of these sensitivities, a much more idealized test case was formulated, the so-called smoke cloud (Lilly 1968; Bretherton et al. 1999), wherein a neutrally stratified mixed layer is filled with radiatively opaque smoke and capped by a strong jump in density (temperature). The more dense lower layer is driven by the radiative cooling (prescribed by a simple formula that depends on the smoke path) from the top of the smoke layer. The ensuing turbulence is then thought to be responsible for any entrainment (mixing) of much warmer, smokeless, free-tropospheric air into the turbulent layer. Because the amount of entrainment is not externally constrained, this type of test case isolates the central question of how efficiently the simulated layer entrains. Given the simplicity of the formulation, differences could be readily attributed to either the numerical implementation of the basic equations being solved, or the model used to represent unresolved scales of motion. Results from this study showed that for poor vertical resolution, simulations differed markedly in their resultant entrainment rates, but as the vertical grid was refined, entrainment rates were reduced and the scatter amongst models and their degree of disagreement with laboratory analogs to the smoke cloud also appeared to be reduced (Bretherton et al. 1999).

Based on the smoke cloud results a consensus emerged that very fine vertical resolution (order 5 m) was necessary to properly capture entrainment in stratocumulus-like, radiatively driven, flows. Most studies showed markedly less sensitivity to horizontal resolution [and by implication grid anisotropy (Lewellen and Lewellen 1998; Stevens et al. 1999)]. Because for coarse horizontal resolution the only scales that were being well represented were those commensurate with the largest eddies, these results led to the view that the energetics of the PBL-scale eddies determines the rate of entrainment, irrespective of how the entrainment process itself is captured by the simulation. This thinking helped rationalize a number of studies (e.g., Lewellen and Lewellen 1998; Lock 1998; vanZanten et al. 1999; Moeng 2000) that then independently revisited the more complex stratocumulus problem with an eye toward mapping out how entrainment rates depend on flow parameters—this being the central question for more aggregated models of PBL flows.

It soon became apparent that simulations by different LES models led to markedly different entrainment parameterizations (Stevens 2002). Even for fine vertical resolution, overall entrainment efficiencies from different codes appeared to differ by a factor of 2 or more, suggesting that the sensitivities to first emerge in the intercomparison study of Moeng et al. (1996) were not completely resolved by using fine vertical resolution. For such large disparities it became possible to imagine (cf. Lenschow 1996) collecting data to help resolve the differences among models, which in large part motivated the second Dynamics and Chemistry of Marine Stratocumulus (DYCOMS-II) field study (Stevens et al. 2003b). By focusing the observations on nocturnal stratocumulus, for which the forcings tend to be more stationary and easy to characterize, one could hope to close the energy budget for the cloud layer. By using a variety of tracers, including dimethyl sulfide [DMS, whose qualities are particularly well suited to measuring entrainment rates Lenschow (1996)], it was possible to estimate entrainment rates to within 30%—narrowing, if you will, Bradshaw’s fact gap.

In the current study we use data from the first research flight (RF01) of DYCOMS-II (Stevens et al. 2003a) and return to the intercomparison framework of Moeng et al. (1996) to reevaluate large-eddy simulation of stratocumulus-topped PBLs. We return to the intercomparison framework for a number of reasons: (i) it touches base with our earlier point of departure (e.g., Moeng et al. 1996); (ii) it provides a compelling framework for the evaluation of PBL parameterizations as manifest in single-column models [e.g., see the accompanying manuscript by Zhu et al. (2005) hereafter ZHU)]; (iii) it helps highlight the extent to which one of the underpinnings of LES, namely its supposed insensitivity to formulation details, is true, at least for the climatologically critical flow regime of marine stratocumulus. A critical distinction between this and previous intercomparison studies is the extent to which we know the right answer. Such a distinction is also critical to the use of the LES results such as ours to help inform the development and evaluation of PBL parameterizations as is discussed in an accompanying manuscript by ZHU.

## 2. Methodology

### a. The case: DYCOMS-II, RF01

Of the seven nocturnal flights flown during DYCOMS-II, the first (RF01) shall serve as the basis for our study. RF01 had a number of appealing features that make it well suited for a study of this type: The environmental conditions were relatively homogeneous; the cloud layer persisted despite the presence of mean conditions that, according to some theories (e.g., Randall 1980; Deardorff 1980a), should have led to its dissipation; it was not complicated by the presence of significant drizzle; its energetics appeared robust to a variety of observational analyses (cf. Stevens et al. 2003a; Faloona et al. 2005; Gerber et al. 2005); and preliminary attempts to simulate it were encouraging.

A detailed description of RF01, the methods used to observe it, and their associated uncertainties, is provided by Stevens et al. (2003a). For the purposes of this study we here limit ourselves to summarizing its main features as used to initialize and force the LES. These initial conditions and forcings differ from those used in the previous study principally through the incorporation of a more realistic representation of the temperature structure of the free atmosphere and the processes (radiation and large-scale subsidence) that help determine it.

#### 1) Mean state

*θ*and total-water specific humidity

_{l}*q*according to

_{t}*z*is initially set to 840 m, and

_{i}*θ*was derived from the measured air temperature using values of the physical constants:

_{l}*c*= 1.015 kJ kg

_{p}^{−1}K

^{−1},

*R*= 0.287 kJ kg

_{d}^{−1}K

^{−1}, and

*L*= 2.47 MJ kg

_{υ}^{−1}, and a surface pressure of 1017.8 hPa.

^{1}To better match the profile for

*θ*to the observations in the free troposphere, its values above

_{l}*z*are reduced by 1.5 K as compared to what was used in Stevens et al. (2003a).

_{i}Other required forcings include geostrophic winds, divergence, sea surface temperatures, and radiation. We specify geostrophic winds of *U _{g}* = 7 m s

^{−1}and

*V*= −5.5 m s

_{g}^{−1}, which produce winds within the PBL near 6 and −4.25 m s

^{−1}, respectively, as observed. The divergence of the large-scale winds is taken to be

*D*= 3.75 × 10

^{−6}s

^{−1}as this seems most consistent with the observed temperature structure above the PBL, and the calculated radiative forcing (see below). For the sea surface temperature we specify a value of 292.5 K, which is 2.1 K warmer than the surface air temperature. Given a bulk aerodynamic drag coefficient,

*C*=

_{D}*C*=

_{H}*C*= 0.0011, this should correspond to a surface sensible heat flux near 15 W m

_{Q}^{−2}and a surface latent heat flux of approximately 115 W m

^{−2}. To test the degree to which the assumption of fixed fluxes masked differences among the simulations, additional simulations were performed by most groups for which surface temperatures were held fixed and surface fluxes were computed interactively. However, these simulations did not differ substantially from those with surface fluxes fixed at the above values, and so the results reported on below are from simulations with specified fluxes. The surface temperature and pressure correspond to a surface air density,

*ρ*

_{0}= 1.22 kg m

^{−3}and an air density just below cloud top of

*ρ*= 1.13 kg m

_{i}^{−3}, both of which are necessary to convert the energetic fluxes into kinematic fluxes for use in Boussinesq models that set their density to some fixed value with height.

#### 2) Radiative forcing

*δ*-four stream radiative-transfer code developed by Fu and Liou (1993). The radiative fluxes from this model were computed given the observed state matched to a free-atmospheric sounding as discussed by Stevens et al. (2003a). Based on the more exact radiative flux profiles derived from the

*δ*-four stream model we constructed a simple model of the net longwave radiative flux as

*α*,

_{z}*κ*,

*F*

_{0}, and

*F*

_{1}. The third term in (3) was chosen so that it generates the observed (

*z*−

*z*)

_{i}^{1/3}structure in the

*θ*profile for

_{l}*z*>

*z*given the large-scale subsidence velocity

_{i}*W*= −

*Dz*. It depends on a determination of

*z*, which in the simulations is identified with the local position of the 8.0 g kg

_{i}^{−1}isoline of

*q*. The dependence of

_{t}*F*

_{rad}on

*x*,

*y*, and

*t*is imparted by the spatiotemporal variability in both

*r*and

_{l}*z*.

_{i}Figure 1 shows that for the chosen parameter values of *F*_{0} = 70 W m^{−2}, *F*_{1} = 22 W m^{−2}, *κ* = 85 m^{2} kg^{−1}, *α _{z}* = 1 m

^{−4/3}, and

*D*= 3.75 × 10

^{−6}s

^{−1}the model gives a good fit to the

*δ*-four stream results. We show the fit for two cases, one being the control case with the specified cloud layer, the other being for a drier PBL (

*q*= 8.5 g kg

_{t}^{−1}) and hence a much thinner cloud (

*q*

_{l}_{,max}= 0.25 g kg

^{−1}). Not only does (3) well represent the radiative fluxes as simulated by the

*δ*-four stream model, it also appears to capture the basic nature of the sensitivity of these fluxes to significant changes in the state of the cloud layer.

This parameterization of the radiative fluxes was chosen primarily for ease of comparison. It naturally raises a number of subsidiary questions. For instance, to what extent are the details of the radiative forcing important for cloud evolution, particularly the flux divergence in the clear air above the cloud layer and the warming near cloud base. To investigate some of these issues groups were also asked to submit simulations of two additional cases, one which included only the radiative forcing across cloud top, that is, the first term in (3) but with *F*_{0} = 48 W m^{−1}, which maintained the net forcing across the PBL as a whole, and a second case that only omitted the third term in (3). For the most part simulations did not appear to differ substantially from these changes in the forcings; however, we maintained the more realistic parameterization as given by (3) because it better maintained the thermal structure in the free troposphere.

### b. Simulation codes and configuration

Ten different modeling centers participated in the intercomparison, including most of the original participants in the Moeng et al. (1996) study. In addition to a number of standard LES models that enjoy wide use around the world [e.g., National Center for Atmospheric Research (NCAR) and the Met Office (METO)] the ensemble includes two mesoscale models [e.g., the Coupled Ocean–Atmosphere Mesoscale Prediction System (COAMPS) and Regional Atmospheric Modeling System (RAMS)] configured to behave like LES. Detailed descriptions of the participating models are provided in appendix A; they differed primarily in their choice of numerical algorithms and in their representation of unresolved motions.

Each participating group was asked to perform a 4-h simulation on a horizontal grid of 96 by 96 points with a 35-m spacing between grid nodes. Vertical spacings were required to be 5 m or less in the vicinity of cloud top, and the total vertical domain extends to a distance well above the cloud layer (typically to 1500 m or higher). Modeling groups were also asked to standardize their thermodynamic calculations so that the initial state corresponded to a cloud layer between 600 and 800 m with *q _{l}* ≈ 0.45 g kg

^{−1}at cloud top. Statistics summarizing the behavior of individual simulations conformed to two network common data form (NetCDF) templates: one for time series statistics documenting the state of the simulation at frequent intervals, the other providing profile statistics valid at the initial time and averaged over the eight 30-min intervals that span the simulation period. Output templates are provided in an appendix, as are thumbnail plots of all the time series data and the profile statistics for the last hour. The numerical values of the statistics from individual simulations, as well as a summary of these statistics, are available in NetCDF format online through the auspices of the Data Integration for Model Evaluation (DIME) project (http://gcss-dime.giss.nasa.gov).

### c. Analysis methods

Overall, scores of simulations were performed at the standard and finer resolutions and over a larger domain. The University of California, Los Angeles (UCLA) group alone performed dozens of simulations at the prescribed resolution, in addition to one (described by ZHU) that ran for 48 h, another that was on a domain with a fourfold increase in area, and a third for which the horizontal grid spacing was refined by a factor of 2. These simulations bore out the representativeness of the results at the chosen horizontal resolution (35 m) and grid size (96 points), as well as the relatively short simulation period of only 4 h.

Results are typically presented in terms of modified Tukey box plots; that is, the full range of the data is shown by light shading, and that half of the distribution centered on the median value is shown by dark shading (i.e., for a distribution divided into quartiles the dark shading is delineated by the first and third quartile). The solid line represents the ensemble mean. Because trying to combine all the simulations performed by each group into an ensemble would unfairly weight the ensemble toward those few groups who ran a great number of simulations, each group was asked to provide at most two simulations to be considered as part of what we call the master ensemble, with the caveat that the two simulations had to differ from one another in some formulaic way, for instance by representing an important process using a changed numerical method, or by changing how unresolved motions are parameterized. This selection resulted in a master ensemble of 16 simulations, which forms the basis of most of our analysis, with additional simulations being drawn upon as necessary.

Most of the analysis is performed on the basis of averages over the last 60–120 min of the simulation, during which time the simulation statistics were relatively stationary. Eddy turnover times (as measured by the ratio between the PBL height and the convective velocity scale, *w*∗) are of order of 10 min, which implies that for each simulation somewhere between 6 and 12 independent realizations are sampled. Past studies have shown that for averaging times significantly longer than the eddy turnover time, differences among independent, identically configured simulations are negligible (e.g., Stevens et al. 2001).

## 3. Results

The temporal evolution of liquid water path, cloud fraction, and vertically integrated turbulence kinetic energy (TKE) from the master ensemble are plotted in Fig. 2. Most of the temporal evolution in the simulations is evident in the first 2 h, with a characteristic “spinup” period evident in the first hour. During the spinup, vertically averaged TKE increases markedly as turbulent eddies develop in response to the destabilization of the PBL by surface and radiative fluxes. As the PBL turbulence increases, every simulation (to varying degrees) experiences a reduction in its liquid-water path (LWP). By the end of the first hour the LWP varies by as much as a factor of 5, with LWP < 30 g m^{−2} for the lowest quartile of the master ensemble. Similar reductions are also evident in the model-simulated cloud fractions with the lowest quartile dropping well below 100%. The cloud fraction distribution also illustrates the skewness of the master ensemble, wherein the mean lies in the lowest quartile. Distributions similar to those illustrated in Fig. 2 could in principle be produced by simulations whose behavior is almost identical, but characterized by large, out-of-phase, temporal oscillations. This was not the case: The degree of stationarity in the distributions in Fig. 2 is commensurate with the stationarity of individual simulations, and the spread in the distribution reflects the spread of the time-averaged statistics among the individual simulations. The stationarity between the second and fourth hour substantiates our earlier claim and is why we concentrate our analysis on the latter 2 h of the simulations.

For the observed case, cloud fraction, as independently measured by downward-pointing lidar and in situ data taken during cloud-top legs, was greater than 99% throughout the night. We had no direct measurements of cloud liquid water path evolution to compare to the upper panel of Fig. 2; however, estimates of the temporal evolution of cloud boundaries and liquid water profiles from the aircraft data indicate that the cloud layer maintained its thickness, and perhaps even deepened. These data, along with the distribution of the LES master ensemble, are shown in Fig. 3. In contrast, most of simulations tend to predict more broken cloud (i.e., Fig. 2) with a higher cloud base, and less liquid water than was observed. Only the upper quartile approaches the constancy in cloud fraction and tendency toward constant or increasing cloud thickness apparent in the data.^{2}

Because most of the evolution in the cloud layer is evident relatively early in the simulation, one is tempted to argue that the divergence among the simulations is the result of the spinup process and need not reflect the inherent dynamics of any particular simulation. From (3) and Fig. 1 the radiative forcing is sensitive to the cloud amount, so that simulations that tend to diminish the cloud layer during the spinup period will tend to have less radiative driving. On the one hand, this could be viewed as a negative feedback in that less radiative driving should lead to less entrainment and hence less entrainment drying, which tends to evaporate the cloud. On the other hand, relatively less radiative driving favors decoupling, which we associate here with a differentiation between the properties of the cloud and subcloud layer and which, *roughly speaking*, is thought to occur when the radiative forcing becomes small compared to forcings due to surface moisture fluxes (Bretherton and Wyant 1997; Stevens 2000a; Lewellen and Lewellen 2002). To examine this possibility we initialized a version of the UCLA model (UCLA-1, details of which are discussed further below), which tended to produce a relatively thinner more-broken cloud, from a fully developed flow produced by a version of that same model (UCLA-0) that better maintained the cloud. Two tests were performed, one with the UCLA-1 model branching from the UCLA-0 solutions after 1 h, the second with the branch point after 2 h. In both cases the UCLA-1 solutions immediately tended toward solutions with a thinner, more broken cloud. Based on this we conclude that the differences among the simulations were not an artifact of the spinup procedure, but reflected truly formulaic differences among the members of the master ensemble. This conclusion was bolstered by a number of additional tests performed with other models, wherein various modifications were made to generate a more gradual spinup. These too indicated that the divergent behavior among models (i.e., whether it tended to maintain or dissipate the cloud) was not significantly aggravated by the spinup procedure.

Further insight into the behavior of the simulations is provided by the vertical profiles of *θ _{l}* and

*q*, which along with the liquid water mixing ratio

_{t}*q*, are overlaid with the aircraft data in Fig. 4. In addition to maintaining significantly less liquid water, many simulations tend to evolve more rapidly to a warmer state, with evidence of decoupling in the mean profiles. This is particularly evident in the envelope of the

_{l}*q*profile distribution, which suggests that the reduction in the cloud amount is due to a drying of the cloud layer, as might be expected for decoupled boundary layers. Although this point is made more definitively later, here we simply state that those simulations that maintain the deepest cloud, and which are in relatively good agreement with the data in the rightmost panel of Fig. 4, also tend to be the coolest, and most well mixed, while those with the driest cloud layer also tend to have the moistest subcloud layer. The minimum in

_{t}*q*evident in some of the simulations just above cloud top is a numerical artifact that arises from phase errors produced by some advection schemes in the presence of sharp gradients. It is usually accompanied by a spurious maximum in the buoyancy flux just above cloud top.

_{t}The ensemble representation of the PBL turbulent structure, as measured by the vertical velocity variance, *σ*^{2}_{w} ≡

In marked contrast the in situ and radar data suggest that the PBL remains well mixed with a single well-defined peak in *w*, which measures the structure of the turbulence. For instance, negative skewness is indicative of strong downdrafts as might be expected in a flow driven predominantly by radiative cooling, where positive skewness is characteristic of surface-based and cumulus convection. The simulations in the master ensemble differ in the sign of this moment. As decoupling becomes more evident there is the expectation that the turbulence will become more surface driven and have more positive third moments through the bulk of the PBL, and thus the disparity in *F*_{0} = 50 W m^{−2} and *F*_{1} = *D* = 0, failed to represent the region of negative skewness near cloud base (Stevens et al. 2003b). Sensitivity studies show that a better representation of this feature accompanies the more realistic representation of the forcing embodied by including all of the terms in (3).

*σ*

^{2}

*versus the LWP averaged over the last hour for each of the simulations. The master ensemble includes two simulations with markedly less LWP, smaller maximum values of*

_{w}*σ*

^{2}

*, and the development of large gradients in*

_{w}*q*. The remaining distributions are more uniformly distributed from one extreme where the PBL is clearly decoupled, with a pronounced negative buoyancy flux at the top of the subcloud layer, substantial gradients in

_{t}*q*, and modest values of

_{t}*σ*

^{2}

*to the other where there is little or no evidence of decoupling and*

_{w}*σ*

^{2}

*is larger. The observations are closer to this latter extreme. It is also worth noting that the differentiation of the vertical structure of the layer, as for instance measured by*

_{w}*δq*, leads to a marked reduction in cloudiness: whereas the simulated LWPs differ by more than a factor of 5, differences in the LWP of perfect mixed layers constructed using the mean thermodynamic properties of the simulations would only differ by a factor of 2.

_{t}*F*

_{rad}] where the square brackets denote a difference across the bulk of the PBL, that is,

*χ*is some arbitrary field and

*z*

_{i+}≡

*z*+

_{i}*ϵ*. For this calculations we take

*ϵ*= 5 m, which is equal to the grid spacing at cloud top in most models. The results are given by the filled symbols in the top panel of Fig. 7. They suggest that the tendency for the more decoupled simulations to be less turbulent reflects the fact that they are driven less vigorously.

*E*to LWP, and hence [

*F*

_{rad}]. Because we think of stratocumulus as being radiatively driven, with the entrainment rate depending primarily on [

*F*

_{rad}] this result is surprising. Its interpretation might provide some insight into why the simulations show such varied propensities to decouple. If we denote the flux of some quantity

*χ*by

*F*,

_{χ}*F*to become negative below cloud base (Turton and Nicholls 1987; Bretherton and Wyant 1997). Because

_{b}*F*is positive at the surface,

_{b}*dF*/

_{b}*dz*must be negative in the subcloud layer, which, because

*F*can be expressed as a linear combination of

_{b}*F*

_{qt}and

*F*

_{θl}, constrains the fluxes of the thermodynamics state variables,

*θ*and

_{l}*q*. In the present case, where surface moisture and heat (and hence buoyancy) fluxes are positive and the former,

_{t}*F*

_{qt}, changes little with height, the latter,

*F*

_{θl}, hence must decrease with height—the PBL must warm. For fixed surface heat fluxes, the rate of warming, and hence the propensity to decouple, is determined by the relative contributions of entrainment warming versus radiative cooling. Figure 7 suggests that the more decoupled simulations maintain the same entrainment warming despite a decrease in the radiative cooling of the layer. This would imply that among the simulations the slope of

*F*

_{θl}in the subcloud layer should vary significantly while the slope of

*F*

_{qt}should be more approximately constant, as is indeed the case (e.g., Fig. C1 in appendix C).

*χ*

*α*can also be interpreted as a nondimensional entrainment rate, or radiative entrainment efficiency. For

*α*≫ 1 radiative processes contribute negligibly to the heat budget,

*α*= 1 indicates a balance between entrainment warming and radiative cooling, while the relative role of entrainment warming diminishes with decreasing

*α*.

*α*directly from (8) is sensitive to how one defines

*E*and the value of

*ϵ*. Such sensitivities are due in large part to large radiative heating rates in the layer just above cloud top, as modeled by the third term in our parameterization of radiative fluxes [e.g., Eq. (3)], which leads, in turn, to commensurate changes in

*θ*. Sharp and coupled changes in

_{l}*θ*and

_{l}*F*

_{rad}mean that attempts to evaluate (8) directly are sensitive to the structure of the inversion as represented by different models, and hence

*ϵ*. The bulk budgets of heat and moisture,

*E*=

*dz*

_{i+}/

*dt*provide a more robust alternative. Solving for

*E*from (10) and for [

*F*

_{rad}] from (11) yields an expression for

*α*largely in terms of bulk quantities:

*α*estimated in this fashion (with

*ϵ*= 50 m) covaries with LWP across the master ensemble. The values of

*E*and [

*F*

_{rad}] estimated from the bulk budgets are also plotted as open symbols in the upper panels. They compare favorably with direct estimates, although the need to define a thick interface, that is,

*ϵ*= 50 m so as to span the interfacial layer (cf. Moeng et al. 2005), necessarily introduces a significant component of the clear air cooling into the expression for [

*F*

_{rad}]. This is evident in the offset between the two estimates of [

*F*

_{rad}]; fortunately it does not alter the trend among the models. Figure 7 thus quantifies the diminishing role of radiative cooling as the simulations become increasingly decoupled.

*F*vanishes at cloud base as a measure of decoupling, then this decoupling threshold can be expressed as a critical value of

_{b}*α*, which we denote by

*α*∗. To estimate

*α*∗ we note that for a quasi-steady subcloud layer, with negligible radiative flux divergence,

*c*

_{1}and

*c*

_{2}are thermodynamic constants, which for unsaturated fluctuations are equal to 0.034 m s

^{−2}K

^{−1}and 5.9 m s

^{−2}, respectively. From (13),

*F*vanishes at cloud base (denoted by

_{b}*z*=

*z*) if

_{b}*d*〈

*θ*

_{l}〉/

*dt*= −

*dF*

_{θl}/

*dz*it follows from (12) and (14) that

*d*〈

*q*

_{t}〉/

*dt*≪

*F*

_{qt}/

*z*

_{i},

*α*∗ can be written entirely in terms of specified quantities, that is, surface fluxes. For this special case we find that

*α*=

*α*∗ = 1.35 should approximately separate decoupled from well-coupled solutions. Overall the scatter of

*α*across the simulation ensemble (shown in the bottom panel of Fig. 7, with

*α*∗ being indicated by the dashed line) appears to support these arguments. Moreover, using the data from Fig. 4 of Stevens et al. (2003a) the observations from RF01 suggest that

*α*≈ 1, which is consistent with both the well-mixedness of the observed layer, and the tendency of those simulations with the lower values of

*α*, to best represent it.

If *E* scales with [*F*_{rad}] then one would expect *α* to be constant. This is arguably the case for the best-mixed simulations, that is, those with LWP > 50 g m^{−2}; it may also be the case for a single configuration of any particular code, run for cases with varied radiative forcings. In contrast, the remarkable correlation between *α* and LWP (especially evident for LWP < 50 g m^{−2}) in Fig. 7 quantifies the tendencies for the more decoupled simulations to result from their ability to maintain their rate of entrainment despite the diminishment of the radiative forcing. Why and how they do this is key to understanding why their solutions diverge so markedly from the observations. Clues are provided in Table 1, where additional flow statistics, and configuration details, of individual simulations are provided. Focusing on the UCLA-0 and UCLA-1 simulations we note that the UCLA-1 simulation (its base, or standard, configuration) has a significant subgrid component to the total *θ _{l}* flux at the inversion. The implication is that much of the entrainment flux by that configuration of the code is being carried by the subgrid model, which is the most poorly justified model component, the implication being that the amount of mixing it generates is less likely to be constrained by the intensity of the PBL-scale circulations. This motivated experiments where different approaches were employed to regulate the behavior of the subgrid-scale (SGS) model. These ranged from using different stability or length scale formulations to limit mixing at the inversion to simply using the monotone property of the scalar advection scheme to carry the dissipation of scalar variance and turning off the subgrid model for scalars entirely. The latter, and most drastic change is manifest in the UCLA-0 model configuration. This configuration markedly changes the energetic profiles (Fig. 5) as compared to the UCLA-1, or standard configuration. The impact of these changes is further illustrated by cross sections from the last time step of higher-resolutions versions of the UCLA-0 and UCLA-1 simulations in Fig. 8. UCLA-0 produces a very well mixed simulation with a thicker, more horizontally homogeneous cloud layer, in better agreement with the data.

Similar sensitivities are also evident among the other models. For instance, centered schemes tend to better represent the inversion (albeit with some unphysical artifacts such as overshooting), both directly because they are nondiffusive, but also indirectly because a stronger inversion also limits SGS mixing. Changes, or features, of the SGS model that helped limit the mixing at the cloud-top interface also have a clear impact on other simulations. This is evident for the Distributed Hydrodynamic Aerosol and Radiative Modeling Application (DHARMA) model, wherein their implementation of a dynamic SGS model naturally (i.e., with out any ad hoc modifications; cf. UCLA-0) shuts down the SGS fluxes at the inversion, resulting in a better simulation. To a lesser extent, similar behavior is evident in the West Virginia University (WVU) simulations. The additional length scale correction introduced into the Deardorff (1980b) SGS model further limits cloud-top mixing and may explain why the COAMPS-1 simulation is more dissipative than COAMPS-0. That said, these inferences are just that, inferences. Because the numerical methods employed are quite varied and because the behavior of the SGS model is so deeply intertwined with the representation of the small-scale flow it is difficult to separate numerical from SGS effects (e.g., Ghosal 1996) and thus associate particular results with simple statements about the character of the host model.

## 4. Discussion

Have we made progress? After nearly a decade of effort the spread among LES is, for the case of some important parameters (e.g., LWP), as large as it was in the prior study by Moeng et al. (1996). Moreover, the hypothesis that the entrainment rate is controlled by the transport properties of large eddies in a manner insensitive to the detailed fluid-dynamical mechanism of entrainment is challenged by our results. At least for this case the basic character of the simulation is remarkably sensitive to details of the simulations. Nonetheless, in contrast to the situation 10 years ago, we now have a good idea of the right answer, and are able to say that many important features of the observed cloud layer can be represented by the LES, if efforts are made to minimize mixing at the cloud-top interface. Caution however is warranted: Simulations in better accord with the data do not necessarily indicate that entrainment is better represented by a particular model, or model configuration. Rather, if for a given forcing a simulation can be made to predict the correct entrainment rate, other aspects of the simulation are likely to be in better accord with the data. This point gains emphasis from a series of simulations using the UCLA-0 model configuration, for which no subgrid model was employed for the scalars, but with varying vertical grid spacing near cloud top. In addition to the base cases whose vertical grid spacing is 5 m through a 100-m zone spanning cloud top, three additional simulations were performed with Δ*z* = 10, 2, and 1 m, respectively. The results from these simulations are shown in Fig. 9. With increasing vertical resolution across cloud top, numerical diffusion is reduced. For instance, first-order advection schemes (which monotone schemes approach in the limit of sharp interfaces) have an effective diffusivity that can be expected to scale as *w*_{rms}Δ*z*, where *w*_{rms} is the rms velocity of the local interface. By reducing the effective diffusion at cloud top, better-mixed and more energetic solutions (see also Table 2) are obtained. Here we note that the lack of a subgrid model renders the simulations sensitive to the grid; similar sensitivities are also evident in other simulations where the SGS model more naturally shuts down at the inversion. Breaking such sensitivities is a prime motivation for including SGS physics.

It is difficult to say whether the UCLA-0 simulations with a 1-, 2-, or 5-m vertical grid near cloud top better represents the observed layer, particularly given that sensitivity tests with the DHARMA model suggest that the neglect of droplet sedimentation in the cloud layer leads to an overprediction of turbulence intensities, commensurate with what is shown in Fig. 9. Nonetheless it is conceivable that the simulation with the finest vertical spacing near cloud top underpredicts entrainment, and hence overpredicts the strength of the large eddies because of a lack of commensurately fine horizontal resolution. In this case relatively small sensitivity to reductions in Δ*z* beyond 2 m might be less a statement of convergence and more a statement that the vertical gradients of eddies whose horizontal scale is larger than 70 m are then resolved, which does not guarantee that such convergence will be preserved, as finer scales are included in the horizontal. To investigate these issues one should repeat these resolution studies with an isotropic refinement. Computations with a mesh spacing of 1 m in all directions, on some of the largest available computers, can be anticipated in the coming years.

Resolutions studies such as these will be particularly interesting because the physics of small-scale processes in the interfacial layer are so rich. As is the case for dry convective layers driven by surface fluxes, small-scale eddies in the interfacial layer are driven by the dissipation of larger-scale plumes as they impinge upon the stably stratified interface, but quite unlike dry convective layers smaller-scale eddies can be directly driven by diabatic (radiative, evaporative) processes at cloud top. Moreover, because of the close proximity of the cloud-top radiative cooling to the inversion, this small-scale turbulence can mix some of the radiatively cooled parcels with warmer inversion air, neutralizing their negative buoyancy and thereby effectively reducing the fraction of radiative forcing that drives PBL-scale turbulence; this may explain the particular sensitivity of stratocumulus simulations to the representation of small-scale processes (Lewellen and Lewellen 1998). Because processes near cloud top should in principle be resolvable, studies with very high resolution will be central to better understanding turbulent processes in regions of great thermal stability, thereby informing the construction of more robust SGS models.

Although the above arguments suggest that simulations of stratocumulus are more sensitive to the representation of subgrid-scale physics, might RF01 be an especially sensitive case? This question arises because a recent intercomparison by Duynkerke et al. (2004), of essentially the same collection of models, showed more satisfactory agreement amongst simulations. Because the initial state for the present case satisfies the Randall (1980) and Deardorff (1980a) cloud-top entrainment instability (CTEI) criterion at cloud top, ambiguities in defining the stability of the cloud-top interface may be compounded because such a criterion is implicit in many subgrid models. The dryness of the free troposphere also implies that moisture fluxes in the cloud layer will be large and thus contribute significantly to kinetic energy production by enhancing the buoyancy flux through evaporative cooling. In such a situation the layer is thought to be particularly susceptible to decoupling (Bretherton and Wyant 1997). Because the transition to a decoupled PBL appears to be relatively sharp (Stevens 2000b), the degree to which simulations fall on one or the other side of this boundary might amplify differences among simulations. To test these ideas we repeated the RF01 simulation but with free-atmospheric profiles of *q _{t}* increased to 5.5 g kg

^{−1}so as to render the cloud-top interface stable from the perspective of the CTEI criterion of Randall and Deardorff and to diminish the total water fluxes and hence the buoyancy flux in the cloud layer, thereby making the layer less susceptible to decoupling. Results from these simulations are shown in Fig. 10 and tabulated in Table 2. The UCLA-1 configuration of the model entrains more, produces a thinner cloud, and is less energetic. However, both simulations remain relatively well mixed and the disparity in the results is less than it was for the case with the drier free troposphere; that is, the LWP differs by only 21% for the case with a moist free troposphere, as compared to the 127% difference previously. This better agreement for this case is consistent with the robustness of the diurnal cycle intercomparison of LES presented by Duynkerke et al. (2004).

## 5. Conclusions

Data from the first research flight (RF01) of DYCOMS-II were used to reexamine the fidelity of LES in representing the turbulent structure of stratocumulus-topped boundary layers. Literally scores of simulations from 10 modeling centers were configured to represent the observed state of the PBL during RF01. Of these, 16 whose initial state and forcings conformed to the specifications outlined for the intercomparison were chosen for presentation here, with the additional simulations being used to guide our interpretation of the results. Overall we found the following:

If efforts are made to reduce mixing at cloud top, either by choosing a less diffusive numerical scheme, refining the vertical grid, or limiting the effects of the subgrid model in this region, then the observed turbulent and thermodynamic structure of the layer can be reproduced with some fidelity. For such simulations, only the third moment of the vertical velocity near the top of the cloud layer showed any significant disagreement with the observations.

The base, or native, configuration of most simulations—that is, that which would have been used in the absence of prior knowledge of the answer—overestimated mixing at cloud top, tending toward a decoupled layer in which cloud liquid water path and turbulent intensities were grossly underestimated.

The sensitivity of the simulations to the representation of mixing at cloud top is amplified by particulars of this case, wherein the cloud-top interface is unstable from the perspective of the (Randall 1980; Deardorff 1980a) cloud-top entrainment instability criterion, and the resultant layer is close to the threshold for which decoupling might be expected. The relative importance of CTEI versus decoupling to the sensitivity of this case is not, however, addressed in this study.

The first two conclusions undermine some of the classic arguments used to rationalize large-eddy simulation. At least for this case, the global behavior of the solutions depends on the most poorly understood details of the models, namely its numerics and the behavior of SGS models in regions of sharp gradients and phase changes. Such a situation challenges the idea (hope) that the proper rate of entrainment can be maintained if the energetics of the large eddies are well represented—if only because the representation of the small eddies may in the end mediate what component of the radiative forcing is actually felt by the large-scale (e.g., Lewellen and Lewellen 1998). Although the particulars of the observed case may make it a particularly challenging test for LES, such cases, which are on a knife edge between solid or broken cloud regimes, are also those most susceptible to perturbation and thus most desirable to quantify. This case is both challenging and extraordinarily well observed. It should serve as a useful benchmark for simulations with ever-increasing resolution, fueled by the importance of the topic and the ceaseless march embodied in Moore’s law.

## Acknowledgments

This case is the eighth case study conducted under the auspices of the GEWEX cloud systems studies (GCSS) boundary layer cloud working group. The support of the GCSS community continues to be instrumental in making this type of work possible. The first author’s research was supported by the NSF through Grant ATM-0097053. Bretherton and Zhu were supported by NASA Grant NAGS5-10624. The work of Golaz was performed while holding a National Research Council Research Associateship Award at the Naval Research Laboratory, Monterey, California. COAMPS is a registered trademark of the Naval Research Laboratory. Lewellen was supported in part by Grant N00014-98-1-0595 from the Office of Naval Research. The Dutch National Computing Facilities Foundation (NCF) sponsored Stephan de Roode for the use of supercomputer facilities. Martin Köhler is thanked for his comments on an early version of this manuscript. The advection schemes used by the UCLA-LES were developed from templates written by Verica Savic-Jovcic as part of the 2003 Institute for Pure and Applied Mathematics (IPAM) summer school on modern applied mathematics in the atmospheric and oceanic sciences. Ms. Savic-Jovcic is also thanked for her comments on an early draft of this manuscript.

## REFERENCES

Albrecht, B. A., D. A. Randall, and S. Nicholls, 1988: Observations of marine stratocumulus clouds during FIRE.

,*Bull. Amer. Meteor. Soc.***69****,**618–626.Bott, A., 1989: A positive definite advection scheme obtained by nonlinear renormalization of the advective fluxes.

,*Mon. Wea. Rev.***117****,**1006–1015.Bradshaw, P., 1972: The understanding and prediction of turbulent flow.

,*Aeronaut. J.***76****,**403–418.Bretherton, C. S., and M. C. Wyant, 1997: Moisture transport, lower tropospheric stability, and decoupling of cloud-topped boundary layers.

,*J. Atmos. Sci.***54****,**148–167.Bretherton, C. S., and Coauthors, 1999: An intercomparison of radiatively-driven entrainment and turbulence in a smoke cloud, as simulated by different numerical models.

,*Quart. J. Roy. Meteor. Soc.***125****,**391–423.Brown, A., J. M. Hobson, and N. Wood, 2001: Large-eddy simulation of neutral turbulent flow over rough sinusoidal ridges.

,*Bound.-Layer Meteor.***98****,**411–441.Brown, A. R., and Coauthors, 2002: Large-eddy simulation of the diurnal cycle of shallow cumulus convection over land.

,*Quart. J. Roy. Meteor. Soc.***128****,**1779–1798.Chlond, A., 1992: Three-dimensional simulation of cloud street development during a cold air outbreak.

,*Bound.-Layer Meteor.***58****,**161–200.Chlond, A., 1994: Locally modified version of Bott’s advection scheme.

,*Mon. Wea. Rev.***122****,**111–125.Chlond, A., 1998: Large-eddy simulation of contrails.

,*J. Atmos. Sci.***55****,**796–819.Cotton, W. R., R. Pielke, R. Walko, G. Liston, C. Tremback, H. Jiang, J. Y. Harrington, and G. Feingold, 2001: RAMS 2001: Current status and future directions.

,*Meteor. Atmos. Phys.***82****,**5–29.Deardorff, J. W., 1980a: Cloud top entrainment instability.

,*J. Atmos. Sci.***37****,**131–147.Deardorff, J. W., 1980b: Stratocumulus-capped mixed layers derived from a three-dimensional model.

,*Bound.-Layer Meteor.***18****,**495–527.Duynkerke, P. G., and Coauthors, 2004: Observations and numerical simulations of the diurnal cycle of the EUROCS stratocumulus case.

,*Quart. J. Roy. Meteor. Soc.***130****,**3269–3296.Faloona, I., and Coauthors, 2005: Observations of entrainment in eastern Pacific marine stratocumulus using three conserved scalars.

, in press.*J. Atmos. Sci.*Fu, Q., and K-N. Liou, 1993: Parameterization of the radiative properties of cirrus clouds.

,*J. Atmos. Sci.***50****,**2008–2025.Gerber, H., G. Frick, S. Malinowski, J-L. Brenguier, and F. Burnet, 2005: Holes and entrainment in stratocumulus.

,*J. Atmos. Sci.***62****,**443–459.Germano, M., U. Piomelli, P. Moin, and W. H. Cabot, 1991: A dynamic subgrid-scale eddy viscosity model.

,*Phys. Fluids***A3****,**1760–1765.Ghosal, S., 1996: An analysis of numerical errors in large-eddy simulations of turbulence.

,*J. Comput. Phys.***125****,**187–206.Hodur, R. M., 1997: The Naval Research Laboratory’s Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS).

,*Mon. Wea. Rev.***125****,**1414–1430.Khairoutdinov, M. F., and D. A. Randall, 2003: Cloud resolving modeling of the ARM summer 1997 IOP: Model formulation, results, uncertainties and sensitivities.

,*J. Atmos. Sci.***60****,**607–625.Klemp, J. B., and R. B. Wilhelmson, 1978: The simulation of three-dimensional convective storm dynamics.

,*J. Atmos. Sci.***35****,**1070–1095.Lenschow, D. H., 1996: A proposal for measuring entrainment into the cloud-capped boundary layer.

*Proc. ETL/CSU Cloud-Related Process Modeling and Measurement Workshop,*Boulder, CO, NOAA/ETL, 29–55.Lewellen, D. C., and W. Lewellen, 1998: Large-eddy boundary layer entrainment.

,*J. Atmos. Sci.***55****,**2645–2665.Lewellen, D. C., and W. Lewellen, 2002: Entrainment and decoupling relations for cloudy boundary layers.

,*J. Atmos. Sci.***59****,**2966–2986.Lilly, D. K., 1968: Models of cloud topped mixed layers under a strong inversion.

,*Quart. J. Roy. Meteor. Soc.***94****,**292–309.Lock, A. P., 1998: The parameterization of entrainment in cloudy boundary layers.

,*Quart. J. Roy. Meteor. Soc.***124****,**2729–2753.MacVean, M. K., and P. J. Mason, 1990: Cloud-top entrainment instability through small-scale mixing and its parameterization in numerical models.

,*J. Atmos. Sci.***47****,**1012–1030.Moeng, C-H., 2000: Entrainment rate, cloud fraction and liquid water path of PBL stratocumulus clouds.

,*J. Atmos. Sci.***57****,**3627–3643.Moeng, C-H., and Coauthors, 1996: Simulation of a stratocumulus-topped PBL: Intercomparison among different numerical codes.

,*Bull. Amer. Meteor. Soc.***77****,**261–278.Moeng, C-H., B. Stevens, and P. S. Sullivan, 2005: Where is the interface of the stratocumulus-topped PBL?

, in press.*J. Atmos. Sci.*Piacsek, S. A., and G. P. Williams, 1970: Conservation properties of convection difference schemes.

,*J. Comput. Phys.***6****,**392–405.Randall, D. A., 1980: Conditional instability of the first kind upside-down.

,*J. Atmos. Sci.***37****,**125–130.Stevens, B., 2000a: Cloud transitions and decoupling in shear-free stratocumulus-topped boundary layers.

,*Geophys. Res. Lett.***27****,**2557–2560.Stevens, B., 2000b: Quasi-steady analysis of a PBL model with an eddy-diffusivity profile and nonlocal fluxes.

,*Mon. Wea. Rev.***128****,**824–836.Stevens, B., 2002: Entrainment in stratocumulus mixed layers.

,*Quart. J. Roy. Meteor. Soc.***128****,**2663–2690.Stevens, B., C-H. Moeng, and P. P. Sullivan, 1999: Large-eddy simulations of radiatively driven convection: Sensitivities to the representation of small scales.

,*J. Atmos. Sci.***56****,**3963–3984.Stevens, B., and Coauthors, 2001: Simulations of trade wind cumuli under a strong inversion.

,*J. Atmos. Sci.***58****,**1870–1891.Stevens, B., and Coauthors, 2003a: On entrainment in nocturnal marine stratocumulus.

,*Quart. J. Roy. Meteor. Soc.***129****,**3469–3492.Stevens, B., and Coauthors, 2003b: DYCOMS-II.

,*Bull. Amer. Meteor. Soc.***84****,**579–593.Stevens, D., and C. S. Bretherton, 1996: A new forward-in-time advection scheme and adaptive multilevel flow solver for nearly incompressible atmospheric flow.

,*J. Comput. Phys.***129****,**284–295.Stevens, D., A. S. Ackerman, and C. S. Bretherton, 2002: Effect of domain size and numerical resolution on the simulation of shallow cumulus convection.

,*J. Atmos. Sci.***59****,**3285–3301.Turton, J. D., and S. Nicholls, 1987: A study of the diurnal variation of stratocumulus using a multiple mixed layer model.

,*Quart. J. Roy. Meteor. Soc.***113****,**969–1009.vanZanten, M. C., P. G. Duynkerke, and J. W. M. Cuijpers, 1999: Entrainment parameterization in convective boundary layers derived from large eddy simulations.

,*J. Atmos. Sci.***56****,**813–828.Wyngaard, J. C., 1998: Experiment, numerical modeling, numerical simulation, and their roles in the study of convection.

*Buoyant Convection in Geophysical Flows,*Vol. 513, E. J. Plate et al., Eds., Kluwer Academic, 239–251.Zhu, P., and Coauthors, 2005: Intercomparison and interpretation of single-column model simulations of a nocturnal stratocumulus-topped marine boundary layer.

, in press.*Mon. Wea. Rev.*

## APPENDIX A

### Model Descriptions

Many models share some features. For instance, all solve equations for the three components of velocity, mass fraction of total water (either total water specific humidity or mixing ratio), and liquid water potential temperature in three dimensions on an Arakawa C grid. The equations governing these fields are solved on a three-dimensional mesh whose horizontal discretization is over a 96^{2}-point regular lattice, with 35-m spacing and cyclic boundary conditions. Because the NCAR model uses a pseudospectral representation and explicit horizontal filtering, this representation yields an effective resolution of 52.5 m. All except the Naval Research Laboratory (NRL) and Colorado State University (CSU) models (COAMPS and RAMS, respectively) invert Poisson equations to maintain continuity, and these inversions are uniformly based on fast Fourier transforms in the horizontal and an inversion of a tridiagonal matrix (in Fourier space) in the vertical. Most solve a thermodynamic equation that assumes that state variables are uniform within a grid volume. Hence the entire grid volume is either saturated or unsaturated; the one exception is the WVU model, which estimates the variance of thermodynamic quantities within a grid volume to estimate fractional cloudiness. The major differences among the models is in how they discretize the equations, how they model unresolved processes, and how pressure and density are decoupled from one another. These, along with the different configurations of the various models used for the purposes of this intercomparison, are detailed below.

DHARMA. DHARMA solutions were provided by A. Ackerman, M. Kirkpatrick, and D. Stevens. This model solves the Ogura–Phillips anelastic equations. The vertical discretization has a nominal spacing of 12 m, which is reduced to 4 m at the surface, varying upward as the square of a sinusoid with an amplitude of 10 m, back to

*δz*= 4 m at the initial inversion height, and stretched once again above. The top of the domain is at 1500 m, and a sponge layer occupies the upper 250 m. The DHARMA-0 integration models the SGS fluxes using a dynamic Smagorinsky–Lilly model that computes local values of*C*and Pr_{s}from the instantaneous flow conditions (Germano et al. 1991). With the dynamic SGS model, a modified version of the Brown et al. (2001) model is used to treat surface layer stresses in the bottom 2Δ_{t}*x*= 70 m of the domain. The subgrid model is treated as an explicit source term. The DHARMA-1 configuration uses the static Smagorinsky–Lilly model with*c*= 0.18,_{s}*δ*= (Δ*x*Δ*y*Δ*z*)^{1/3}, a turbulent Prandtl number (Pr) of 0.40. For both the dynamic and Smagorinsky model the stability on the grid scale is computed using a Richardson number following Mac Vean and Mason (1990). For all runs its equations are integrated using a forward-in-time method based on a second-order Runge–Kutta scheme with a third-order, total variation diminishing (TVD) upwinding advection scheme as described by Stevens and Bretherton (1996). The code is parallelized using the message passing interface with a 2D decomposition. The base calculations are performed on a 96–96–128 point mesh with a nominal time step of 2 s. On sixteen 2.4-GHz Pentium-4 processors of a Beowulf cluster, one time step takes about 5 s. Except for the dynamic SGS model, the model has been previously described by Stevens et al. (2002)._{t}IMAU. Institute for Marine and Atmospheric Research (IMAU) solutions were provide by S. de Roode. This LES model (vanZanten et al. 1999) is used by research groups at the IMAU (Utrecht University), the Royal Netherlands Meteorological Institute (KNMI), Delft University of Technology, and Wageningen University. It solves the Boussinesq equations using finite differences on a Cartesian grid with uniform a 5-m vertical grid that is translated with the mean geostrophic wind. A sponge layer is in effect for the upper 15 points. The advection of scalars is performed using the

*κ*= 1/3 TVD scheme. The leapfrog method with an Asselin filter is used to integrate in time. The SGS model is formulated following Deardorff (1980b). The code is parallelized using the message passing interface. To satisfy the Courant–Friedrichs–Lewy (CFL) criterion during the spinup phase the time step is 0.1 s. With 16 processors on an SGI Origin 3800 one time step takes about 2.6 s.MPI. MPI solutions were provided by A. Chlond and F. Müller. The MPI-LES model solves the Boussinesq equations on a regular Cartesian grid with a 5-m vertical spacing that is translated with the geostrophic wind to allow for larger time steps. A Rayleigh damping layer in the upper sixtieth of the domain was utilized to absorb vertically propagating gravity waves. The model includes most of the physical processes occurring in the moist PBL. The SGS model is based on a transport equation for the SGS turbulent energy following Deardorff (1980b), where moist processes are accounted for in the definition of the Richardson number for the MPI-0 and neglected for the MPI-1 configuration. Microphysical processes are modeled following Lüpkes’ three-variable model. Advection of momentum is formulated using a second-order scheme that conserves the integral of linear and quadratic quantities up to very small errors. In the MPI-0 configuration scalars are advected using the monotone scheme described by Chlond (1994), while for MPI-1 scalars are advected using the positive definite method described by Bott (1989). The time integration scheme uses a combination of second-order Adams–Bashforth and Euler steps. A time step of 0.8 s was used for all runs. The calculations are performed on eight processors of a NEC-SX6; one time step takes about 2.2 s. Further information can be found in Chlond (1992, 1998).

NCAR. NCAR solutions were provided by C-H. Moeng. The NCAR code solves the Boussinesq equations using a Fourier representation in the horizontal planes and finite differences in the vertical. The vertical mesh has uniform 5-m spacing topped by a rigid lid after 400 points; no sponge layer is applied. Subgrid turbulent fluxes are modeled using the Deardorff’s TKE model. All equations are time stepped using a third-order Runge–Kutta scheme with a variable time step that maintains maximum Courant numbers of about 0.5. For the vertical advection terms, a second-order finite differencing is used for the momentum equations, while the

*κ*= 1/3 TVD scheme is used for the scalar equations. For the horizontal advection terms, one simulation NCAR-0 configuration uses pseudospectral differences, while for the NCAR-1 configuration the*κ*= 1/3 scheme is applied in all directions. The code is parallelized using the message passing interface with a 1D (z) decomposition. On 80 processors (eight nodes and 10 tasks) of NCAR’s Bluesky (IBM-SP), one time step takes about 4.7 s.COAMPS. COAMPS solutions were provided by J.-C. Golaz. The COAMPS model is based on the Navy’s Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS; Hodur 1997). It solves the compressible equations of motion following Klemp and Wilhelmson (1978). Unlike the other models, its predictive scalars are

*θ*and both*q*and_{υ}*q*. The vertical grid spacing is 25 m from the surface up to 390 m, refined (5% per layer) until a minimum value of 5 m and kept constant at 5 m up to 920 m. Above this level, the grid spacing is stretched (5% per layer) up to a maximum of 25 m. The top of the domain is located at 1320 m, and a sponge layer with a damping time of 60 s is applied to the seven uppermost model levels. For the COAMPS-1 configuration SGS fluxes are computed following Smagorinsky–Lilly, while for COAMPS-0 they are computed following Deardorff (1980b). The time-stepping scheme is leapfrog for the momentum variables with a Robert filter applied, and forward in time for the scalars. Second-order advection is used for the momentum variables and the second-order Bott (1989) scheme is used for the scalars. The code is parallelized using the message passing interface with a 2D domain decomposition. The main time step is 0.5 s with 16 nested acoustic time steps. The speed of the sound waves is reduced to 240 m s_{c}^{−1}. On a 20-processor SGI Origin 2000, one time step takes approximately 10 s.RAMS. RAMS solutions were provided by H.-L. Jiang. The Colorado State RAMS model (Cotton et al. 2001) is constructed around the full set of nonhydrostatic, compressible equations. The vertical grid is 10 m except between 830 and 925 m, where it is reduced to the requisite 5-m spacing. The top of the domain is at 1500 m, and a sponge layer occupies the upper five levels. SGS fluxes are modeled following Deardorff (1980b). The momentum terms are time stepped using a hybrid combination of leapfrog and forward-in-time with an Asselin filter for the damping of the computational mode; momentum advection is computed using second-order centered differences. Scalar terms are time stepped using a forward scheme staggered with respect to the time levels of the momentum terms, so that the advecting winds correspond to the midpoint times. Scalar advection maintains the sign of the advected variable but is not monotonic. The base calculations are performed on a 96 × 96 × 160 point mesh with a time step of 0.5 s on a single-processor 1.8-GHz Linux machine.

UCLA. UCLA solutions were provided by B. Stevens and J. Edwards. The UCLA model solves the Ogura–Phillips anelastic equations using finite differences on a regular-horizontal, stretched-vertical mesh. The vertical spacing is 10 m near the surface and refined (10% per layer) to obtain a fixed 5-m (or less in the case of some sensitivity studies) spacing spanning the interval between 825 and 925 m, above which the grid is stretched again. The top of the domain is at 1470 m, and a sponge layer occupies the upper five levels. Subgrid fluxes are modeled using the Smagorinsky–Lilly model. The momentum terms are time stepped using a leapfrog scheme with an Asselin filter for the damping of the computational mode; momentum advection is computed using fourth-order centered differences. Scalar terms are time stepped using a forward scheme staggered with respect to the time levels of the momentum terms, so that the advecting winds correspond to the midpoint times. Scalar advection is TVD and uses the monotonized centered (MC) flux limiters. The code is parallelized using the message passing interface with a 1D decomposition. The base calculations are performed on a 96–96–131 point mesh with a time step of 0.667 s; on eight processors of an IBM-SP4, one time step takes about 0.5 s.

SAM. The Colorado State University System for Atmospheric Modeling (SAM) solutions were provided by M. Khairoutdinov, C. Bretherton, and P. Zhu. SAM (Khairoutdinov and Randall 2003) solves the Ogura–Phillips anelastic equations on a Cartesian grid with a uniform 5-m vertical spacing and 35-m horizontal spacing. The top of the domain is at 1600 m, and a sponge layer occupies the upper 25% of the domain. The Deardorff (1980b) SGS model is used with

*C*= 0.19 (=0.54 at the lowest grid level); Pr_{s}= 0.33 for neutral and unstable conditions. Given the anisotropy of the grid the SGS length scale is set to_{t}*δ*= Δ*z*and the horizontal eddy-diffusion coefficients are computed by multiplying the vertical coefficients by a square of the ratio of horizontal to vertical grid spacings. The momentum equations are integrated second-order centered differences using the third-order Adams–Bashforth scheme with a variable time step. All the scalars are transported using a monotonic scheme. The code is parallelized using the message passing interface with a 2D domain decomposition. The base calculations are performed on a 96 × 96 × 320 point mesh with a time step of 1.0 s on eight processors of 350-MHz SGI Origin workstation. One time step takes about 2.5 s.METO. METO solutions were provided by E. Whelan and A. Lock. The Met Office model, as per Brown et al. (2002), solves Boussinesq equations (instead of anelastic) using an Arakawa C grid in the horizontal and a Lorenz grid in the vertical with variable vertical resolution. The nominal vertical spacing is 10 m refined to obtain a fixed 5-m spacing spanning the interval between 700 and 900 m above which the grid is stretched again. The momentum terms are time stepped using a leapfrog scheme with a Robert–Asselin time filter. Momentum advection is computed using the Piascek–Williams advection scheme. Scalar terms are time stepped using a leapfrog scheme with a Robert–Asselin time filter. Scalar advection is computed using the TVD/ULTIMATE scheme. The subgrid model follows the method of Smagorinsky–Lilly and is solved explicitly with the Richardson number in the stability dependence calculated using the method of MacVean and Mason (1990). The code is parallelized using general communication (GCOM) library routines with a 1D decomposition. The base calculations are performed on a 96–96–110 point mesh with a variable time step based on a Courant number of 0.4 using horizontal Gallilean transformation to minimize the Courant number. This gave an average time step of 0.125 s. The model was run on four processors of an NEC SX-6, with one time step taking about 0.5 s

WVU. WVU solutions were provided by D. Lewellen. This model solves Boussinesq equations approximation using finite differences over an Arakawa C grid with stretched vertical spacing. The stretching rate within the layer is always 10% or less. There is damping imposed on the upper five levels. The subgrid model is a TKE scheme, with the subgrid turbulence length scale dependent on local grid spacing, distance from the surface, and Richardson number. A saturation variance is carried to implement subgrid partial cloudiness following Sommeria, Deardorff, and Mellor. The momentum terms (and TKE and saturation variance) are advanced using a leapfrog scheme in time and second-order centered differences in space (Piacsek and Williams 1970). Temperature and humidity are advected using the piecewise parabolic method (ppm). Diffusion terms are implemented implicitly in the vertical and explicitly in the horizontal (some with the DuFort–Frankel scheme). The time step is allowed to vary and the Courant condition is checked everywhere at each time step. The base case was run on a 96 × 96 × 118 point grid with the time step = 0.5 s over most of the run. On an old single-processor Alpha Linux box, each time step took 19 s. WVU-0 differs from WVU-1 in that it uses the unsaturated Richardson number at cloud top when calculating SGS fluxes.

## APPENDIX B

## APPENDIX C

### Thumbnail

Figure C1 gives an overview of the model profile statistics.

Time series of master ensemble liquid water path, cloud fraction, and turbulence kinetic energy. The light shading spans the entire distribution and is delimited by the maximum and minimum value within the master ensemble at any given time. The dark shading denotes the central half of the distribution as delimited by the first and third quartiles. The line is the ensemble mean over the master ensemble.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Time series of master ensemble liquid water path, cloud fraction, and turbulence kinetic energy. The light shading spans the entire distribution and is delimited by the maximum and minimum value within the master ensemble at any given time. The dark shading denotes the central half of the distribution as delimited by the first and third quartiles. The line is the ensemble mean over the master ensemble.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Time series of master ensemble liquid water path, cloud fraction, and turbulence kinetic energy. The light shading spans the entire distribution and is delimited by the maximum and minimum value within the master ensemble at any given time. The dark shading denotes the central half of the distribution as delimited by the first and third quartiles. The line is the ensemble mean over the master ensemble.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Time series of cloud boundaries of master ensemble, with shading as in Fig. 2. Markers identify cloud boundaries following the analysis of Stevens et al. (2003b), wherein the data were tagged for their Lagrangian coherency. The LES case here was designed to match the observations over the central study region where most of the data were collected. In this figure unboxed markers denote cloud-base estimates from the lifting condensation level calculated using in situ data collected below cloud top or cloud-top estimates derived from lidar and radar backscatter. Boxed markers indicate estimates of cloud base and top from aircraft soundings. The straight solid line denotes the best-fit line to the cloud base over the central study region; it descends at a rate of 2 m h^{−1}. Dashed lines are fits by eye to cloud-top data.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Time series of cloud boundaries of master ensemble, with shading as in Fig. 2. Markers identify cloud boundaries following the analysis of Stevens et al. (2003b), wherein the data were tagged for their Lagrangian coherency. The LES case here was designed to match the observations over the central study region where most of the data were collected. In this figure unboxed markers denote cloud-base estimates from the lifting condensation level calculated using in situ data collected below cloud top or cloud-top estimates derived from lidar and radar backscatter. Boxed markers indicate estimates of cloud base and top from aircraft soundings. The straight solid line denotes the best-fit line to the cloud base over the central study region; it descends at a rate of 2 m h^{−1}. Dashed lines are fits by eye to cloud-top data.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Time series of cloud boundaries of master ensemble, with shading as in Fig. 2. Markers identify cloud boundaries following the analysis of Stevens et al. (2003b), wherein the data were tagged for their Lagrangian coherency. The LES case here was designed to match the observations over the central study region where most of the data were collected. In this figure unboxed markers denote cloud-base estimates from the lifting condensation level calculated using in situ data collected below cloud top or cloud-top estimates derived from lidar and radar backscatter. Boxed markers indicate estimates of cloud base and top from aircraft soundings. The straight solid line denotes the best-fit line to the cloud base over the central study region; it descends at a rate of 2 m h^{−1}. Dashed lines are fits by eye to cloud-top data.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile of mean state of specific humidity and temperature at initial time (dashed lines), as observed (points), and from master ensemble averaged over the fourth hour (solid lines). The shading is as in Fig. 2 and as described in the text.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile of mean state of specific humidity and temperature at initial time (dashed lines), as observed (points), and from master ensemble averaged over the fourth hour (solid lines). The shading is as in Fig. 2 and as described in the text.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile of mean state of specific humidity and temperature at initial time (dashed lines), as observed (points), and from master ensemble averaged over the fourth hour (solid lines). The shading is as in Fig. 2 and as described in the text.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile of vertical velocity statistics—(left) resolved buoyancy production, (middle) variance of *w*, and (right) third moment of *w*—from master ensemble averaged over the fourth hour. Markers indicate estimates of vertical velocity second and third moments as derived from in situ (solid with bar) and radar (circle–dot). Details of data analysis provided by Stevens et al. (2003a). As labeled in the left panel, the dashed lines are two simulations drawn from the master ensemble: UCLA-0 (long dash) and UCLA-1 (short dash). Horizontal dashed lines delimit cloud area. The shading is as in Fig. 2 and as described in the text.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile of vertical velocity statistics—(left) resolved buoyancy production, (middle) variance of *w*, and (right) third moment of *w*—from master ensemble averaged over the fourth hour. Markers indicate estimates of vertical velocity second and third moments as derived from in situ (solid with bar) and radar (circle–dot). Details of data analysis provided by Stevens et al. (2003a). As labeled in the left panel, the dashed lines are two simulations drawn from the master ensemble: UCLA-0 (long dash) and UCLA-1 (short dash). Horizontal dashed lines delimit cloud area. The shading is as in Fig. 2 and as described in the text.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile of vertical velocity statistics—(left) resolved buoyancy production, (middle) variance of *w*, and (right) third moment of *w*—from master ensemble averaged over the fourth hour. Markers indicate estimates of vertical velocity second and third moments as derived from in situ (solid with bar) and radar (circle–dot). Details of data analysis provided by Stevens et al. (2003a). As labeled in the left panel, the dashed lines are two simulations drawn from the master ensemble: UCLA-0 (long dash) and UCLA-1 (short dash). Horizontal dashed lines delimit cloud area. The shading is as in Fig. 2 and as described in the text.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile metrics plotted vs LWP for all members of the master ensemble: (top) Surface minus cloud layer specific humidity *δq _{t}*; (middle) vertical velocity variance,

*σ*

^{2}|

_{max}; (bottom) minimum buoyancy flux

*F*

_{b,}_{min}.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile metrics plotted vs LWP for all members of the master ensemble: (top) Surface minus cloud layer specific humidity *δq _{t}*; (middle) vertical velocity variance,

*σ*

^{2}|

_{max}; (bottom) minimum buoyancy flux

*F*

_{b,}_{min}.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profile metrics plotted vs LWP for all members of the master ensemble: (top) Surface minus cloud layer specific humidity *δq _{t}*; (middle) vertical velocity variance,

*σ*

^{2}|

_{max}; (bottom) minimum buoyancy flux

*F*

_{b,}_{min}.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Various flow statistics plotted vs LWP for the master ensemble. (top) Radiative flux divergence across the entire PBL estimated directly (solid circles) or from heat and moisture budgets (open circles); solid gray line denotes maximum flux divergence *F*_{0} − *F*_{1} = 48 W m^{−2} due to the presence of cloud. (middle) Entrainment rate, *E*, as estimated by the time rate of change of *z _{i}* (solid circles) or by the moisture budget (open circles). (bottom) Nondimensional entrainment rate

*α*. The solid gray line on the last panel indicates,

*α*∗, the mixed-layer estimate of a decoupling threshold.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Various flow statistics plotted vs LWP for the master ensemble. (top) Radiative flux divergence across the entire PBL estimated directly (solid circles) or from heat and moisture budgets (open circles); solid gray line denotes maximum flux divergence *F*_{0} − *F*_{1} = 48 W m^{−2} due to the presence of cloud. (middle) Entrainment rate, *E*, as estimated by the time rate of change of *z _{i}* (solid circles) or by the moisture budget (open circles). (bottom) Nondimensional entrainment rate

*α*. The solid gray line on the last panel indicates,

*α*∗, the mixed-layer estimate of a decoupling threshold.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Various flow statistics plotted vs LWP for the master ensemble. (top) Radiative flux divergence across the entire PBL estimated directly (solid circles) or from heat and moisture budgets (open circles); solid gray line denotes maximum flux divergence *F*_{0} − *F*_{1} = 48 W m^{−2} due to the presence of cloud. (middle) Entrainment rate, *E*, as estimated by the time rate of change of *z _{i}* (solid circles) or by the moisture budget (open circles). (bottom) Nondimensional entrainment rate

*α*. The solid gray line on the last panel indicates,

*α*∗, the mixed-layer estimate of a decoupling threshold.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

(top) Visualization of flow fields from (left) UCLA-0 and (right) UCLA-1 simulations at the end of the simulation period. Shown are (top) plan-view images of the albedo estimated from the liquid water path, and (bottom) cross sections showing vertical velocity (shaded) and cloud water (contoured). The cross-section cuts are indicated by the white dashed line in plan-view plots. These fields are drawn from simulations wherein *N _{x}* =

*N*= 192 and Δ

_{y}*x*= Δ

*y*= 20 m. The change in the horizontal mesh leads to more pleasing flow visualization, but has no marked impact on the flow statistics.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

(top) Visualization of flow fields from (left) UCLA-0 and (right) UCLA-1 simulations at the end of the simulation period. Shown are (top) plan-view images of the albedo estimated from the liquid water path, and (bottom) cross sections showing vertical velocity (shaded) and cloud water (contoured). The cross-section cuts are indicated by the white dashed line in plan-view plots. These fields are drawn from simulations wherein *N _{x}* =

*N*= 192 and Δ

_{y}*x*= Δ

*y*= 20 m. The change in the horizontal mesh leads to more pleasing flow visualization, but has no marked impact on the flow statistics.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

(top) Visualization of flow fields from (left) UCLA-0 and (right) UCLA-1 simulations at the end of the simulation period. Shown are (top) plan-view images of the albedo estimated from the liquid water path, and (bottom) cross sections showing vertical velocity (shaded) and cloud water (contoured). The cross-section cuts are indicated by the white dashed line in plan-view plots. These fields are drawn from simulations wherein *N _{x}* =

*N*= 192 and Δ

_{y}*x*= Δ

*y*= 20 m. The change in the horizontal mesh leads to more pleasing flow visualization, but has no marked impact on the flow statistics.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profiles of the buoyancy flux and vertical velocity (cf. Fig. 5) but with four different simulations by the UCLA-0 configuration of the model and different vertical grid spacings of 1, 2, 5, and 10 m.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profiles of the buoyancy flux and vertical velocity (cf. Fig. 5) but with four different simulations by the UCLA-0 configuration of the model and different vertical grid spacings of 1, 2, 5, and 10 m.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profiles of the buoyancy flux and vertical velocity (cf. Fig. 5) but with four different simulations by the UCLA-0 configuration of the model and different vertical grid spacings of 1, 2, 5, and 10 m.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profiles of the buoyancy flux and vertical velocity (cf. Fig. 5) but for simulations with a free-tropospheric *q _{t}* = 5.5 g kg

^{−1}.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profiles of the buoyancy flux and vertical velocity (cf. Fig. 5) but for simulations with a free-tropospheric *q _{t}* = 5.5 g kg

^{−1}.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Profiles of the buoyancy flux and vertical velocity (cf. Fig. 5) but for simulations with a free-tropospheric *q _{t}* = 5.5 g kg

^{−1}.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Fig. C1. (upper six rows) Thumbnails of profile and (last row) time series statistics for the master ensemble.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Fig. C1. (upper six rows) Thumbnails of profile and (last row) time series statistics for the master ensemble.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Fig. C1. (upper six rows) Thumbnails of profile and (last row) time series statistics for the master ensemble.

Citation: Monthly Weather Review 133, 6; 10.1175/MWR2930.1

Members of master ensemble and various diagnostics/configuration specifications: LWP (vertically integrated liquid water path) over last hour; *F*_{θl}|_{sgs} denotes the SGS contribution to the minimum *θ _{l}* flux (in energetic units) near the inversion; SGS models are either Deardorff (1980b), Smago (for Smagorinsky–Lilly), Smago–MM indicating Smagorinsky with the MacVean and Mason (1990) stability correction, or in the case of DHARMA-0 a dynamic model. The * denotes the SGS model was modified so that the dry measure of stability was used at cloud top. Advection schemes for scalars were either variance diminishing (denoted M, for monotone) or variance preserving (C for centered or positive definite, PS for pseudospectral).

Scalar metrics for different configurations of UCLA-0 (no SGS on scalars) and UCLA-1 models. The last two simulations are for a different set of initial conditions as discussed in section 4.

Table B1. Temporal statistics from LES. Each field is valid at a particular time.

Table B2. Profile statistics from LES. Excepting the time and height fields, which do not vary with time, each field consists of eight vertical profiles averaged over 30-min intervals and one initial profile. The vertical profiles are either given at temperature or *w* points depending on the field.

^{1}

Note that *c _{p}* can vary substantially across the cloud-top interface: for dry air

*c*

_{pd}= 1005 J kg

^{−1}K

^{−1}, while for water vapor

*c*

_{pυ}= 1870 J kg

^{−1}K

^{−1}, which implies that the isobaric specific heat above the inversion is approximately 1008 J kg

^{−1}K

^{−1}and 1022 J kg

^{−1}K

^{−1}below, hence our use of an intermediate value that excludes a dependence on the amount of ambient water vapor.