1. Introduction
Convective-scale data assimilation aims at improving forecasts of severe weather events, which are often related to deep convection. The prediction of these events requires not only an accurate initial state of the large-scale environmental conditions, but also knowledge on the location and structure of individual convective systems at the kilometer-scale. Cloud-affected satellite observations from geostationary satellite sensors provide a promising source of information in this context as they reveal insights into dynamically active regions of the atmosphere (McNally 2002) and cover a large area with high spatial resolution in the range of kilometers and high temporal resolution in the range of minutes. Furthermore, clouds are an easily detectable signal of emerging convective systems that can be observed earlier than larger precipitating hydrometeors that are seen by weather radars.
Observations from different satellite channels provide very complementary information for this purpose: Water vapor infrared channels are sensitive to water and ice clouds, containing information on atmospheric humidity and temperature. The brightness temperature of clouds observed in these channels provides information on the cloud top height. Due to the absorption by water vapor these channels peak fairly high, so they are only sensitive to mid- and upper-level clouds. Infrared window channels can see through the atmosphere, but low clouds are often hard to distinguish from the surface in these observations. Also, high-level ice clouds are often opaque in infrared channels leading to a lack of information on water clouds beneath them. Visible channels are available only during day time. While visible channels are not sensitive to temperature, humidity and cloud top height and less sensitive to ice clouds, they can provide more information on low- and midlevel clouds. Visible channels allow for a clear distinction between low-level clouds and the surface (Heinze et al. 2017), unless the latter is covered by snow or ice.
Despite this wealth of available information, cloud-affected visible and infrared satellite observations are not yet assimilated in operational convection-permitting numerical weather prediction (NWP) models (Gustafsson et al. 2018; Geer et al. 2018). Previous case studies highlighted the potential benefit of assimilating cloud-affected infrared satellite observations for the prediction of tropical cyclones (Zhang et al. 2016; Otkin et al. 2017; Honda et al. 2018) and organized convection (Cintineo et al. 2016; Zhang et al. 2018, 2019) over the continental United States using convection-permitting models. To improve the prediction of local severe weather, infrared radiances were assimilated above the pacific (Sawada et al. 2019) with 10-min temporal resolution. Scheck et al. (2020) conducted the first study assimilating a visible satellite channel in a regional model for two cases with summertime convective precipitation over Germany. The simultaneous assimilation of visible and infrared channels has not been investigated so far. Furthermore, the impact of these two observation types on the practical predictability of precipitation has not been compared, yet.
The incorporation of cloud-affected microwave satellite radiances in global assimilation systems has led to significant forecast improvements in recent years (Bauer et al. 2010; Geer et al. 2010, 2017, 2018), but cloud-affected infrared observations are still not assimilated directly yet and microwave channels are not available on current geostationary satellites. Polar-orbiting satellites, however, do not provide sufficient temporal resolution and coverage for convective-scale data assimilation in regional models.
Challenges for the assimilation of cloud-affected radiances include the errors of forward operators (Scheck et al. 2018), correlated observation errors (Janjić et al. 2017), the non-Gaussian distribution of errors (Geer et al. 2010), systematic errors in the representation of clouds (Otkin et al. 2018) and the ambiguity of observed integrated radiation in one channel resulting from the sensitivity to various model variables (e.g., water clouds, ice clouds, humidity, and temperature). Various methods have been developed to address these challenges. For instance, cloud-dependent error models (Geer et al. 2010) are capable to address the non-Gaussianity of errors. Meanwhile, the error model initiated by Geer et al. (2010) has been extended for the assimilation of cloud-affected infrared radiances by Harnisch et al. (2016) and Okamoto et al. (2014). All these error models are based on error climatologies as functions of cloud impact. The error climatology typically increases with cloud impact. A different approach is the error model with dynamic observation error inflation developed by Minamide and Zhang (2017). Observation thinning mitigates issues due to correlated errors (see, e.g., Waller et al. 2016), and recent studies tested the incorporation of correlated observation errors in data assimilation (Geer 2019). Observational ambiguities may be mitigated through the combined assimilation of different channels or observation types.
To investigate the potential impact of satellite data assimilation and various approaches for their treatment, Houtekamer and Zhang (2016) suggested to study the optimal use of cloud-affected radiance measurements in observing system simulation experiments (OSSEs). In an OSSE, a model simulation is regarded as truth (nature run) and several data assimilation experiments with synthetic observation simulated from the nature run are conducted that aim to reproduce the nature run as closely as possible. While Zhang et al. (2016) assimilated cloud-affected radiances in the infrared with an OSSE, Cintineo et al. (2016) combined infrared and radar observations in OSSEs. The complex configuration of their OSSE includes (e.g., structured terrain and boundary conditions from global-scale model ensembles).
To reduce the complexity and focus on a particularly challenging case with randomly located convection, we conduct a more idealized OSSE with homogeneous initial conditions and small random noise to trigger convection following studies for radar data assimilation (Lange and Craig 2014; Bachmann et al. 2019, 2020). In this setup, we neglect orography and land surface heterogeneity. The boundary and initial conditions are perturbed randomly and the statistics of the perturbations can be reproduced for even larger ensembles without requiring boundary, or initial conditions from larger-scale numerical weather prediction models. Our OSSEs are based on the Payerne sounding measured over Switzerland during a day of deep convection. The convective clouds evolve throughout the troposphere in a time scale of
For data assimilation, we use the local ensemble transform Kalman filter (LETKF; Hunt et al. 2007) implemented in the kilometer-scale ensemble data assimilation system KENDA for the operational regional model, Consortium for Small-Scale Modeling (COSMO) of Deutscher Wetterdienst (Schraff et al. 2016). The COSMO–KENDA system is operational at Deutscher Wetterdienst and has been used for a number of assimilation studies (Schomburg et al. 2015; Necker et al. 2018; Sommer and Weissmann 2014, 2016; Hutt et al. 2020). To calculate synthetic infrared satellite observations from the model state, we simulate the cloud-affected infrared radiances with the radiative transfer code RTTOV (Saunders et al. 1999; Matricardi and Saunders 1999). For synthetic observations in the visible channel, we use the method Method for Fast Satellite Image Simulation (MFASIS) recently put forward by Scheck et al. (2016, 2018), which is by now also included in RTTOV. Compared to the assimilation of conventional observations (Schraff et al. 2016; Necker et al. 2018), a larger number (>6000) of all-sky radiance measurements can be assimilated every hour in a model domain covering (e.g., central Europe).
Based on these OSSEs, we compare the impact of assimilating cloud-affected radiances from an infrared water vapor channel and from a visible channel as well as the combination of both types. We aim to find appropriate settings for the LETKF to assimilate all-sky satellite observations for the challenging case of deep convection and address the following questions:
How can we efficiently assimilate cloud-affected radiances during deep convection?
What is the analysis and forecast impact of infrared and visible satellite radiances?
What is the benefit of combining the assimilation of infrared and visible radiances?
In the following, section 2 describes the setup of our OSSEs. Section 3 discusses results from assimilating visible and infrared radiances and section 4 the sensitivity of the results with respect to changes in the assimilation parameters. Conclusions are provided in section 5.
2. Observing system simulation experiments
Nolan et al. (2013) discuss the complexity of simulating a nature run in OSSEs, when surface heat exchange, structured orography and boundary conditions of global-scale numerical weather prediction are present. To reduce the complexity, we use an idealized setup with a flat domain and cyclic boundary conditions. This section explains the setup of our OSSEs, shows resulting fields from the nature run, and provides an impression of the simulations with a focus on synthetic satellite radiances.
a. COSMO–KENDA in an idealized configuration with initial perturbations
Our OSSE setup largely follows previous studies for radar data assimilation (Lange and Craig 2014; Bachmann et al. 2019, 2020) using the COSMO model, version 5.3. We initialize wind, temperature, and humidity with a radiosonde profile from Payerne, Switzerland, at 1200 UTC 30 July 2007 and add two types of perturbation for each ensemble member to account for the uncertainty on smaller and larger scales (see below). The sounding is from a day with deep convection. Strong mesoscale convective systems formed on that day (Lange and Craig 2014) due to a high CAPE of 2200 J kg−1 and relatively low CIN in a vertical wind shear [see Fig. 1a of Bachmann et al. (2020)]. In contrast to the studies undertaken by Lange and Craig (2014) and Bachmann et al. (2019, 2020), the starting time of the initial forecasts corresponds to the time of the radiosonde observation. The idealized setup is homogeneous in the horizontal without vegetation or orography. The model domain covers a region of (Lx, Ly, Lz) = (396 km × 396 km × 22 km) with a horizontal resolution of Δx = Δy = 2 km. The model integration time step is 6 s. The vertical resolution extends from 100 m in the lowest atmospheric layers to 800 m at the domain top and includes 50 model levels. A Rayleigh damping is applied aloft of 15 km. The model runs with cyclic horizontal boundary conditions. The Coriolis force is neglected. During the course of the day, the radiation on Earth’s surface varies with the zenith angle of the sun. In this way, the idealized setup mimics the weather situation of a typical day with deep convection and a strong influence of the diurnal cycle. A one-moment cloud microphysics scheme similar to the one developed by Lin et al. (1983) is used, which includes cloud ice, cloud water, rain, snow and graupel hydrometeors and contains a simplified version of the parameterization of Seifert and Beheng (2001) for autoconversion, accretion and self-collection. Deep convection is represented explicitly and we do not apply a shallow convection scheme.
1) Ensemble perturbations and nature run
To represent initial and boundary condition uncertainty of a regional ensemble system, we add two types of perturbations to the Payerne sounding to form the initial conditions for the ensemble members: A vertically correlated perturbation that depends only on height, which is meant to represent the large-scale uncertainty, and gridscale noise for the uncertainty on smaller scales.
As in Lange and Craig (2014), the small-scale component consists of white noise with a standard deviation of 0.02 m s−1 for the vertical velocity and 0.02 K for the temperature and is limited to the lowest 100 hPa. Adding this white noise triggers the development of convective cells. The resulting cell-position is random and completely uncorrelated in space between ensemble members.
For the representation of larger-scale errors, we add perturbations on the vertical profiles of the initial conditions following Bachmann et al. (2020). As the boundary conditions are cyclic, these perturbations represent both large-scale initial condition errors and boundary condition errors. We perturb the initial conditions in the vertical and add
Due to the cyclic boundary conditions, the added random perturbations are sustained within the domain of each ensemble member and are only subject to diffusion.
The initial conditions for the nature run are constructed like the ones for the ensemble members, but using different random numbers. The nature run is a free forecast initialized at 1200 UTC and will serve as the truth to calculate the errors of the assimilation experiments. The 40-member free ensemble forecasts (also initialized at 1200 UTC) serve as the benchmark to evaluate the relative improvement by assimilating visible/infrared radiances.
In this simplified OSSE setup, we use both the same forecast model and forward operator for the simulated truth (nature run) and the assimilation/forecast experiments. This has the advantage to study the assimilation and potential impact of observations in the absence of systematic model, observation and operator deficiencies, which pose a severe issue for the assimilation of cloud-affected observations in real-world systems. However, this also means that the achieved impact is likely significantly larger than the impact of such observations in real data assimilation systems.
2) KENDA data assimilation configuration
The KENDA assimilation system (Schraff et al. 2016) is operational at Deutscher Wetterdienst and has been used for a number of assimilation studies (Schomburg et al. 2015; Necker et al. 2018; Sommer and Weissmann 2014, 2016; Zeng et al. 2019). It is based on a local ensemble transform Kalman filter (LETKF; Hunt et al. 2007). As in the operational setup, we use 40 ensemble members. In the OSSEs, we only assimilate synthetic satellite observations, but no conventional and radar observations that are usually assimilated in operational assimilation systems. Synthetic 6.2 μm SEVIRI images (one of the water vapor channels) are calculated from the nature run using the RTTOV package (version 10) and visible 0.6 μm images are generated using MFASIS. To represent observation errors, white noise is added to these synthetic satellite observations. This noise has a standard deviation of 3 K for brightness temperature and of 3% for visible reflectances. In our setup, the pixels of the synthetic satellite images correspond to the cells of the horizontal model grid. While a diurnal variation of solar zenith angle (SZA) is taken into account in the internal radiative transport scheme for calculating heating rates, a fixed geometry with a SZA of 8°, a satellite zenith angle of 36° and a scattering angle of 152° is used for the generation of the satellite images. Furthermore, it should be noted that we also assimilate visible observations after sunset in this idealized study, whereas these observations would be limited to daytime in real systems. We regard these simplifications to be justified in this idealized setup, because we are primarily interested in fundamental properties of the observations like their information content and not in practical problems related to their systematic errors or their restricted availability. Moreover, a major fraction of summertime convective precipitation does occur during daytime, where visible observations would be available.
The number of satellite observations is reduced by “superobbing” (i.e., by averaging the satellite image on a certain length scale) (see, e.g., Scheck et al. 2020). For this purpose, the observation operator is called for each column of the model grid and then the results are averaged over blocks of 6 by 6 grid cells, corresponding to a superobbing scale of 12 km. Single thunderstorm cells exhibit a characteristic radius of ≈10 km during the onset of convection. The averaging area of 12 × 12 km2 is therefore about the scale of the individual thunderstorm cells. In the standard data assimilation setup, we use a cycling period of 15 min, corresponding to the time interval between full disk SEVIRI scans from the standard 0° Meteosat service. A horizontal averaging of the measurements to a scale of the storm system must be in accordance with the horizontal localization (Craig and Würsch 2013). A relatively small horizontal localization (Lh = 32 km) is chosen with the purpose to draw the ensemble closely to the observations as previously done for radar data assimilation (Lange and Craig 2014). For the experiments assimilating cloud-affected observations, we do not localize in the vertical as clouds reveal the convective dynamics of the whole atmospheric column. Only for the assimilation of clear-sky observations, we conducted one experiment without vertical localization and one experiment with vertical localization (a logarithmic radius of 0.3 hPa around the observation height of 350 hPa). The observation error for the visible spectral range is set to a constant value of 0.2 in the reference experiments and to 0.3 in further sensitivity experiments. For the infrared water vapor observations, a cloud-dependent dynamic error model is employed (section 2e). For the reference experiments, this leads to an assigned observation error of 1.1 K for clear-sky observations and an assigned error between 1.5 and 6.4 K for cloud-affected observations. Furthermore, sensitivity experiments were performed with assigned errors increased by 50%.
In contrast to the assimilation experiments by Scheck et al. (2020) and Hutt et al. (2020), no multiplicative or additive inflation (Zeng et al. 2019) of the error covariance matrix is used. To conserve positivity of relative humidity, we employ saturation adjustment in the LETKF (Schraff et al. 2016). The data assimilation begins at 2000 UTC and ranges up to 5 h. We start forecasts with a lead time of 8 h for each ensemble member from the analysis after 1, 3, and 5 h of data assimilation (Fig. 1).
b. Overview of assimilation experiments and sensitivity studies
Table 1 summarizes the conducted experiments. These consist of four reference experiments that are discussed in section 3 and six further sensitivity experiments with modified settings that are discussed in section 4.
Overview of all data assimilation experiments—assimilating brightness temperature (BT), visible observations (VIS), and a combination of both with observation error oe(CA) depending on cloud impact in the water vapor band (Harnisch et al. 2016) and a given constant oevis for the visible spectral range. All experiments are assimilated for ≥1 h with a cycling period of 15, 30 min, or 1 h. Forecasts of 8 h each can be started after 4 cycles for all 40 members from the analysis. The data assimilation cycle in all experiments begins at 2000 UTC. Experiment BTCA=0 assimilates only clear-sky values, while
The first set of experiments compares the effect of assimilating different instruments and use a cycling period of 15 min: brightness temperature (BT) with standard error settings, the visible channel in VISoe=0.2 with an assigned observation error (OE) of 0.2, and both observation types with these settings in BT + VISoe=0.2. Experiment BTCA=0 assimilates clear-sky brightness temperature, only.
In sensitivity experiments, we increased the assigned observation errors by 50% for brightness temperature in the experiment BToe×1.5 and for visible observations in the experiments VISoe=0.3 and BT + VISoe=0.3. We additionally used 30 and 60 min as cycling periods for the combined assimilation of brightness temperature and visible reflectance. Furthermore, only clear-sky brightness temperature was assimilated using vertical localization in experiment
c. Evolution of the nature run
After the start of the nature run from the perturbed profile described in section 2a(1), it takes about 7 h until the perturbations have grown sufficiently to develop into first convective cells at around 1900 UTC. During this time a thin stratiform cloud layer is present, which forms right after the beginning of the model run and quickly dissolves when convection sets in and air starts to descend between the convective cells. This cloud layer is probably only an artifact related to deficiencies in the model radiation and microphysics and we consider it not to be of relevance for the convective activity we are interested in.
In Fig. 2, hourly snapshots from the evolution of the nature run are displayed between 2000 and 0100 UTC. The rows of Fig. 2 show brightness temperature in the 6.2 μm water vapor channel, visible reflectance in the 0.6 μm channel, column maximum of radar reflectivity, column maximum of the cloud ice mixing ratio, and column maximum of the cloud water mixing ratio, respectively (from top to bottom). The snapshots show a representative area of the convection that occurs horizontally isotropic over the whole domain. It is obvious that the brightness temperature of the high-peaking water vapor channel is strongly correlated with the cloud ice content and that the visible reflectances mostly depend on cloud water. There is also some weak contribution from ice clouds to the visible reflectance. This contribution is much weaker than the one from cloud water, because the mass of cloud ice in the atmosphere is smaller than the one of cloud water and the ice particles are larger, which reduces their effectiveness in scattering visible light (see discussion in Scheck et al. 2020). The radar reflectivity Z indicates precipitation and is calculated based on the prognostic fields of rain, snow, and graupel following Done et al. (2004).
In the first column of Fig. 2 (i.e., at 2000 UTC), remnants of the stratiform cloud layer are still visible in VIS and QC, but at 2100 UTC the layer has completely dissolved. In all rows we see signs of convective activity that increases in the first 2–3 h and slowly decays afterward. In BT and QI we see the increased formation of ice clouds in the first hours. The maxima in QI and the much smaller-scale structures in Z indicate the location of the cores of the convective cells. The latter are not clearly identifiable in the infrared images, as the relatively large-scale anvil clouds are opaque in this channel. In the visible channel the ice clouds are nearly transparent and smaller-scale water clouds below can be observed. It should be noted that this effect may be exaggerated by too weak anvil clouds in the model. Water clouds are not only present at the location of convective cores, but also farther away, in some cases outside of the regions covered by anvil clouds. These water clouds are likely to be a result of gust fronts triggered by cold pools (Lange and Craig 2014; Lange et al. 2017).
d. Effect of initial perturbations on the ensemble spread
Following Bachmann et al. (2020), we added vertically correlated perturbations of wind, temperature, and relative humidity to the initial profile to represent larger-scale errors. Already during the first hour of the model integration, this leads to significant deviations of CAPE and CIN in the ensemble members.
The initial perturbations enhance the spread of all prognostic variables at later times: The time when deep convection sets in varies over the ensemble members as can be seen in the ensemble mean brightness temperature fields–when a cooling sets in in the mean temperature (Fig. 3). While this cooling occurred due to convection over all ensemble members within a time period of ±0.5 h before adding perturbations to the radiosonde profile (Bachmann et al. 2019, show the variability of the onset of precipitation), the time period is now extended to ±1.5 h with the vertical variability in the initial conditions (Fig. 3). The onset of the convection is more clearly seen in the visible channel. The mean reflectance of most members drops at 2000 UTC from ≈0.7 to ≈0.4. The decrease in mean reflectance is due to the breakup of the stratus layer during the onset of convection. As deep convective clouds form, after 2000 UTC, the brightness temperature decreases from ≈236 to ≤232 K in all members. One ensemble member forms deep convective clouds already earlier at 1600 UTC.
e. Observation error model for brightness temperature
To account for the non-Gaussianity of the first-guess departures mainly caused by the presence of clouds we apply the cloud-dependent error model developed by Harnisch et al. (2016) to efficiently assimilate cloud-affected radiances. In this approach the assigned error is increased for cases in which the observed brightness temperature or its model equivalent is smaller than a limiting brightness temperature BTlim, which is used to distinguish between clear-sky and cloudy situations; BTlim mainly depends on the satellite channel. Here we focus on the 6.2 μm water vapor channel.
A number of parameters, such as limiting brightness temperature BTlim, cloud impact Ca, and dynamic error variance
The cloud-impact values range from 0 to ≈25 K in our simulations. The resulting cloud impact values are classified to a class K with a value of cloud impact
Notably, the FGD histograms in the idealized deep convection are wider than the ones calculated by Harnisch et al. (2016) in their Fig. 4. We attribute this to the deep convective clouds that show a clear contrast to the warmer ground and the resulting strong FGDs at cloud edges. The distributions peak at small values, where either clear-sky or cloudy conditions occur in both the simulated observations as well as in the ensemble member. The error model leads to more Gaussian all-sky departures after the first cycle when the convection is not completely uncorrelated anymore between ensemble members. Small clear-sky departures occur especially in early assimilation cycles during the first hour. At later times, when clouds have formed in all ensemble members, the troposphere is more mixed. The corresponding first-guess departures of clear-sky radiances exhibit a wide range of clear-sky values also following a Gaussian.
3. Results from assimilating visible and infrared radiances
This section focuses on the comparison of the four main assimilation experiments. The first one (BT) assimilates brightness temperatures in the infrared 6.2 μm channel with standard error settings, the second one (VISoe=0.2) visible reflectance in the 0.6 μm channel with a constant assigned error of 0.2, and the third one (BT + VISoe=0.2) both observation types with these error settings. Finally, experiment BTCA=0 assimilates clear sky brightness temperature in the infrared 6.2 μm channel with standard error settings (i.e., an error of 1.1 K). The discussion of further sensitivity experiments with modified settings follows in section 4.
a. Impact during data assimilation cycling
Figure 5 shows time series of the evolution of the mean absolute error of the LETKF mean prior (15-min forecast) during the 5-h assimilation period for cloud ice (QI), cloud water (QC), water vapor (QV), meridional wind (V), and temperature (T) of the free forecast experiment and the three assimilation experiments. In this idealized setup, the zonal wind behaves similarly to the meridional wind and is not shown in the following.
The clear-sky data-assimilation experiment BTCA=0 assimilates 3162 observations in the first and 1257 observations in the second cycle, while all-sky experiments assimilate all available radiance observations over the whole domain. Without data assimilation, the error in all variables approximately doubles in the first 1–2 h, reaches its maximum after 1–3 h and decreases afterward particularly for cloud water and cloud ice. This decrease is related to the decay of convection.
The three experiments with all-sky data assimilation nearly always exhibit a reduced error with respect to the free ensemble. The only exceptions are a slightly increased cloud water error in the BT experiment in the first hour and in the VISoe=0.2 experiment in the second hour.
Generally, the BT experiment shows a more pronounced error reduction than VISoe=0.2 in this situation dominated by randomly located and locally triggered deep convection. The only exception is the error of cloud water in the first hour, where VISoe=0.2 shows a lower error than the BT experiment. At this early state of convection, most clouds are not high enough to influence the 6.2 μm brightness temperatures but are clearly detectable in the visible channel. The combination of both channels (BT + VISoe=0.2) leads in most cases to an even stronger error reduction than that of the BT experiment. Overall, the BT + VISoe=0.2 experiment clearly exhibits the lowest errors for all variables.
Vertical profiles of the mean first-guess error averaged over the 5-h assimilation period are shown (Fig. 6). The strongest reduction of wind and temperature errors occur in the upper troposphere between z = 6 km and 12 km. Again, the BT experiment shows a clearly more pronounced error reduction than VISoe=0.2 and BT + VISoe=0.2 shows slightly lower errors than the BT experiment.
The error of cloud water peaks around 4 km, corresponding to the melting level of ice, and all three assimilation experiments show a fairly similar reduction of these errors by about 20%. For cloud ice at upper levels, however, infrared observations are more effective in reducing the error than visible observations. Furthermore, VISoe=0.2 shows a lower reduction of humidity errors in the lowest 2 km. As neither observation type observes humidity at this height directly, this must be related to vertical correlations and changes to surface insolation by clouds.
The weaker error reduction in the VISoe=0.2 experiment, compared to the BT experiment, evident in Figs. 5 and 6 may be related to the lack of clear-sky temperature and humidity information in the visible range. Another possible explanation for this would be the ambiguity of the visible observations. BT observations are highly sensitive in clear air to the vertical profile of temperature. Visible reflectances contain no height information, so water and ice clouds can lead to the same signal. In a situation where both water and ice clouds are present it is thus possible that in the LETKF analysis weight is given to the ensemble members that have a cloud with the wrong phase at the right horizontal location. This ambiguity problem can be avoided when visible reflectances are assimilated together with the brightness temperatures as in the BT + VISoe=0.2 experiment. In this case the visible observations provide additional information about low clouds that is not present in the brightness temperature, leading to a further error reduction in BT + VISoe=0.2, compared to BT.
During the clear-sky assimilation experiment BTCA=0 the impact on hydrometeors begins to be positive for cloud ice after a few hours (Fig. 5). The overall impact during the data assimilation is neutral as can be seen in the profiles in Fig. 6, except for temperature, where the impact is positive over the height of the clear-sky weighting function. The clear-sky radiances appear to correct the phase shift of the onset of convection, but miss direct corrections of hydrometeors.
Mean errors (“biases”) in all prognostic fields are already present in the free ensemble before data assimilation: the errors arise from the unbiased initial perturbations due to nonlinearity of the prognostic equations. To investigate if the assimilation leads to undesirable systematic effects, the evolution of the mean errors for wind, temperature and hydrometeors in the first guess during the 5 h of data assimilation and in the corresponding free forecast are compared in Fig. 7. In all experiments, the mean error decreases or stays within the range of the error from the beginning of the data assimilation period—or within the range of the mean error of the free ensemble. For wind, temperature, cloud-ice, and water vapor, the mean error decreases when BT or BT + VISoe=0.2 are assimilated. The rapid decrease in the mean error of cloud water in the free ensemble is not reproduced sustainably in the conducted data-assimilation experiments. Assimilating clear-sky brightness temperature in BTCA=0, the mean error is overall reduced.
A slight degradation of the order of magnitude of the mean error occurs in the cloud-ice, when only VIS is assimilated. However, it needs to be kept in mind that the assimilation experiments are very short. Thus, it is promising that Fig. 7 overall indicates no significant increase of mean errors, but longer assimilation experiments over various scenarios would be required to investigate systematic effects in more detail.
b. Forecast impact
The forecast error for cloud variables, temperature T, and meridional wind V is shown in Fig. 8. Overall, the forecast error reduction is fairly consistent with the error reduction during the data assimilation period. The all-sky assimilation experiments show lower forecast errors than the free forecast for all variables. This error reduction lasts throughout the whole forecast range of 7 h with the exception of temperature errors in the VISoe=0.2 experiment that become similar to the free forecast after 5.5 h. The BT experiments shows roughly twice the error reduction of VISoe=0.2 and BT + VISoe=0.2 shows even slightly lower errors than BT. The advantage of the combined assimilation of both channels is particularly apparent for humidity, temperature and wind. For hydrometeor errors, in contrast, the differences between BT and BT + VISoe=0.2 are fairly small. The clear-sky assimilation experiment BTCA=0 has a positive or neutral impact for all variables, except for temperature and horizontal wind after 1–2 h. There, a negative impact occurs due to the forecast at 2100 UTC. In contrast, the forecast impact on temperature and horizontal wind remains positive at 2300 and 0100 UTC (section 4b), when the temperature bias is smaller at the starting time of the forecast (Fig. 7).
As further metric, we employ the fractional skill score for precipitation forecasts following the evaluation of Bachmann et al. (2019) for idealized radar data assimilation OSSEs. The fractional skill score allows to derive a believable scale (sometimes referred to as skillful scale) for a precipitation forecast. The results shown in (Fig. 9) are derived for a radar reflectivity threshold of 20.0 dBZ. The believable scale indicates a nonrandom overlap of precipitation fields (Mittermaier and Roberts 2010) in the forecast and nature. In all our satellite data assimilation experiments, a clear reduction of the believable scale indicates improved precipitation forecasts. The believable scale increases from 100 to 200 km in the free runs over ≤7 h until the rain decays (Fig. 9). The increase is due to a more and more scattered and random precipitation field. Similar to the evaluation for other forecast variables, we differentiate a clear order between the experiments from best to worst precipitation forecast as follows: Assimilating the visible channel increases the forecast skill (i.e., reduces the believable scale compared to the free background forecast at all times). The assimilation of the infrared channel leads to even better results and again, assimilating both channels is best and reduces the believable scale during the first forecasting hour to 1/4, while resulting forecasts of the clear sky assimilation have a neutral or slightly negative impact. Assimilating the combination leads to the smallest believable scale in the forecast at the order of 10 km. This scale is close to the superobservation scale and effective model resolution.
These results are not directly comparable to the experiments for radar data assimilation by Bachmann et al. (2020) given small differences in the setup. Nevertheless, the results overall indicated that the potential impact of satellite observation is of a similar magnitude as the impact of radar observations.
4. Sensitivity experiments
In this section, we discuss the sensitivity of the data assimilation experiments to modified settings of the assigned observation error and cycling frequency.
a. Sensitivity to assigned observation error
Table 2 and Fig. 10 show the effect of increasing the assigned observation error by 50% on the forecast error of different variables averaged over lead times of 1–8 h. The improvement of the mean absolute error as depicted before is calculated relative to the free background ensemble for cloud water ΔQC/ΔQCfree, water vapor ΔQV/ΔQVfree, cloud ice ΔQI/ΔQIfree, horizontal wind ΔV/ΔVfree, and temperature ΔT/ΔTfree. The increased observation error leads to a lower beneficial impact for all three experiments, the experiment with observations in the visible spectrum, the experiment with infrared observations and the experiment that uses both observation types. For experiments with infrared observations and the one with both observation types, however, the difference of the experiments with increased visible observation errors to the reference experiments is fairly small. Only the experiment with visible observations shows a strong difference (overall improvement of 13% with increased error instead of 18% improvement in the reference experiment).
Overview of relative improvement in percent with respect to the free background forecasts for cloud water QC, water vapor QV, cloud ice QI, meridional wind V, temperature T, and believable scale ZBS of column maximum radar reflectivity. The relative improvements are averaged for each experiment over the whole forecast range of 8 h taking into account three different forecasts starting at 2100, 2300, and 0100 UTC.
Experiments with decreased assigned observation errors either led to numerical instabilities, forecast deterioration or a very small beneficial impact (not shown). This indicates that the assigned observation error of the reference experiments is a suitable choice for the assimilation. In this context, it should also be noted that the assigned errors are strongly inflated compared to the errors used for simulating the observations. Visible observations were simulated with a random error of only 3%. Due to superobbing of 36 pixels, the actual error is reduced further by a factor of 36 for the assimilated superobservations. This discrepancy of actual and assigned errors by more than a factor of 10 is interesting given the absence of correlated observation errors and of representation and operator errors when using a model simulation as truth in an OSSE. We therefore speculate that the strong inflation of errors is necessary to compensate for displacement errors and other nonlinear effects as well as for deficiencies of the data assimilation scheme. For infrared observations, the comparison of actual and assigned errors is a bit more complicated due to the use of the dynamic error model. Nevertheless, the assigned observation error of infrared observations is also strongly inflated compared to their actual observation error.
b. Sensitivity to cycling frequency and all-sky versus clear-sky brightness temperature assimilation
The cycling period was varied between 15, 30, and 60 min for the experiment assimilating the combination of infrared and visible observations with an assigned observation error of oe = 0.2.
All experiments with lower cycling frequency are typically evaluated hourly (referred to as “sampled hourly” in the experiment name). To study the effect of the evaluation frequency on the results, assimilation experiments with higher-frequency cycling are also evaluated hourly and half-hourly. However, the error of evaluating less frequently appears to be insignificant (Fig. 11).
The comparison of the experiments with a cycling period of 1/4, 1/2, and 1 h (Table 3) reveals a larger forecast improvement for higher cycling frequencies. It is therefore beneficial to assimilate the observations with higher temporal resolution. However, the differences between the experiments are rather small despite the fact that the 1-h cycling period also decreases the amount of assimilated observations by a factor of 4 compared to the experiment with a ¼-h cycling period. Using a 1-h cycling period may therefore be a reasonable choice if the number of assimilated observation should not be too large or if other reasons restrict the cycling period.
Overview of relative improvement as in Table 2, but only evaluating forecasts starting at 0100 UTC.
Assimilating only clear-sky brightness temperature observations with or without localization leads to a clear decrease in forecast skill for all variables compared to assimilating all-sky brightness temperature (Fig. 12). In comparison to assimilating without localization, adding localization in the clear-sky experiment
5. Conclusions
This paper investigates the potential impact of cloud-affected satellite observations in the visible and infrared spectrum in idealized convective-scale observing system simulation experiments (OSSEs) with a local ensemble transform Kalman filter (LETKF) for data assimilation. We investigate a particularly challenging case with locally triggered and randomly located summertime deep convection in central Europe.
Observations from the visible and infrared channel provide very complementary information on atmospheric clouds with a higher sensitivity of the infrared channels to ice clouds and of the visible to water clouds. Furthermore, infrared channels provide information on cloud top heights whereas visible channels allow us to distinguish low clouds from the surface. Despite these advantages, a combination of infrared and visible channels has not been used for data assimilation, yet.
The OSSEs demonstrate a strongly beneficial impact of satellite data assimilation on various forecast quantities for the whole forecast range of 8-h lead time. The mean relative forecast improvement ranges up to nearly 30% for model state variables. Precipitation forecast show even more drastic improvements. The fraction skill score (FSS) believable (or skillful) scale increases by up to a factor of 4 and means that 7-h forecasts with satellite data assimilation are better than 1-h forecasts without.
While the results are not directly comparable to the OSSE results of Bachmann et al. (2019) and Bachmann et al. (2020) for radar data assimilation due to some differences of the setup, they indicate a comparable magnitude of the potential impact of cloud-affected satellite observations to radar observations. Both visible and infrared observations individually lead to a forecast improvement, which is higher for infrared observations in this convective situation. Best forecast results, however, are achieved through the combined assimilation of both visible and infrared observations. We assume that this is related to the reduction of ambiguities in the observations through the combination of both types.
It should be noted that the relative effectiveness of assimilating visible or water vapor channels can be expected to depend strongly on the weather situation. For instance, when only boundary layer clouds are present, the visible channel does not suffer from a potential confusion between water and ice clouds and the water vapor channel does not contain cloud information. Therefore, we would expect a much stronger impact from the visible channel in such a case. However, the current impact on forecasts after 2200 UTC does not take into account the diurnal cycle of the sun on visible observations.
Sensitivity experiments with different assigned observation errors indicate that a constant error of 0.2 for visible reflectance and of 1.1 K plus an error inflation dependent on cloud impact based on Harnisch et al. (2016) for infrared observations is an appropriate choice. This is an interesting result given that the observations were simulated using an error of only 3% for visible reflectance and 3 K for infrared brightness temperature observations. As the assimilated observations are superobservations consisting of 6 × 6 pixels, their actual error is only 1/6 of the one used for assimilating the observations. Consequently, this means that the appropriate assigned error needs to be highly inflated for the assimilation despite of the absence of correlated observation errors, representation errors, and operator errors. We assume that this strong error inflation is necessary to compensate for displacement errors and other nonlinear effects as well as for deficiencies of the data assimilation scheme.
Furthermore, we conducted sensitivity experiments using cycling periods of 15, 30, and 60 min. These show that it is most beneficial to assimilate the observations every 15 min. However, a beneficial impact is also achieved using 30- or 60-min cycling periods and given that those experiments only assimilate half or a quarter of the observations, the forecast improvement is also remarkable. Consequently, it may as well be a suitable choice to use a cycling period of 1 h for these conditions in case of need for a reduced data amount or other operational constraints.
In summary, we show than an LETKF assimilation scheme is capable of using the information provided by cloud-affected satellite observations. Their assimilation strongly improves the forecast of various quantities including precipitation. While the total impact of such observations achieved in this idealized OSSE can likely not be achieved in a real NWP system, the study provides important insights on the relative impact of observations. Best forecast results are achieved when assimilating both visible and infrared observations and overall, the impact is of comparable magnitude as the impact of radar observations. This strongly emphasizes the potential benefit of such observations for convective-scale NWP—especially in regions on the globe where a dense network of conventional observations or other remote sensing measurements are unavailable.
Acknowledgments
This study was carried out in the Hans-Ertel Centre for Weather Research (Weissmann et al. 2014; Simmer et al. 2016), which is a German research network of universities, research institutes, and Deutscher Wetterdienst funded by the BMVI (Federal Ministry of Transport and Digital Infrastructure). We thank three anonymous referees for constructive suggestions on the manuscript. Furthermore, we acknowledge H. Lange and K. Bachmann for providing an earlier version of the experimental setup and R. Faulwetter for support with RTTOV.
REFERENCES
Bachmann, K., C. Keil, and M. Weissmann, 2019: Impact of radar data assimilation and orography on predictability of deep convection. Quart. J. Roy. Meteor. Soc., 145, 117–130, https://doi.org/10.1002/qj.3412.
Bachmann, K., C. Keil, G. C. Craig, M. Weissmann, and C. A. Welzbacher, 2020: Predictability of deep convection in idealized and operational forecasts: Effects of radar data assimilation, orography, and synoptic weather regime. Mon. Wea. Rev., 148, 63–81, https://doi.org/10.1175/MWR-D-19-0045.1.
Bauer, P., A. J. Geer, P. Lopez, and D. Salmond, 2010: Direct 4D-Var assimilation of all-sky radiances. Part I: Implementation. Quart. J. Roy. Meteor. Soc., 136, 1868–1885, https://doi.org/10.1002/qj.659.
Cintineo, R. M., J. A. Otkin, T. A. Jones, S. Koch, and D. J. Stensrud, 2016: Assimilation of synthetic GOES-R ABI infrared brightness temperatures and WSR-88D radar observations in a high-resolution OSSE. Mon. Wea. Rev., 144, 3159–3180, https://doi.org/10.1175/MWR-D-15-0366.1.
Craig, G. C., and M. Würsch, 2013: The impact of localization and observation averaging for convective-scale data assimilation in a simple stochastic model. Quart. J. Roy. Meteor. Soc., 139, 515–523, https://doi.org/10.1002/qj.1980.
Done, J., C. A. Davis, and M. Weisman, 2004: The next generation of NWP: Explicit forecasts of convection using the Weather Research and Forecasting (WRF) model. Atmos. Sci. Lett., 5, 110–117, https://doi.org/10.1002/asl.72.
Geer, A. J., 2019: Correlated observation error models for assimilating all-sky infrared radiances. Atmos. Meas. Tech., 12, 3629–3657, https://doi.org/10.5194/amt-12-3629-2019.
Geer, A. J., P. Bauer, and P. Lopez, 2010: Direct 4D-Var assimilation of all-sky radiances. Part II: Assessment. Quart. J. Roy. Meteor. Soc., 136, 1886–1905, https://doi.org/10.1002/qj.681.
Geer, A. J., and Coauthors, 2017: The growing impact of satellite observations sensitive to humidity, cloud and precipitation. Quart. J. Roy. Meteor. Soc., 143, 3189–3206, https://doi.org/10.1002/qj.3172.
Geer, A. J., and Coauthors, 2018: All-sky satellite data assimilation at operational weather forecasting centres. Quart. J. Roy. Meteor. Soc., 144, 1191–1217, https://doi.org/10.1002/qj.3202.
Gustafsson, N., and Coauthors, 2018: Survey of data assimilation methods for convective-scale numerical weather prediction at operational centres. Quart. J. Roy. Meteor. Soc., 144, 1218–1256, https://doi.org/10.1002/qj.3179.
Harnisch, F., M. Weissmann, and Á. Periáñez, 2016: Error model for the assimilation of cloud-affected infrared satellite observations in an ensemble data assimilation system. Quart. J. Roy. Meteor. Soc., 142, 1797–1808, https://doi.org/10.1002/qj.2776.
Heinze, R., and Coauthors, 2017: Large-eddy simulations over Germany using ICON: A comprehensive evaluation. Quart. J. Roy. Meteor. Soc., 143, 69–100, https://doi.org/10.1002/qj.2947.
Honda, T., and Coauthors, 2018: Assimilating all-sky Himawari-8 satellite infrared radiances: A case of Typhoon Soudelor (2015). Mon. Wea. Rev., 146, 213–229, https://doi.org/10.1175/MWR-D-16-0357.1.
Houtekamer, P., and F. Zhang, 2016: Review of the ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 144, 4489–4532, https://doi.org/10.1175/MWR-D-15-0440.1.
Hunt, B. R., E. J. Kostelich, and I. Szunyogh, 2007: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter. Physica D, 230, 112–126, https://doi.org/10.1016/j.physd.2006.11.008.
Hutt, A., and Coauthors, 2020: Assimilation of SEVIRI water vapour channels with an ensemble Kalman filter on the convective scale. Front. Earth Sci., 8, 70, https://doi.org/10.3389/feart.2020.00070.
Janjić, T., and Coauthors, 2017: On the representation error in data assimilation. Quart. J. Roy. Meteor. Soc., 144, 1257–1278, https://doi.org/10.1002/qj.3130.
Lange, H., and G. C. Craig, 2014: The impact of data assimilation length scales on analysis and prediction of convective storms. Mon. Wea. Rev., 142, 3781–3808, https://doi.org/10.1175/MWR-D-13-00304.1.
Lange, H., G. C. Craig, and T. Janjić, 2017: Characterizing noise and spurious convection in convective data assimilation. Quart. J. Roy. Meteor. Soc., 143, 3060–3069, https://doi.org/10.1002/qj.3162.
Lin, Y.-L., R. D. Farley, and H. D. Orville, 1983: Bulk parameterization of the snow field in a cloud model. J. Climate Appl. Meteor., 22, 1065–1092, https://doi.org/10.1175/1520-0450(1983)022<1065:BPOTSF>2.0.CO;2.
Matricardi, M., and R. Saunders, 1999: Fast radiative transfer model for simulation of infrared atmospheric sounding interferometer radiances. Appl. Opt., 38, 5679–5691, https://doi.org/10.1364/AO.38.005679.
McNally, A., 2002: A note on the occurrence of cloud in meteorologically sensitive areas and the implications for advanced infrared sounders. Quart. J. Roy. Meteor. Soc., 128, 2551–2556, https://doi.org/10.1256/qj.01.206.
Minamide, M., and F. Zhang, 2017: Adaptive observation error inflation for assimilating all-sky satellite radiance. Mon. Wea. Rev., 145, 1063–1081, https://doi.org/10.1175/MWR-D-16-0257.1.
Mittermaier, M., and N. Roberts, 2010: Intercomparison of spatial forecast verification methods: Identifying skillful spatial scales using the fractions skill score. Wea. Forecasting, 25, 343–354, https://doi.org/10.1175/2009WAF2222260.1.
Necker, T., M. Weissmann, and S. Matthias, 2018: The importance of appropriate verification metrics for the assessment of observation impact in a convection-permitting modelling system. Quart. J. Roy. Meteor. Soc., 144, 1667–1680, https://doi.org/10.1002/qj.3390.
Nolan, D. S., R. Atlas, K. T. Bhatia, and L. R. Bucci, 2013: Development and validation of a hurricane nature run using the joint OSSE nature run and the WRF model. J. Adv. Model. Earth Syst., 5, 382–405, https://doi.org/10.1002/jame.20031.
Okamoto, K., A. McNally, and W. Bell, 2014: Progress towards the assimilation of all-sky infrared radiances: An evaluation of cloud effects. Quart. J. Roy. Meteor. Soc., 140, 1603–1614, https://doi.org/10.1002/qj.2242.
Otkin, J. A., W. E. Lewis, A. J. Lenzen, B. D. McNoldy, and S. J. Majumdar, 2017: Assessing the accuracy of the cloud and water vapor fields in the Hurricane WRF (HWRF) Model using satellite infrared brightness temperatures. Mon. Wea. Rev., 145, 2027–2046, https://doi.org/10.1175/MWR-D-16-0354.1.
Otkin, J. A., R. Potthast, and A. S. Lawless, 2018: Nonlinear bias correction for satellite data assimilation using Taylor series polynomials. Mon. Wea. Rev., 146, 263–285, https://doi.org/10.1175/MWR-D-17-0171.1.
Saunders, R., M. Matricardi, and P. Brunel, 1999: An improved fast radiative transfer model for assimilation of satellite radiance observations. Quart. J. Roy. Meteor. Soc., 125, 1407–1425, https://doi.org/10.1002/qj.1999.49712555615.
Sawada, Y., K. Okamoto, M. Kunii, and T. Miyoshi, 2019: Assimilating every-10-minute Himawari-8 infrared radiances to improve convective predictability. J. Geophys. Res. Atmos., 124, 2546–2561, https://doi.org/10.1029/2018JD029643.
Scheck, L., P. Frèrebeau, R. Buras-Schnell, and B. Mayer, 2016: A fast radiative transfer method for the simulation of visible satellite imagery. J. Quant. Spectrosc. Radiat. Transfer, 175, 54–67, https://doi.org/10.1016/j.jqsrt.2016.02.008.
Scheck, L., M. Weissmann, and B. Mayer, 2018: Efficient methods to account for cloud-top inclination and cloud overlap in synthetic visible satellite images. J. Atmos. Oceanic Technol., 35, 665–685, https://doi.org/10.1175/JTECH-D-17-0057.1.
Scheck, L., M. Weissmann, and L. Bach, 2020: Assimilating visible satellite images for convective-scale numerical weather prediction: A case-study. Quart. J. Roy. Meteor. Soc., https://doi.org/10.1002/qj.3840, in press.
Schomburg, A., C. Schraff, and R. Potthast, 2015: A concept for the assimilation of satellite cloud information in an ensemble Kalman filter: Single-observation experiments. Quart. J. Roy. Meteor. Soc., 141, 893–908, https://doi.org/10.1002/qj.2407.
Schraff, C., H. Reich, A. Rhodin, A. Schomburg, K. Stephan, A. Periáñez, and R. Potthast, 2016: Kilometre-scale ensemble data assimilation for the COSMO model (KENDA). Quart. J. Roy. Meteor. Soc., 142, 1453–1472, https://doi.org/10.1002/qj.2748.
Seifert, A., and K. D. Beheng, 2001: A double-moment parameterization for simulating autoconversion, accretion and self-collection. Atmos. Res., 59–60, 265–281, https://doi.org/10.1016/S0169-8095(01)00126-0.
Simmer, C., and Coauthors, 2016: HErZ: The German Hans-Ertel Centre for Weather Research. Bull. Amer. Meteor. Soc., 97, 1057–1068, https://doi.org/10.1175/BAMS-D-13-00227.1.
Sommer, M., and M. Weissmann, 2014: Observation impact in a convective-scale localized ensemble transform Kalman filter. Quart. J. Roy. Meteor. Soc., 140, 2672–2679, https://doi.org/10.1002/qj.2343.
Sommer, M., and M. Weissmann, 2016: Ensemble-based approximation of observation impact using an observation-based verification metric. Tellus, 68A, 27885, https://doi.org/10.3402/tellusa.v68.27885.
Waller, J. A., S. P. Ballard, S. L. Dance, G. Kelly, N. K. Nichols, and D. Simonin, 2016: Diagnosing horizontal and inter-channel observation error correlations for SEVIRI observations using observation-minus-background and observation-minus-analysis statistics. Remote Sens., 8, 581, https://doi.org/10.3390/rs8070581.
Weissmann, M., and Coauthors, 2014: Initial phase of the Hans-Ertel Centre for Weather Research—A virtual centre at the interface of basic and applied weather and climate research. Meteor. Z., 23, 193–208, https://doi.org/10.1127/0941-2948/2014/0558.
Zeng, Y., T. Janjić, M. Sommer, A. de Lozar, U. Blahak, and A. Seifert, 2019: Representation of model error in convective-scale data assimilation: Additive noise based on model truncation error. J. Adv. Model. Earth Syst., 11, 752–770, https://doi.org/10.1029/2018MS001546.
Zhang, F., M. Minamide, and E. E. Clothiaux, 2016: Potential impacts of assimilating all-sky infrared satellite radiances from GOES-R on convection-permitting analysis and prediction of tropical cyclones. Geophys. Res. Lett., 43, 2954–2963, https://doi.org/10.1002/2016GL068468.
Zhang, Y., F. Zhang, and D. J. Stensrud, 2018: Assimilating all-sky infrared radiances from GOES-16 ABI using an ensemble Kalman filter for convection-allowing severe thunderstorms prediction. Mon. Wea. Rev., 146, 3363–3381, https://doi.org/10.1175/MWR-D-18-0062.1.
Zhang, Y., D. J. Stensrud, and F. Zhang, 2019: Simultaneous assimilation of radar and all-sky satellite infrared radiance observations for convection-allowing ensemble analysis and prediction of severe thunderstorms. Mon. Wea. Rev., 147, 4389–4409, https://doi.org/10.1175/MWR-D-19-0163.1.