1. Introduction
For more than two decades, operational numerical weather prediction (NWP) has benefited from aircraft observations. Typically transmitted by the Aircraft Meteorological Data Relay (AMDAR; WMO 2003), the aircraft observations provide the data assimilation (DA) systems with in situ measurements of the important dynamical variables of temperature and wind (Daley 1991). AMDAR data contain vertical profiles near airports and upper-air observations at flight level with cruising altitudes around 10 km above mean sea level (MSL), corresponding to a layer between 200 and 300 hPa.
A new aircraft data source has been introduced in de Haan (2011). It uses airport radars in the surveillance Mode-S to collect traffic control reports of commercial aircrafts from which observations of wind and temperature can be derived. de Haan (2011) has described this dataset of Mode-S Enhanced Surveillance (Mode-S EHS)1 and has found a quality comparable to AMDAR by comparing collocated measurements from the same aircrafts. de Haan and Stoffelen (2012) have assimilated Mode-S EHS observations from Schiphol Airport into the High Resolution Limited Area Model (HIRLAM) using the three-dimensional variational data assimilation (3DVar) algorithm. In the study, HIRLAM is run with a resolution of 10 km and Mode-S observations are assimilated in 3-hourly and 1-hourly intervals. The assimilation of Mode-S data has shown a reduction in wind forecast errors by approximately 5% (de Haan and Stoffelen 2012). Strajnar et al. (2015) also found benefits when assimilating Mode-S observations from a different data source in a limited-area model over Slovenia.
The present study aims to assimilate the Mode-S EHS data with the Kilometre-scale Ensemble Data Assimilation (KENDA) system (Schraff et al. 2016, hereafter SCH), which is being developed at Deutscher Wetterdienst (DWD). KENDA couples a local ensemble transform Kalman filter (LETKF; as in Bishop et al. 2001; Hunt et al. 2007) with a 40-member ensemble of the Consortium for Small-Scale Modeling (COSMO; Baldauf et al. 2011) model in the domain over Germany (COSMO-DE). COSMO-DE is a nonhydrostatic, convection-permitting model that runs operationally with a horizontal resolution of 2.8 km and 50 vertical levels. COSMO-KENDA provides a framework for convective-scale ensemble data assimilation of different observation types and aims to replace the previously used nudging scheme for observed model variables and the latent heat nudging scheme (Stephan et al. 2008).
The present study aims at using the Mode-S EHS aircraft data to improve in particular the estimates of temperature and wind, in order to provide better background forecasts for the assimilation of radar data (Bick et al. 2016). Past studies have assimilated observations from Doppler radars with an ensemble Kalman filter (EnKF) in order to forecast convective systems (e.g., Stensrud et al. 2009). Aksoy et al. (2010) and Stensrud and Gao (2010) stress the important dependence of convective forecasts on correct environmental profiles of wind and temperature, which are usually provided by radiosondes and aircraft observations. In the present study, NWP experiments with and without Mode-S EHS are performed (i.e., by supplementing the previously used AMDAR data or by replacing it). For verification purposes, radiosondes are not assimilated and used as fully independent observations.
Since the large amount of additional aircraft observations is expected to reduce the ensemble spread, it is tested how robust are the alleviating mechanisms of background covariance inflation (Zhang et al. 2004; Li et al. 2009) and adaptive covariance localization (Perianez et al. 2014). Further, estimates of the observation error are made following Desroziers et al. (2005). Thinning experiments are performed that gradually increase the amount of Mode-S EHS data to see whether the assimilation system reaches a point of saturation where no more additional benefit is taken from the observations. Forecasts with lead times up to 3 hours are computed to see how the error reduction of the Mode-S EHS data persists.
Since any error reduction is related to a change of the model state, a quantification of those model state modifications is of interest in this study, particularly with respect to the assimilated data amount. Using OSSEs of a regional EnKF system that assimilate datasets comparable to the present study, Zhang et al. (2006) and Meng and Zhang (2007) have investigated how the difference total energy grows for selected variables with and without data assimilation. They found that for vertical velocity and cloud variables, the growth of difference energy is mainly in the small scales, while for wind and temperature, the growth in difference is dominated by the larger scales. This was done using a localization radius of 900 km. In the present study, adaptive localization length scales of order 100 km are applied. The true state is not known, so a control experiment without data assimilation will be used as the reference state. It will be evaluated which scales of the horizontal kinetic energy are affected by the data assimilation experiments and how quickly the different scales will relax toward the control experiment during the 3-h forecasts.
Section 2 describes the conventional observations in COSMO-KENDA and the properties of the Mode-S EHS aircraft observations. Section 3 briefly introduces the forecast model COSMO-DE, describes how the LETKF and the adaptive algorithms of the DA system are set up, and how the observation errors are estimated. Section 4 describes the experimental period and the different configurations for the assimilation experiments. In section 5, the DA results during the continuous cycling and 3-h forecasts are evaluated. Section 6 discusses the observation error estimates and how the adaptive KENDA settings act when the Mode-S EHS data density is varied. Section 7 discusses the impact of Mode-S EHS data on the kinetic energy spectrum of the forecasts. Section 8 summarizes the results and discusses their implications on forecasts with COSMO-KENDA.
2. Observations
The conventional observations that are currently assimilated in the COSMO-KENDA system consist of surface pressure and 10-m wind observations from surface synoptic stations (SYNOP); upper-air observations of wind, temperature, and humidity from radiosondes (TEMP) and aircrafts; and wind profiler data (PROF). Figure 1 illustrates the amount and spatial distribution of the conventional dataset that is used in the experimental period from 7 to 12 May 2014. Most of the 30 radiosondes provide vertical soundings of wind, temperature, and relative humidity only at 0000 and 1200 UTC, some also at 0600 and 1800 UTC. The six wind profilers continuously sample with intervals between 5 and 30 min. Hourly assimilated surface data from SYNOP stations are located only in such land areas with a surface height below 100 m MSL and on the sea surface, due to a rigorous quality control (SCH). The amount of aircraft measurements of wind and temperature collected in the AMDAR format are illustrated in Fig. 2. While the bulk number of single observations in AMDAR is similar to the profiler category, the horizontal distribution is broader.

Domain extent of COSMO-DE with conventional observations. The circles indicate positions of the surface-based stations. The areas of the circles correspond to the average daily number of single observations of the wind variable per station. The average number of observations per day are 11 851 PROF, 5813 SYNOP, and 1571 TEMP.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

Domain extent of COSMO-DE with conventional observations. The circles indicate positions of the surface-based stations. The areas of the circles correspond to the average daily number of single observations of the wind variable per station. The average number of observations per day are 11 851 PROF, 5813 SYNOP, and 1571 TEMP.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
Domain extent of COSMO-DE with conventional observations. The circles indicate positions of the surface-based stations. The areas of the circles correspond to the average daily number of single observations of the wind variable per station. The average number of observations per day are 11 851 PROF, 5813 SYNOP, and 1571 TEMP.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

(a),(b) The horizontal density of assimilated aircraft observations of AMDAR and the full Mode-S EHS set per average day. The color scale in (b) is enhanced by a factor of 10 with respect to (a). (c),(d) The vertical density against longitude. Differences in the low-level distributions are due to highly frequented airports and are overly exaggerated by their color scales. (e),(f) The overall vertical density.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

(a),(b) The horizontal density of assimilated aircraft observations of AMDAR and the full Mode-S EHS set per average day. The color scale in (b) is enhanced by a factor of 10 with respect to (a). (c),(d) The vertical density against longitude. Differences in the low-level distributions are due to highly frequented airports and are overly exaggerated by their color scales. (e),(f) The overall vertical density.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
(a),(b) The horizontal density of assimilated aircraft observations of AMDAR and the full Mode-S EHS set per average day. The color scale in (b) is enhanced by a factor of 10 with respect to (a). (c),(d) The vertical density against longitude. Differences in the low-level distributions are due to highly frequented airports and are overly exaggerated by their color scales. (e),(f) The overall vertical density.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
de Haan (2011) first presented Mode-S EHS aircraft data as a meteorological observation source. In contrast to the actively submitted AMDAR reports from specially equipped planes, flight control messages of Mode-S EHS are collected by airport radars from all commercial aircrafts within a radius of 270 km every 4–20 s (depending on the purpose of the scanning radars) in the region of Mode-S EHS over Europe and are distributed in a postprocessed quality by the Royal Netherlands Meteorological Institute (KNMI).2 Therefore, this experimental dataset is limited to the range of the collecting airport radars (Fig. 2b). The horizontal extent in the COSMO-DE domain is, therefore, slightly smaller than for AMDAR, but the number of observations is roughly 15 times larger (Figs. 2e,f). The single Mode-S EHS report messages contain information on latitude/longitude, flight level, ground speed, airspeed, track angle, heading angle, and Mach number. As with AMDAR, the horizontal wind observations are derived from the vectors of airspeed with heading angle and ground speed with track angle. The reported Mach number has been computed by the board computer of the aircraft from the in situ temperature and airspeed. Reverting this calculation using the ideal gas law, the observed temperature is regained and bias corrected [see de Haan (2011) and de Haan and Stoffelen (2012) for details], whereas AMDAR reports contain the direct temperature measurement from the airplane thermometer. Relative humidity is not contained in the Mode-S EHS reports. The number of AMDAR reports that contain relative humidity is negligible in the present dataset.
de Haan (2011) further describes the postprocessing that is applied to the Mode-S EHS data (e.g., exclusion of observations with a large roll angle, magnetic heading offset corrections, and bias corrections for different aircraft types). In collocated comparisons with AMDAR data of the same airplane de Haan (2011) finds observation error standard deviations of comparable magnitude for wind and a slightly larger magnitude for the temperature in case of Mode-S EHS.
Along the flight tracks of single planes, the raw Mode-S EHS observations have been averaged in order to meet the criteria of AMDAR (WMO 2003; de Haan and Stoffelen 2012). During the ascending flight phase, the first nine observations are vertically 10 hPa apart and after that they are 50 hPa apart. On the flight level, consecutive observations are 60 s apart, resulting in a distance of approximately 15 km for a typical flight speed of 250 m s−1. In the descending flight phase, observations with p
3. Data assimilation with COSMO-KENDA
COSMO-DE (Baldauf et al. 2011) is a nonhydrostatic model, which is run operationally at DWD with a model domain of 461 by 421 grid points horizontally, covering Germany and parts of neighboring countries (Fig. 1). It has a 2.8-km horizontal grid resolution and 50 vertical layers. The data assimilation framework of KENDA has been developed at the DWD for operational use (SCH). It is an ensemble-based data assimilation system that uses the LETKF algorithm (Hunt et al. 2007). This section describes the settings of the KENDA system for the assimilation experiments with COSMO-DE of this study.
a. Local ensemble transform Kalman filter
COSMO-KENDA uses a 40-member ensemble to sample the background error covariance, in which each member i with state
The LETKF calculations are done on a coarse analysis grid and the analysis weights are interpolated onto the model grid before the ensemble forecasts are started [see Yang et al. (2009) for details]. The coarse analysis grid is horizontally reduced by a factor of 3 with respect to the COSMO-DE model, resulting in a spacing of roughly 8 km (COSMO-DE: 2.8 km), and it has 30 vertical levels (COSMO-DE: 50 levels).
The boundary conditions (BCs) are provided by an LETKF-ensemble of the Icosahedral Nonhydrostatic (ICON) general circulation model (Zängl et al. 2015). This global LETKF system uses a 3-hourly cycle in which observations from surface stations, radiosondes, aircrafts, and satellites are assimilated (Fernandez et al. 2015, manuscript submitted to Mon. Wea. Rev.; SCH), using a localization radius of 1000 km. The ICON forecasts between the analyses of 0000, 0300, 0600,
b. Observation error statistics
The computation of analyses in the LETKF depends on a proper specification of the observation error statistics. Following Desroziers et al. (2005) and Li et al. (2009), the observation error covariance
The estimates obtained for Mode-S EHS should indicate the quality of the dataset compared to AMDAR. It will be tested if the estimated observation error standard deviations
c. Methods of accounting for model and sampling error
The background error covariance derived from the ensemble does not adequately represent the uncertainty of the background field due to sampling and model error. In KENDA, the methods of background covariance inflation, adaptive covariance localization, relaxation-to-prior-perturbation (RTPP), and random surface perturbations are implemented. These methods are briefly introduced here and their effects are presented in section 6.
The RTPP scheme of Zhang et al. (2004) relaxes the analysis ensemble perturbations of the LETKF toward the background ensemble perturbations at every grid point of the model. In KENDA, the relaxation is performed with a factor of
Following Li et al. (2009), an adaptive multiplicative covariance inflation with factor ρ is applied separately for every coarse analysis grid point (SCH) and relaxed in time by mixing the current ρ estimate with the estimate of the previous cycle. The variable ρ is larger than 1 where the background ensemble spread in observation space
In the present KENDA setup based on SCH, the horizontal localization is adaptive to the number of observations in the vicinity of an analysis grid point (Perianez et al. 2014) so that the spatial influence is distributed differently between corresponding scales (Janjić et al. 2011, 2012). The horizontal localization length scale
As described by SCH, the sea surface temperature (SST) and the soil moisture are randomly perturbed in every analysis by adding temporally and spatially correlated perturbation fields in order to enhance the spread near the model surface and in the boundary layer.
4. Experiments with varying aircraft datasets
The experiments of this study were performed from 7 to 12 May 2014. The meteorological situation was a west-wind period with passing cyclones. A warm front passage on 8 May caused stratiform precipitation and a cold front passage on 10 May caused predominantly convective precipitation with embedded thunderstorms and showers. The period was chosen because synoptically and locally forced convection was present and a convection-permitting model such as COSMO-DE is expected to produce more realistic weather systems than its driving global model.
The initial COSMO-DE ensemble, consisting of the downscaled global ICON-LETKF ensemble, is started at 0000 UTC 6 May. One day of cycled data assimilation is performed to spin up COSMO-DE and the time-relaxed adaptive covariance inflation. The resulting analysis ensemble and the covariance inflation field ρ at 0000 UTC 7 May are then used as initial conditions for all other experiments.
Table 1 summarizes the performed experiments for the chosen test period. The monitored observations (mon.) are not assimilated, therefore, their model equivalents are only influenced by the cross correlations calculated by the LETKF by the means of the assimilated observations (denoted by •). The control experiment NoDA is performed without data assimilation. All DA experiments assimilate the selected datasets in an hourly interval. The basic experiment Aconv assimilates conventional (SYNOP, PROF) and AMDAR observations. From Aconv, the Mconv experiment is derived by setting AMDAR to monitoring and assimilating Mode-S EHS. The experiment MAconv assimilates both AMDAR and Mode-S EHS datasets. In MAconvTh10 and MAconvTh50 the Mode-S EHS data are randomly thinned to 10% and 50% of the full density that is used in MAconv. The random thinning makes sure that the spatial and temporal distribution characteristics of the Mode-S EHS observation space are preserved, only with a lower density. The observation error standard deviation
Experiments (rows) performed with COSMO-KENDA. Observations with bullet points (•) are assimilated, and observations with “mon.” are monitored. In the case of “• x%,” only a random subset of x percent is assimilated.








The profiles of RMS and mean of
5. Results
The RMS, mean, and STD of

Mean RMS (
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

Mean RMS (
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
Mean RMS (
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

Mean (
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

Mean (
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
Mean (
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

STD of the ensemble
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

STD of the ensemble
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
STD of the ensemble
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
As a first diagnostic for the observation error, the RMS of NoDA is examined, under the assumption that the model equivalents in the upper-air observation spaces of all three systems are subject to the same forecast error characteristics. For wind speed, the observation systems TEMP, AMDAR, and Mode-S EHS behave similarly (Figs. 3a,d,g), which hints at comparable observation errors. For temperature (Figs. 3c,f,i), the NoDA RMS of Mode-S EHS in lower levels (Fig. 3i) is larger than for the other systems. For wind direction (Figs. 3b,e,h), the NoDA RMS of Mode-S EHS is much smaller. This difference in directional observation error could be a consequence of the heading correction in the postprocessing of Mode-S EHS (de Haan 2011), which is calibrated for different commercial aircraft models. According to WMO (2003), such a correction is not performed for AMDAR.
a. Results with AMDAR and Mode-S EHS observations
The main experiments Aconv, Mconv, and MAconv compare the usage of AMDAR and Mode-S EHS as the only assimilated aircraft observation types (Aconv and Mconv) and the combination of assimilating both (MAconv). In Fig. 3, the significance symbols are omitted because where the RMSs of DOB are reduced by adding additional data, the reductions are significant in all cases.
The RMS in the radiosonde space is continuously reduced with respect to NoDA for wind speed and temperature (Figs. 3a,c) and less so for wind direction (Fig. 3b) when AMDAR and additionally Mode-S EHS data are assimilated in the experiments Aconv and MAconv. Also, the STD is continuously diminished (Figs. 5a–c).
The RMS values of Mconv in AMDAR space and of Aconv in Mode-S EHS space show the influence of the datasets across the two aircraft observation spaces. The RMSs of wind speed (Figs. 3d,g) and temperature (Figs. 3f,i) are reduced across the spaces for Aconv and Mconv, while the cross-space RMSs in wind direction (Figs. 3e,h) are increased for levels below 700 hPa. This might again be a consequence of the heading correction of Mode-S EHS.
In Fig. 5, the ratio of the RMS and the STD give information about the consistency of background error and spread, assuming that the biases in DOB are small enough. The CRs of wind speed and temperature are close to 0.9 or 1 for all experiments, except close to the surface where values around 0.75 are reached.
b. Results with varying Mode-S EHS data coverage
As there are far more Mode-S EHS data than AMDAR data, it is tested how the forecasts depend on the amount of Mode-S EHS observations. In the experiments MAconvTh50 and MAconvTh10, the assimilated portion of the Mode-S EHS observations is randomly thinned to roughly 50% and 10% of the original set.
During the cycling, the wind speed RMS in the radiosondes (Fig. 6a) is significantly reduced going from 10% to 50% for all levels except 700 and 1000 hPa, while an increase from 50% to 100% does not yield benefits. For the wind direction (Fig. 6b), there is no significant RMS reduction when increasing the data amount. For temperature (Fig. 6c), the RMS is decreased going from 10% to 50% and from 10% to 100% for all levels except the surface. At 400 and 300 hPa, an improvement is also visible when going from 50% to 100% of Mode-S EHS. The wind and temperature STD in the radiosonde space is continuously reduced when adding more data (Fig. 7, AMDAR and Mode-S are analogous and not shown), but not in a linear dependence on the data amount.

As in Fig. 3, but for experiments NoDA, MAconvTh10, MAconvTh50, and MAconv. A two-colored diamond on a level means that the RMSs of the left experiment are significantly smaller than that of the right experiment.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

As in Fig. 3, but for experiments NoDA, MAconvTh10, MAconvTh50, and MAconv. A two-colored diamond on a level means that the RMSs of the left experiment are significantly smaller than that of the right experiment.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
As in Fig. 3, but for experiments NoDA, MAconvTh10, MAconvTh50, and MAconv. A two-colored diamond on a level means that the RMSs of the left experiment are significantly smaller than that of the right experiment.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

As in Fig. 5, but for experiments NoDA, MAconvTh10, MAconvTh50, and MAconv.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

As in Fig. 5, but for experiments NoDA, MAconvTh10, MAconvTh50, and MAconv.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
As in Fig. 5, but for experiments NoDA, MAconvTh10, MAconvTh50, and MAconv.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
c. Results of the 3-h ensemble forecasts
The daily analysis ensembles at 0900 and 2100 UTC were saved and ensemble forecasts of 3 hours were initialized from all experiments, so that also the radiosondes launched at 1200 and 0000 UTC could be used for the verification. The forecast RMS of

Forecast RMS of the Mode-S EHS thinning experiments and Aconv, evaluated for the last hour of the 3-h forecast windows from 0900 to 1200 UTC and 2100 to 0000 UTC. A two-colored diamond on a level means that the RMSs of the left experiment are significantly smaller than that of the right experiment. At levels where the RMS of an experiment is smaller than the RMS of NoDA, the difference is always significant and the diamonds are not plotted.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

Forecast RMS of the Mode-S EHS thinning experiments and Aconv, evaluated for the last hour of the 3-h forecast windows from 0900 to 1200 UTC and 2100 to 0000 UTC. A two-colored diamond on a level means that the RMSs of the left experiment are significantly smaller than that of the right experiment. At levels where the RMS of an experiment is smaller than the RMS of NoDA, the difference is always significant and the diamonds are not plotted.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
Forecast RMS of the Mode-S EHS thinning experiments and Aconv, evaluated for the last hour of the 3-h forecast windows from 0900 to 1200 UTC and 2100 to 0000 UTC. A two-colored diamond on a level means that the RMSs of the left experiment are significantly smaller than that of the right experiment. At levels where the RMS of an experiment is smaller than the RMS of NoDA, the difference is always significant and the diamonds are not plotted.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
For wind speed, significant reductions in forecast RMS between Aconv and MAconv take place at all levels except the surface. The clearest reduction is visible when using Mode-S EHS for the verification (Fig. 8g). The radiosonde space (Fig. 8a) is positively affected mainly in levels above 500 hPa. For AMDAR, additional Mode-S EHS data of MAconvTh10 and MAconvTh50 is beneficial at 700 hPa (Fig. 8d), which could be due to the shared observation spaces of the aircraft systems (Fig. 2). For wind direction RMS, the radiosonde space verification shows no significant improvement due to Mode-S EHS (Fig. 8b). Still, in AMDAR the wind direction forecast is improved on the flight levels (Fig. 8e), and in the Mode-S EHS space also the 700-hPa level is improved (Fig. 8h). For temperature RMS, an improvement due to additional Mode-S EHS data is visible for all three systems (Figs. 8c,f,i) from 700 to 200 hPa.
The 3-h forecast RMSs are, in some cases, improved by increasing the amount of assimilated Mode-S EHS. The wind speed RMS of MAconv is smaller than both Aconv and MAconvTh10 at 300 (Fig. 8a), 500, and 700 hPa (Fig. 8g). The 700-hPa wind direction is improved within Mode-S EHS going from MAconvTh10 to MAconv (Fig. 8h). For temperature, an improvement from MAconvTh10 to MAconv is visible from 700 to 200 hPa (Figs. 8c,f,i). An improvement from MAconvTh50 to MAconv appears only in the 300-hPa radiosonde wind speed (Fig. 8a). A deterioration of forecast RMS at 500 hPa is apparent in some cases when increasing the data amount from MAconvTh50 to MAconv (Figs. 8c,d,e).
6. Effects of adaptive KENDA settings
The settings used in KENDA affect the representations of both background and analysis error covariances. The specified values of the observation error are discussed first in section 6a. Second, the influence of the methods that account for model and sampling error in KENDA are examined in section 6b.
a. Results of the observation error estimation
The estimated error standard deviation

Estimated observation error STD
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

Estimated observation error STD
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
Estimated observation error STD
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
The values are similar among the experiments that actively assimilate AMDAR (Aconv, MAconvTh10, MAconv). A lower estimate is reached (Fig. 9a) when Mode-S EHS observations are used that reduce the estimators
For the wind speed of Mode-S EHS (Fig. 9c),
The hypothesis that a feedback
b. Accounting for model and sampling error
Figure 10a shows the adaptive covariance inflation factor. It is almost continuously larger for experiments with more observations. One maximum lies between 300 and 200 hPa where the high data density of the flight level is situated (Fig. 2). Another maximum is between 700 hPa and the surface. This is caused by a spread deficiency in the lower levels (see CR in Fig. 5). While the adaptive inflation is set to counteract this deficiency, the RTPP factor of 0.75 limits the overall reduction and inflation of spread by the analysis update. As seen in Fig. 10b, the adaptive localization directly depends on the number of observations per level. In the horizontal snapshot of Fig. 10c, highly frequented airports (Amsterdam, the Netherlands; Frankfurt and Berlin, Germany) become visible.

(a) Adaptive covariance inflation factor, averaged over the experimental period on the pressure levels of the analysis grid. (b) Adaptive localization length scale. (c) Snapshot of the localization length scale at the surface level at 1200 UTC 8 May 2014. The plotted circles are centered on every eighth point of the coarse analysis grid, so the overlap of the local LETKF solutions is denser than in this illustration.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

(a) Adaptive covariance inflation factor, averaged over the experimental period on the pressure levels of the analysis grid. (b) Adaptive localization length scale. (c) Snapshot of the localization length scale at the surface level at 1200 UTC 8 May 2014. The plotted circles are centered on every eighth point of the coarse analysis grid, so the overlap of the local LETKF solutions is denser than in this illustration.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
(a) Adaptive covariance inflation factor, averaged over the experimental period on the pressure levels of the analysis grid. (b) Adaptive localization length scale. (c) Snapshot of the localization length scale at the surface level at 1200 UTC 8 May 2014. The plotted circles are centered on every eighth point of the coarse analysis grid, so the overlap of the local LETKF solutions is denser than in this illustration.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
7. Kinetic energy spectra of 3-h forecasts
One-dimensional kinetic energy spectra are derived from the analysis and forecast ensemble members as in Bierdel et al. (2012). Because of the predominant westerly flow, isotropy is not assumed and the energy spectra are calculated separately in longitudinal and latitudinal directions on levels with a constant height MSL. Since on the flight levels there are significant amounts of AMDAR and Mode-S EHS observations, an average over three heights of 10-, 11-, and 12-km height MSL is chosen for the investigation. The wind field of the ensemble was saved every 15 min throughout the previously mentioned 3-h forecasts and the corresponding spectra were calculated. Figure 11 shows the difference kinetic energy spectrum of Aconv, MAconvTh10, MAconvTh50, and MAconv with respect to the NoDA experiment. To enhance the relative differences, the energy of the difference wind field from the NoDA experiment is scaled by the absolute kinetic energy spectrum of NoDA. The evaluation presumes that during the three forecast hours the BCs are not dominant and the main part of the dynamical evolution is happening within the COSMO-DE domain itself.

Kinetic energy of the difference wind fields from NoDA (along latitudes between 10 and 12 km MSL), scaled by absolute kinetic energy of the NoDA wind field. The upper-air spectra are shown for the experiments (a) Aconv, (b) MAconvTh10, (c) MAconvTh50, and (d) MAconv.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1

Kinetic energy of the difference wind fields from NoDA (along latitudes between 10 and 12 km MSL), scaled by absolute kinetic energy of the NoDA wind field. The upper-air spectra are shown for the experiments (a) Aconv, (b) MAconvTh10, (c) MAconvTh50, and (d) MAconv.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
Kinetic energy of the difference wind fields from NoDA (along latitudes between 10 and 12 km MSL), scaled by absolute kinetic energy of the NoDA wind field. The upper-air spectra are shown for the experiments (a) Aconv, (b) MAconvTh10, (c) MAconvTh50, and (d) MAconv.
Citation: Monthly Weather Review 144, 5; 10.1175/MWR-D-15-0112.1
Starting from the analyses (forecast minute 0), the largest relative differences are present on the scales below the effective resolution of
Throughout the three forecast hours, the relative difference energy on all scales is gradually decreasing, where a value of zero would express a wind field identical to NoDA. In all experiments, the spectrum of the relative forecast difference energy remains similar to the analysis of the respective experiment for up to 1 hour, especially on scales smaller than 200 km. After 1 hour, a drop in relative difference energy with respect to the analysis can be noted on all scales. As a consequence of pulling the states farther away from the attractor of COSMO-DE, the rate of convergence toward NoDA is higher when more data are assimilated. Although the experiments MAconvTh50 and MAconv are almost indistinguishable after 3 hours of forecast with respect to the forecast RMS (Fig. 8), the higher level of the relative spectra at 180 min in MAconv still indicates differences in the wind field. It can be concluded that the usage of 100% Mode-S data causes excessive modifications, possibly in the form of gravity wave noise (Houtekamer and Mitchell 2005), which are more extensive than necessary to actually improve the forecast.
8. Summary and discussion
To evaluate the benefit of additional aircraft in situ observations of wind and temperature that are collected by airport radars (Mode-S EHS), experiments were performed with the COSMO-KENDA system, which couples an LETKF to an ensemble of the nonhydrostatic model COSMO-DE. The Mode-S EHS observations are available within most of the domain of the COSMO-DE model over Germany. The amount of Mode-S EHS observations is 15 times larger than of the traditionally used AMDAR, with a similar observation density distribution. Cycled ensemble data assimilation was performed for a period of 5 days with a cycling interval of 1 h. Mode-S EHS data were assimilated in addition to AMDAR, assuming the same observation error. Using 100% of the Mode-S data improved the upper-air innovation RMSs during the 1-h cycling and in the verification of 3-h ensemble forecasts, in comparison to assimilating only AMDAR aircraft data. A comparable improvement was visible when assimilating 50% of Mode-S EHS instead of none. The 3-h forecasts that were started from the experiment with 100% Mode-S EHS data often had significantly lower errors than from the experiment with 10%. Still, using 100% Mode-S EHS instead of 50% degraded the 3-h forecasts in some cases. It is, therefore, concluded that a saturation of benefit exists between 50% and using 100% of Mode-S EHS.
By using innovation statistics in observation space, the observation error standard deviation of Mode-S EHS was estimated to be comparable to AMDAR in the wind variable. For temperature, the observation error of Mode-S EHS was diagnosed to be 50% larger for levels below 700 hPa. It must be noted that observation error standard deviations obtained by this method depend on the background ensemble spread of the cycling system, so the estimated observation errors can only be regarded as inherently compatible with the present DA system. Still, the current KENDA setting appeared mostly insensitive to slightly wrong prescribed observation errors.
The ensemble spread was generally consistent with the forecast errors, except near the surface due to a deficiency of small-scale error growth (SCH). KENDA contains mechanisms that maintain the ensemble spread, namely the RTPP scheme, adaptive covariance inflation, and adaptive localization. The effects of these methods were evaluated and it was concluded that they enable the assimilation system to use the larger number of aircraft observations without a collapse of the ensemble spread. The spread reduction exhibited a nonproportional dependence on the increasing number of observations. In the future, unified inflation methods such as those presented in Ying and Zhang (2015) could be helpful in further dealing with this issue.
The ability to benefit from a high observation density strongly depends on the RTPP relaxation parameter. With less relaxation toward the background ensemble than the currently used factor of 0.75, the resulting analysis ensemble could contain smaller errors because the observations are given more weight. In future experiments, also a more sophisticated thinning could be applied to reduce the observation density only where it is redundant or where saturation effects are apparent. The high temporal density of Mode-S EHS observations could be exploited in a 15-min cycling interval. An observation system that fills the low-level data gaps between airports could be useful for airport forecasts, especially for warnings of small-scale phenomena such as rapidly evolving gust fronts and downbursts. A wider usage of surface stations than in the present study could supplement the high density of upper-air observations, if provided with proper vertical localization.
Spectra of the difference kinetic energy with respect to a control experiment showed that the LETKF data assimilation affects all model scales. The amount of observation data in the experiments was reflected by the degree of modification of analysis and forecast states. A stronger modification caused a faster relaxation toward the attractor of the control experiment. In further studies, different regimes (dry/wet) or seasons (winter/summer) could be chosen to compare the influence of dense observation sets when error growth is dominated by either synoptic or local processes. The spectral difference energy of temperature and cloud fields could give insight on scale-dependent error growths (Zhang et al. 2007; Selz and Craig 2015).
It is planned to combine the present setup with the assimilation of observation sets with even higher resolutions, such as radial winds and reflectivity of convective systems from Doppler radar, and to verify their influences across the observation spaces [e.g., by using the techniques of Sommer and Weissmann (2014)]. Forecasts with longer lead times than 3 hours should be performed to evaluate if the Mode-S EHS benefit is persistent. A rigorous survey of the imbalances should be performed that are caused by possible overfitting and overly small localization lengths (Lange and Craig 2014), along with a test period longer than 5 days to improve the significance of the results.
Acknowledgments
We thank MUAC-EUROCONTROL and the Mode-S-group at KNMI for processing and providing the Mode-S EHS data, Christoph Schraff for the implementation of the Mode-S EHS input in COSMO, Hendrik Reich for his support of the basic cycling (BaCy) system of COSMO-KENDA, and Alexander Cress and Ana Fernandez for generating and providing the ICON BCs. This study was carried out in the Hans Ertel Centre for Weather Research. This research network of universities, research institutes, and the Deutscher Wetterdienst is funded by the BMVI (Federal Ministry of Transport and Digital Infrastructure). The first author is funded by the BMVI Forschungsvorhaben Nr. 50.0357-2013-L1.
REFERENCES
Aksoy, A., D. C. Dowell, and C. Snyder, 2010: A multicase comparative assessment of the ensemble Kalman filter for assimilation of radar observations. Part II: Short-range ensemble forecasts. Mon. Wea. Rev., 138, 1273–1292, doi:10.1175/2009MWR3086.1.
Baldauf, M., A. Seifert, J. Förstner, D. Majewski, and M. Raschendorfer, 2011: Operational convective-scale numerical weather prediction with the COSMO model: Description and sensitivities. Mon. Wea. Rev., 139, 3887–3905, doi:10.1175/MWR-D-10-05013.1.
Bick, T., and Coauthors, 2016: Assimilation of 3D radar reflectivities with an ensemble Kalman filter on the convective scale. Quart. J. Roy. Meteor. Soc., doi:10.1002/qj.2751, in press.
Bierdel, L., P. Friederichs, and S. Bentzien, 2012: Spatial kinetic energy spectra in the convection-permitting limited-area NWP model COSMO-DE. Meteor. Z., 21, 245–258, doi:10.1127/0941-2948/2012/0319.
Bishop, C. H., B. J. Etherton, and S. J. Majumdar, 2001: Adaptive sampling with the ensemble transform Kalman filter. Part I: Theoretical aspects. Mon. Wea. Rev., 129, 420–436, doi:10.1175/1520-0493(2001)129<0420:ASWTET>2.0.CO;2.
Daley, R., 1991: Atmospheric Data Analysis. Cambridge University Press, 457 pp.
de Haan, S., 2011: High-resolution wind and temperature observations from aircraft tracked by Mode-S air traffic control radar. J. Geophys. Res., 116, D10111, doi:10.1029/2010JD015264.
de Haan, S., and A. Stoffelen, 2012: Assimilation of high-resolution Mode-S wind and temperature observations in a regional NWP model for nowcasting applications. Wea. Forecasting, 27, 918–937, doi:10.1175/WAF-D-11-00088.1.
Desroziers, G., L. Berre, B. Chapnik, and P. Poli, 2005: Diagnosis of observation, background and analysis-error statistics in observation space. Quart. J. Roy. Meteor. Soc., 131, 3385–3396, doi:10.1256/qj.05.108.
Gaspari, G., and S. E. Cohn, 1999: Construction of correlation functions in two and three dimensions. Quart. J. Roy. Meteor. Soc., 125, 723–757, doi:10.1002/qj.49712555417.
Harnisch, F., and C. Keil, 2015: Initial conditions for convective-scale ensemble forecasting provided by ensemble data assimilation. Mon. Wea. Rev., 143, 1583–1600, doi:10.1175/MWR-D-14-00209.1.
Houtekamer, P. L., and H. L. Mitchell, 2005: Ensemble Kalman filtering. Quart. J. Roy. Meteor. Soc., 131, 3269–3289, doi:10.1256/qj.05.135.
Hunt, B. R., E. J. Kostelich, and I. Szunyogh, 2007: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter. Physica D, 230, 112–126, doi:10.1016/j.physd.2006.11.008.
Janjić, T., L. Nerger, A. Albertella, J. Schröter, and S. Skachko, 2011: On domain localization in ensemble-based Kalman filter algorithms. Mon. Wea. Rev., 139, 2046–2060, doi:10.1175/2011MWR3552.1.
Janjić, T., J. Schröter, R. Savcenko, W. Bosch, A. Albertella, R. Rummel, and O. Klatt, 2012: Impact of combining GRACE and GOCE gravity data on ocean circulation estimates. Ocean Sci., 8, 65–79, doi:10.5194/os-8-65-2012.
Lange, H., and G. C. Craig, 2014: The impact of data assimilation length scales on analysis and prediction of convective storms. Mon. Wea. Rev., 142, 3781–3808, doi:10.1175/MWR-D-13-00304.1.
Li, H., E. Kalnay, and T. Miyoshi, 2009: Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter. Quart. J. Roy. Meteor. Soc., 135, 523–533, doi:10.1002/qj.371.
Meng, Z., and F. Zhang, 2007: Tests of an ensemble Kalman filter for mesoscale and regional-scale data assimilation. Part II: Imperfect model experiments. Mon. Wea. Rev., 135, 1403–1423, doi:10.1175/MWR3352.1.
Perianez, A., H. Reich, and R. Potthast, 2014: Optimal localization for ensemble Kalman filter systems. J. Meteor. Soc. Japan, 92, 585–597, doi:10.2151/jmsj.2014-605.
Schraff, C., H. Reich, A. Rhodin, A. Schomburg, K. Stephan, A. Periañez, and R. Potthast, 2016: Kilometre-Scale Ensemble Data Assimilation for the COSMO Model (KENDA). Quart. J. Roy. Meteor. Soc., doi:10.1002/qj.2748, in press.
Selz, T., and G. C. Craig, 2015: Upscale error growth in a high-resolution simulation of a summertime weather event over Europe. Mon. Wea. Rev., 143, 813–827, doi:10.1175/MWR-D-14-00140.1.
Sommer, M., and M. Weissmann, 2014: Observation impact in a convective-scale localized ensemble transform Kalman filter. Quart. J. Roy. Meteor. Soc., 140, 2672–2679, doi:10.1002/qj.2343.
Stensrud, D. J., and Coauthors, 2009: Convective-scale warn-on-forecast system: A vision for 2020. Bull. Amer. Meteor. Soc., 90, 1487–1499, doi:10.1175/2009BAMS2795.1.
Stensrud, D. J., and J. Gao, 2010: Importance of horizontally inhomogeneous environmental initial conditions to ensemble storm-scale radar data assimilation and very short-range forecasts. Mon. Wea. Rev., 138, 1250–1272, doi:10.1175/2009MWR3027.1.
Stephan, K., S. Klink, and C. Schraff, 2008: Assimilation of radar-derived rain rates into the convective-scale model COSMO-DE at DWD. Quart. J. Roy. Meteor. Soc., 134, 1315–1326, doi:10.1002/qj.269.
Strajnar, B., N. Zagar, and L. Berre, 2015: Impact of new aircraft observations Mode-S MRAR in a mesoscale NWP model. J. Geophys. Res. Atmos., 120, 3920–3938, doi:10.1002/2014JD022654.
Whitaker, J. S., and T. M. Hamill, 2012: Evaluating methods to account for system errors in ensemble data assimilation. Mon. Wea. Rev., 140, 3078–3089, doi:10.1175/MWR-D-11-00276.1.
WMO, 2003: Aircraft meteorological data relay (AMDAR) reference manual. Tech. Rep. WMO-958, 84 pp. [Available online at http://www.wmo.int/pages/prog/www/GOS/ABO/AMDAR/publications/AMDAR_Reference_Manual_2003.pdf.]
Yang, S.-C., E. Kalnay, B. Hunt, and N. E. Bowler, 2009: Weight interpolation for efficient data assimilation with the local ensemble transform Kalman filter. Quart. J. Roy. Meteor. Soc., 135, 251–262, doi:10.1002/qj.353.
Ying, Y., and F. Zhang, 2015: An adaptive covariance relaxation method for ensemble data assimilation. Quart. J. Roy. Meteor. Soc., 141, 2898–2906, doi:10.1002/qj.2576.
Zängl, G., D. Reinert, P. Ripodas, and M. Baldauf, 2015: The ICON (ICOsahedral Non-hydrostatic) modelling framework of DWD and MPI-M: Description of the non-hydrostatic dynamical core. Quart. J. Roy. Meteor. Soc., 141, 563–579, doi:10.1002/qj.2378.
Zhang, F., C. Snyder, and J. Sun, 2004: Impacts of initial estimate and observation availability on convective-scale data assimilation with an ensemble Kalman filter. Mon. Wea. Rev., 132, 1238–1253, doi:10.1175/1520-0493(2004)132<1238:IOIEAO>2.0.CO;2.
Zhang, F., Z. Meng, and A. Aksoy, 2006: Tests of an ensemble Kalman filter for mesoscale and regional-scale data assimilation. Part I: Perfect model experiments. Mon. Wea. Rev., 134, 722–736, doi:10.1175/MWR3101.1.
Zhang, F., N. Bei, R. Rotunno, C. Snyder, and C. C. Epifanio, 2007: Mesoscale predictability of moist baroclinic waves: Convection-permitting experiments and multistage error growth dynamics. J. Atmos. Sci., 64, 3579–3594, doi:10.1175/JAS4028.1.