Quantifying the Error of Radar-Estimated Refractivity by Multiple Elevation and Dual-Polarimetric Data

Ya-Chien Feng Department of Atmospheric and Oceanic Sciences, McGill University, Montreal, Quebec, Canada

Search for other papers by Ya-Chien Feng in
Current site
Google Scholar
PubMed
Close
and
Frédéric Fabry Department of Atmospheric and Oceanic Sciences, McGill University, Montreal, Quebec, Canada

Search for other papers by Frédéric Fabry in
Current site
Google Scholar
PubMed
Close
Full access

Abstract

To properly use radar refractivity data quantitatively, good knowledge of its errors is required. The data quality of refractivity critically depends on the phase measurements of ground targets that are used for the refractivity estimation. In this study, the observational error structure of refractivity is first estimated based on quantifying the uncertainties of phase measurements, data processing, and the refractivity estimation method. New correlations between the time series of phase measurements at different elevation angles and between polarizations are developed to assess the bulk phase variability of individual targets. Then, the observational error of refractivity is obtained by simulating the uncertainties of phase measurements through the original refractivity estimation method. Resulting errors in refractivity are found to be smaller than 1 N-unit in areas densely populated with reliable point-like stationary ground targets but grow as the target density becomes sparse.

Current affiliation: Department of Atmospheric Science, Colorado State University, Fort Collins, Colorado.

© 2018 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Ya-Chien Feng, ya-chien.feng@mail.mcgill.ca

Abstract

To properly use radar refractivity data quantitatively, good knowledge of its errors is required. The data quality of refractivity critically depends on the phase measurements of ground targets that are used for the refractivity estimation. In this study, the observational error structure of refractivity is first estimated based on quantifying the uncertainties of phase measurements, data processing, and the refractivity estimation method. New correlations between the time series of phase measurements at different elevation angles and between polarizations are developed to assess the bulk phase variability of individual targets. Then, the observational error of refractivity is obtained by simulating the uncertainties of phase measurements through the original refractivity estimation method. Resulting errors in refractivity are found to be smaller than 1 N-unit in areas densely populated with reliable point-like stationary ground targets but grow as the target density becomes sparse.

Current affiliation: Department of Atmospheric Science, Colorado State University, Fort Collins, Colorado.

© 2018 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Ya-Chien Feng, ya-chien.feng@mail.mcgill.ca

1. Introduction

Convection initiation and short-term quantitative precipitation forecasting are sensitive to the moisture variability at the surface (e.g., Zawadzki et al. 1981; Crook 1996; Weckwerth et al. 1999). High-spatial- and high-temporal-resolution near-surface moisture measurements are thus needed for improving the initial conditions in storm-scale numerical weather prediction (NWP) models (Emanuel et al. 1995; Dabberdt and Schlatter 1996; Fabry and Sun 2010; Hanley et al. 2011; Ha and Snyder 2014; Madaus and Hakim 2016). The refractivity (N) field estimated from weather radars (Fabry et al. 1997) provides a proxy for two-dimensional near-surface moisture distribution. The high-spatiotemporal-resolution refractivity field mimics the horizontal moisture variations, which benefits studies on convection initiation and boundary layer evolution (Weckwerth et al. 2005; Fabry 2006; Buban et al. 2007; Koch et al. 2008; Bodine et al. 2010) as well as providing valuable information for NWP models.

Since radar refractivity mimics the high-resolution moisture variability, preliminary studies have demonstrated the positive impact of ingesting the radar refractivity fields into the mesoscale NWP models to initialize the low-level moisture field (Montmerle et al. 2002; Sun 2005; Gasperoni et al. 2013; Seko et al. 2017). The results of quantitative precipitation forecasting were improved by the adjusted distribution and quantity of low-level moisture. In addition, the refractivity fields are applied to evaluate the model forecasts at different horizontal grid resolutions (Nicol et al. 2014; Besson et al. 2016). Greater differences in refractivity between radar estimates and model forecasts are particularly found in NWP models with finer horizontal resolution (Nicol et al. 2014). This suggests the critical need for assimilating radar refractivity data into advanced high-resolution NWP models. The Weather Meteorological Organization (WMO 2015) further advocates for more studies on the impact of assimilating radar-estimated refractivity data for real cases to examine the value for operational high-resolution nowcasting NWP models. In addition, while the focus of this paper is on quantifying observation errors for use in data assimilation at the convective scale, it should not be construed as implying that this is the main assimilation application of refractivity data (see the appendix for an illustration in a more regional-scale context).

The purpose of data assimilation is to find the optimal condition, known as analysis, for model integration forward in time (Kalnay 2003). The data assimilation system statistically combines observations and forecasts by weighting them on their error information. The updated analysis can be written in matrix form as
e1
Here, is the linearized observation operator that transfers the background field , the unobserved state variables in the model, into simulated observations compatible with the observations y. The optimal weight matrix equals T(T + )−1, where and are the background and observational error covariances, respectively. The value of the increment () of the analysis field depends on the innovation [y()] and determined by and . Hence, and need to be estimated to properly assign the weights of observations in optimal estimation methods.

Quantitative knowledge on the data quality and observational errors is an essential step toward properly using data in NWP models. The characteristic of observational error of radar refractivity still remains unquantified and hinders the application of refractivity. The observational errors used in most previous studies were assumed randomly distributed in space with a Gaussian distribution with no clear justification or basis for this choice, since is not well known and quantified. Therefore, this study aims to investigate the quantitative characteristics of observational errors of radar refractivity. The observational error matrix in data assimilation can generally be attributed to four sources: 1) instrument and measurement error, 2) errors caused by data processing (quality control), 3) errors introduced by the observation operator (forward model), and 4) representativeness errors (i.e., different representativeness of resolved spatial scales between models and observations). Obtaining observational error is challenging, since the true value of the atmospheric state is unknown. Some methods have been proposed to estimate the magnitude and characteristics of observational errors. One is the error inventory method that analyzes all the contributions of the uncertainties to the observations. For example, Keeler and Ellis (2000) used the knowledge on data quality of radar signals to estimate the observational errors of radar reflectivity and radial wind caused by measurements and data processing. In addition, diagnostic methods are popularly applied in the model community for estimating observational errors. The observational errors are mainly obtained based on output from data assimilation systems, for example, observation minus background and observation minus analysis (Hollingsworth and Lonnberg 1986; Desroziers et al. 2005; Waller et al. 2016).

The goal of this paper is to estimate the observational errors of radar refractivity through the error inventory method. In section 2, all possible sources of uncertainty in the radar phase measurements and data processing based on the original radar refractivity technique (Fabry et al. 1997) are revisited and discussed. In section 3, we propose a method to estimate the uncertainties of the radar phase measurements that have not been quantified before. The errors of radar refractivity associated with instrument measurements, data processing, and the estimation method are estimated in section 4. We then summarize our findings in section 5.

2. Sources of uncertainty in radar refractivity

In this section, we revisit the basic concept and data processing processes of radar refractivity estimation. These enable us to sort out the sources of the uncertainties in radar refractivity.

a. Basis behind radar-estimated refractivity

The time that electromagnetic waves travel between the radar and a stationary ground target changes with the refractivity of the air along its propagation path. Fabry et al. (1997) used the phase signal from a fixed ground target as a proxy for to estimate the air refractivity. The radar-measured phase ϕ of a stationary point ground target depends on the time taken by a radar pulse for a two-way path:
e2
where f is a stable radar transmitter frequency, r is the one-way beam path range from the radar to the target, and c is the speed of light in a vacuum. Since r is not known with the required precision to use (2) and since the observed phase largely exceeds 2π, the phase difference of a stationary ground target between a scan at time t and at a reference time can be used to relax considerably the need for precision on r and to reduce the problem of the aliasing of phases:
e3
To estimate refractivity change between two time steps , the reference phase needs to be determined first when is known. Then, the temporal local small-scale variations of can be derived from the radial gradient of the phase difference between these targets. By adding to the known field, the refractivity value can be estimated.

There are several processing steps to get the refractivity field from the radar measurements as shown in Fig. 1 (Fabry and Pettet 2002). At calibration stage, from a known homogeneous refractivity field and the data quality of ground targets need to be determined. At real time stage, the field between the current time and the reference time is calculated. Then, the noisy field is processed (e.g., via smoothing weighted by the reliability of targets, dealiasing, and interpolations) to obtain a smoother field to easily estimate the local from the radial slope of the processed field. The final N field is obtained as the sum of and .

Fig. 1.
Fig. 1.

The data processing flowchart of obtaining near-surface refractivity from radar measurements (Fabry and Pettet 2002).

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

The data quality of the radar refractivity is affected by both the phase measurements of ground targets and by the radar refractivity estimation method. Note that the estimation method includes the data processing procedures and the local N estimation as mentioned in the previous paragraph. Nevertheless, previous studies mainly focused on qualitative discussions of different sources of phase measurements uncertainty (see the following section), but they seldom investigated the magnitude of the uncertainties of measured phase data and the estimation method.

b. Uncertainties of the phase measurements of ground targets

The phase change caused by the change in refractivity at a given height above the terrain is the signal of interest for radar refractivity estimation (Fabry 2004; Feng et al. 2016). However, different reasons other than this atmospheric-driven signal also lead to uncertainties in ϕ or introduce errors in the refractivity estimations. Generally, contributions to the uncertainty in the phase measurement come from the phase variations associated with issues of radar hardware, radar wave propagation conditions, and characteristics of ground targets. The details of each category are described as follows.

  • Radar hardware: Phase uncertainty associated with radar hardware issues includes the varying frequency of a magnetron-based radar (Parent du Chatelet et al. 2012; Nicol et al. 2013) and the phase pattern of the parabolic antenna (Feng and Fabry 2016). These systematic phase shifts can be corrected by knowing the fluctuating local oscillator frequency and the antenna phase pattern.

  • Radar wave propagation conditions: Electromagnetic wave propagation conditions associated with the vertical refractivity gradient and the height differences between the radar and ground targets have been considered the major problem in the original method (Fabry 2004; Park and Fabry 2010; Bodine et al. 2011). A novel method to reduce this uncertainty caused by the coupling effect of and target heights has been proposed in Feng et al. (2016). Moreover, precipitation along the wave path also affects the phase measurements, which can be estimated from the rainfall rate (Bodine et al. 2011).

  • Characteristics of ground targets: The uncertainties of the phases related to the characteristics of ground targets include the movements of targets, changes in how a complex target with multiple reflecting elements are illuminated by the radar (Fabry 2004), sidelobe contamination from strong neighboring targets (Besson et al. 2012; Nicol and Illingworth 2013), and the unknown target locations with respect to the center of the sampled range gate (Nicol et al. 2013). The uncertainties of target locations in range, azimuths, or heights affect the interpretations and representativeness of phase measurements, even for ideal stationary point-like targets. For example, the unknown ranges of targets in conjunction with transmitter frequency fluctuations result in random phase errors that are proportional to the magnitude of the frequency change and the pulse length (Nicol et al. 2013). In addition, if targets are not aligned on the same azimuth and refractivity changes locally, then some spatial noisiness of phase might also be introduced. Since the time between most radar volume scans is about 5–10 min, refractivity variations at small scales also introduce some fluctuations in phase that may not be properly interpreted as such, particularly when the exact location of targets is unknown.

The uncertainties in phase measurements can be classified into biases and errors. Biases are systematic given a set of conditions and can be corrected based on these known conditions, such as the measured changes in the unstable frequency of the local oscillator and estimated . Phase uncertainties caused by radar hardware, the coupling effect of changes in , and uneven target heights, as well as precipitation delay, are considered biases. These systematic biases need to be corrected during the data processing. Then, the unbiased refractivity can be properly used in quantitative applications. On the other hand, phase uncertainties that cannot be corrected are errors. The phase errors include the random phase changes introduced by the unknown target characteristics, for example, movements, complexity, and locations. Since these terms are independent, the total error variance of phase equals the sum of individual error variances:
e4

3. Estimating phase measurement errors

Estimating as a bulk error remains a challenge, not to mention each individual term in (4). It is an ill-posed problem to obtain the signal and noise simultaneously with limited phase measurements. Therefore, we propose a new method for quantitatively estimating through more phase measurements collected at multiple antenna elevations and at two polarizations.

a. Correlation of two time series of radar signals

Let us conduct a simple thought experiment to help understand the correlation of the radar signal at two lower elevation angles. An ideal stationary point-like target is considered here and it is located well within the main lobe of the antenna, where the antenna phase pattern is constant (Feng and Fabry 2016). When there is no temporal change in refractivity, the phase measurements from an ideal target at two low antenna elevations—say, 0.3° and 0.5°—are constant in time. Meanwhile, the time series of phase measurements at horizontal and vertical polarizations at given elevation are also constant. In other words, the phase differences between two elevations or between two polarizations stay constant in time. Nevertheless, for nonideal ground targets, the phase differences between two elevations vary temporally because of target movements and unknown target location issues associated with small-scale refractivity changes as mentioned in (4). The phase difference between polarizations also shows temporal variability caused by the complexity of targets and its changing illumination of the targets. Therefore, the information of phase difference between polarizations and between elevations provides both qualitative and quantitative insights on the phase errors.

We use the correlation coefficient ρ of two time series of phase measurements and over M volume scans from a given ground target to quantify the temporal variation of phase differences. Then, ρ can be expressed as
e5
These two time series of phase measurements can be applied for two elevations or two polarizations. When and are identical or with a constant phase difference in time, ρ is equal to one. For most targets, ρ decreases with increasing temporal variability of as a result of target movements under various wind speeds, small-scale refractivity variations, and complicated wave interferences of nonideal point targets. We learned that ρ qualitatively decreases with the temporal fluctuations of the phases, but quantifying the variance of these phase errors is a problem that needs to be solved in order to estimate the error of radar-estimated refractivity.

Note that the ρ of a ground target here is calculated from the phases of a given radar-sampled range gate (resolution volume). For example, the ideal point-like ground target we mentioned is an isolated power or communication tower within the gate that dominates the returned signals of that given gate. In reality, there are usually more than one ground target within a gate. Even with high-resolution lidar measurements or high-resolution satellite images, we cannot resolve every single ground target in detail within a resolution volume for more complicated convolution computation of the radar antenna pattern and these ground targets’ reflected characteristics. The phase measurement of a given sampled range gate provides bulk characteristics of the radar wave interacting (convolving with) all the ground targets within the resolved volume. The term “ground target” provides a simple concept to understand, so we keep using “ρ of ground target.” Also note that we do not calculate the correlation between the original returned signals V that are generally used in the radar signal processing; V is a complex number as , where A is the amplitude of the signal and ϕ is the phase. It is because the returned power fluctuates in time for many reasons and then affects the magnitude and the representativeness of correlation calculated from these signals. Therefore, we use the correlation of phases to determine the temporal variation of the phases’ difference and exclude the effects of fluctuating amplitudes.

b. Types of correlation coefficient of phases

The correlation coefficient of phases can be calculated between two elevations , between two polarizations , or from a time series of successive scans at a given polarization and elevation using lagged autocorrelation . Here, we will discuss and compare the differences between these ρ (Fig. 2) calculated from 3-h data of the McGill radar. The selected time period is 1100–1400 UTC (0700–1000 LST) 30 October 2012. The weather condition was cloudy with some showers. The average wind speed is 7 m s−1 from surface stations and the average vertical gradient of refractivity is about −70 ± 15 km−1.

  • The coefficient is a useful indicator to distinguish the reliability of targets, particularly in windy conditions. This correlation is calculated from time series of phases at two low successive antenna scanning elevations, for example, 0.3° and 0.5° for the McGill radar. The time interval between these two elevations is about 10 s, and the temporal refractivity changes within this short time period can be assumed to be negligible. For stationary ideal point-like targets located within the radar antenna main beam, the phase difference between nearby elevations is constant in time based on the antenna phase pattern (Feng and Fabry 2016). Thus, the temporal variability of the phase difference between these elevation scans is mainly caused by the changes in target characteristics [i.e., movement and complexity in (4)]. For example, winds cause target movements and shape changes even within a few seconds, leading to a temporal phase difference between two elevations and a reduction in the magnitude of . Figure 2a shows the distribution of at horizontal polarization on a windy morning. Higher values of shown as yellowish colors represent the reliable ground targets with smaller phase errors. On our radar, the number of targets (Fig. 2d) whose is greater than 0.8 is about 15 000, which is 1% of the data within a 62.5-km radius. In addition, fields at horizontal and vertical polarizations show very similar distribution, the minor differences are due to the antenna pattern and the target characteristics responding to the different polarizations (Feng 2017). Moreover, some practical criteria are suggested for selecting the two elevation angles required to calculate . The angle difference between these two elevations is recommended to be less than the half of the antenna beamwidth, considering the characteristics of antenna phase pattern. A temporal interval of less than 1 min between these elevations is also recommended.

  • The coefficient is best used to distinguish point or point-like targets from complex ones. For point-like ground targets, the phase difference between the (simultaneously transmitted and received) horizontal and vertical polarizations is constant in time, since it is solely related to the discrepancy of the antenna phase patterns at each polarization. As a consequence, the value of of point-like targets is expected to be close to one. For complicated targets, the phase difference between the two polarizations varies temporally and this results in a lower . The phase discrepancy between polarizations mostly occurs during atmospheric inversion conditions at night with strong negative values (Feng and Fabry 2013). When the radar beam bends toward the ground, the main beam may illuminate more of the full vertical extent of targets or surrounding targets, such as the ground and shorter buildings, that were not seen by the main beam under normal propagation conditions. Then, the complicated shape of the targets responds differently to horizontal and vertical polarizations, and a lower value of is consequently expected for complicated targets. The values of (Fig. 2b) are thus mostly higher than , particularly under the normal propagation conditions. The histogram of (Fig. 2e) shows the majority of centered around 0.4, which is different from the distribution of (Fig. 2d), which is more skewed toward zero. Though is a good indicator for the ground target properties, it cannot provide too much information on the phase error caused by target movement and small-scale refractivity changes. Additionally, a lower value of might be a result of problematic unstable phases of either horizontal or vertical polarization, or of both the polarizations. The challenge of using alone is that we do not know whether to discard the phases at both polarizations or to use either one of them.

  • The autocorrelation of phases at a given elevation and polarization but between successive volume scans is dominated by the temporal refractivity change between volume scans, whose time interval depends on radar scanning speed (e.g., 5 min for the McGill radar). For stationary point-like ground targets, the phase change caused by the refractivity variation between successive volume scans is generally larger than other causes in (4). Thus, the values of (Figs. 2c and 2f) are smaller than the previous correlations, particularly at farther ranges. The variable does not represent the variance of phase errors. Nevertheless, can be useful to determine the reliability of ground targets under only one special condition, in the presence of a homogeneous refractivity field in time and space at the calibration stage (Fabry et al. 1997).

Fig. 2.
Fig. 2.

(a)–(c) Distribution of the correlation coefficients ρ of different combinations of phase time series observed from the McGill radar within a 50-km radius during 1100–1400 UTC (UTC = LST + 4 h) 30 Oct 2012. (a) Correlation coefficients between data at two low elevations angles , 0.3° and 0.5°. (b) Correlation coefficients between horizontal and vertical polarization at 0.3° elevation. (c) Autocorrelation of phase time series at horizontal polarization and at 0.3° elevation. (d)–(f) Histograms of each correlation shown in (a)–(c) for data within a 50-km range.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

c. Which correlation to use

The phase uncertainties discussed in (4) caused by target movement and shape complexities are related to the near-surface wind conditions. We compared the relationship between areal-average ρ within the radar coverage and the wind speed from surface stations near the McGill radar during summer days. Figure 3 shows that ρ generally decreases with increasing wind speed, but the decreasing rates vary among different ρ. Correlation is the most sensitive to the variation of wind speed. It is because target movements are strongly affected by the wind speed, and the phase differences between two elevations separated by a 10-s time interval can be substantial. For instance, a radial displacement of half a wavelength—that is, 5 cm for S-band radars—leads to a 2π phase variation. When the wind speed is greater than 15 m s−1, lowers to a constant value around 0.3. On the other hand, a higher might happen during calm environment conditions with light (or no) wind. The higher values of are contributed from the nonideal targets without movements. The variation ranges of and show only relative minor changes with wind speed compared to the variation of . In summary, is preferred to provide the time-dependent phase quality under various weather conditions over the other two correlations.

Fig. 3.
Fig. 3.

Relationship between average wind speed from surface stations and areal-average (red circles), (blue triangles), and (black crosses). The average ρ is calculated from the data within a 62.5-km radius of McGill radar. The time period of this dataset is from 20 to 31 Aug 2012.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

Based on the different characteristics of each correlation (Table 1), we suggest applying for selecting reliable ground targets and for estimating the phase errors. Correlation is the most representative of the phase uncertainties in (4) among other correlations. Using is practical for most weather phenomena, and it does not have to commit to an artificial time like in the original method. It can also be used as a weighting index of each individual ground target in the real-time data processing (step III in Fig. 1). Even though still underestimates the effect of uncertainties of target locations, it is so far the best we have found. The time-dependent provides an effective way for real-time ground target selection and quantification of the error of phase measurements for the radar-estimated refractivity technique. In addition, in extreme propagation conditions, adds value by detecting the abnormal phase behaviors from complicated targets.

Table 1.

Summary of different correlation coefficients associated with various physical causes, where “Y” indicates that ρ is affected by the corresponding physical cause and “P” means that ρ is only partially affected by the physical cause.

Table 1.

d. Link between ρ and

To quantitatively describe the uncertainties of the phase error, the knowledge of the relationship between the correlation of two time series of phase and the standard deviation of the phase error, hereafter the ρ–σϕ relationship, is required. The conventional equation for estimating the angular standard deviation of phase is based on a wrapped normal distribution: , that is , if is expressed in degrees (Mardia 1972; Weber 1997). Since the magnitude of the phase error changes with time, the length of the time series (i.e., number of volume scans) used to estimate that fluctuation must be a compromise between greater accuracy, calling for a longer time series, and adaptability to changing conditions, calling for shorter time series. Even though the ρ–σϕ relation exists, we investigated the sensitivity of the sampling.

To achieve this, we performed a series of simulations using various numbers of samplings M. The error of the phase measurement is assumed to follow white Gaussian noise statistics with a given standard deviation σϕ. Even though the noisy phases caused by small-scale refractivity variation and target movements might vary as a function of time, white noise statistics is the only assumption we can make given the limited observation samples and unknown wind conditions. Time series data of fluctuating phases and are generated independently as random white noise with a given and zero mean. Then, ρ of these simulated and is calculated for a variety of , ranging from 0° to 120°. For example, using M = 36 volume scans of a time series, the relationship between ρ and is shown as blue dots in Fig. 4. The ρ–σϕ relationship is then fitted with a Gaussian distribution as , shown by the red line.

Fig. 4.
Fig. 4.

Correlation coefficient ρ between two time series of phase measurements having a random noise with a standard deviation . Multiple simulations have been done with varying (blue dots). A fitted Gaussian relation is also shown (red). Note that only simulations with ρ greater than 1/e (green dashed line) are used in the regression, because there is no clear skill in connecting ρ and when ρ is less than 1/e.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

We examined the ρ–σϕ relation under various samples. The ρ–σϕ fitting starts to converge around 30 samples where the relationship is . The fit becomes stable when there are 60 samples and the relationship turns into . The slight difference in the fitting coefficient between 30 and 60 samples does not affect σϕ too much under a given ρ. Therefore, sample numbers greater than 30 are acceptable to apply the fitted relationship. In this work, we used 36 samples of the time series, corresponding to 3 h of data from the McGill radar, to obtain ρ and the ρ–σϕ relationship. In the end, σϕ can be estimated based on ρ calculated from the radar observation and the newly derived ρ–σϕ relationship, at least as long as ρ is greater than 1/e.

4. Quantification of the error of radar-estimated refractivity

Based on the quantitative knowledge of phase uncertainties at each gate sampled by the radar in section 3, the impact of phase quality on can thus be quantified. In addition, even though the biases of refractivity associated with the target height and can be corrected given reasonable assumptions for target heights, there are still concerns about the impact of the uncertainties of the target heights and estimated . The caused by these uncertainties is also discussed and examined.

a. caused by phase uncertainties and the estimation method

The data quality of the radar refractivity depends both on the phase measurements of ground targets and on the radar refractivity estimation method as shown in Fig. 1. The following steps attempt to estimate that is introduced by phase errors through the data processing of phases and the N estimation method: 1) For each sampled range gate, is calculated from the observed phase measurements at two low antenna elevations. Consequently, is obtained based on the calculated and the ρ–σϕ relationship. 2) The noisy phase at each sampled gate is simulated by random errors based on Gaussian statistics with a mean of zero and the assigned from the previous step. For a sampled gate whose is smaller than 1/e, the added phase noise is randomly assigned a value from −180° to 180°. Then, a phase field is obtained based on the simulated noisy phase at each sampled gate superposed on a known phase field for a given condition, which is zero in this case. 3) We can estimate N from the simulated phase field in the previous step through the method for estimating radar refractivity. Then, is obtained by comparing the estimated N with the expected one.

Taking a real case for example, the refractivity error is examined and obtained based on the phase perturbation estimated from the field (Fig. 5a). The errors in refractivity (Fig. 5b) are not randomly distributed as generally assumed for the observational error for data assimilation but are associated with the density of reliable targets. In areas with dense reliable ground targets of higher , is close to zero and is smaller than those in areas with fewer reliable ground targets. This experiment confirms that we can use the radar-estimated refractivity with higher confidence in areas having a greater number of reliable targets. Further, in order to determine the variance of , this process of taking a known phase field, adding a random noise based on the expected phase fluctuation for each gate, estimating N, and comparing it with the truth was repeated 30 times. The ensemble mean of the refractivity error field is almost zero as shown in Fig. 5c. The ensemble standard deviation of the refractivity error shown in Fig. 5d is within 1 N-unit in areas with numerous reliable targets, generally in urban and suburban regions (e.g., areas with yellowish shads in Fig. 5a). Figure 6 further shows that the areal-mean is inversely proportional to the areal target density fraction above a given threshold, here , based on Fig. 5d. In addition, this simulation was repeated with a higher value of average —here, 30 N-unit—in order to examine the impact of the phase errors on the refractivity in the presence of large phase gradients in range. The field (not shown here) presents the similar pattern as it when N is equal to 0 N-unit in Fig. 5d.

Fig. 5.
Fig. 5.

Illustration of the results of the simulation of errors in estimated refractivity. (a) Correlation coefficient of phases at two elevations . (b) Error of refractivity obtained from one simulation of the noisy phases perturbed based on (a). (c) Mean of based on 30 simulations of randomly perturbed noisy phases based on Gaussian statistics with a mean of zero and the assigned of given . (d) Standard deviation of based on 30 simulations.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

Fig. 6.
Fig. 6.

Relationship between the mean and the areal fraction of higher-quality ground targets (; i.e., with the phase errors less than 45°) within an area of 5° in azimuth by 4 km in range. The total area considered here is a range from 20 to 40 km from the radar in Fig. 5.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

It is worth noting that some artificial azimuthal wavy patterns with larger values are shown in both and fields (Figs. 5c and 5d). These wavy patterns usually occurred at locations with fewer reliable ground targets, where the radial gradient of phases [the range derivative of (3)] is difficult to estimate from the raw observational data. We have found that these patterns also appear in the long-term climatological refractivity mean field. This highlights the need to improve the current refractivity estimation method, particularly in regions with fewer good ground targets. Other methods for refractivity estimation [e.g., least squares fit (Hao et al. 2006; Nicol and Illingworth 2013), compressive sensing (Ozturk et al. 2014), etc.] might be helpful to improve the target density problems. Evaluation of these refractivity estimation methods are worthy of further investigation.

b. from assumed target heights and

A method to correct the main bias of refractivity caused by height differences between radar and targets and by changes in has been proposed in Feng et al. (2016). The bias correction is made assuming that target heights are given heights above the terrain and assuming homogeneous in space. However, there are still some uncertainties in the assumed target heights and in estimation. Simulations are thus conducted to examine the effect of these uncertainties in the assumed target heights and on .

We examined the refractivity errors introduced by assumed target heights first. Taking the area of Montreal, Canada, for example, Fig. 7a shows the height differences between the McGill radar (at the origin) and the ground targets. The heights of ground targets here are assumed as the terrain height. We performed the simulation of with perturbed target heights with ±10 m added on the previously assumed target height and obtained the refractivity fields. The observed is simulated using the conditions of equal to −50 N-unit km−1 and the randomly perturbed target heights based on the equation of phase changes [(8) in Feng et al. (2016)], and then obtained the refractivity field through the original radar refractivity technique. The simulations are executed 30 times with randomly perturbed target heights to evaluate the uncertainties of assumed target heights on . Figure 7b shows that the standard deviation of from these simulations of height perturbation is sensitive to uncertainties of target heights in the area with a steep terrain height gradient, such as in the Mount Royal area (x = 22–24 km and y = 10–12 km). Elsewhere, the radar-estimated refractivity field in areas with relatively flat terrain achieve higher data quality after the bias corrections. In addition, if the uncertainties of are ±10 N-unit km−1, then the result of is the same as the result of the uncertainties of a target height with ±10 m, based on the dominant term (ii) of (8) in Feng et al. (2016).

Fig. 7.
Fig. 7.

Examination of associated with the uncertainties of the height difference between the radar and the targets under given changes in . (a) Height difference (, m) between the terrain in the Montreal area and the McGill radar. The targets here are assumed at the height of the terrain. The origin is the location of the radar, and the black rings show the radial distances of 20 and 40 km, respectively. (b) The standard deviation of based on 30 simulations, when is randomly perturbed within ±10 m.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

5. Summary and discussion

Radar-estimated refractivity fields provide insights into the high-spatiotemporal-resolution distribution of low-level moisture, and assimilating the refractivity field is considered critical to improve the model initial conditions. In this study, the observational errors of radar-estimated refractivity are first quantified and better understood as a prerequisite step to the ingestion of the data into NWP models. This is based on the newly developed method for quantifying the uncertainties of phase measurements and the data processing.

The observational errors of the radar-estimated refractivity associated with the uncertainties of phase measurement and the original estimation method (Fabry et al. 1997) are examined together for the first time. The magnitude of phase errors is determined based on two pieces of newly examined information: the first is the phase correlation coefficient ρ from phase measurements at different elevations and the second is the derived ρ–σϕ relationship between the correlations of phases and the standard deviation of the phase errors. The phase errors obtained here are a bulk quantity, with contributions from independent sources caused by the uncertainties of the target location, movement, and complexity within a sampled range gate. Using the phase error estimations from the observed phase measurements and the original refractivity estimation method, the time-evolving errors in refractivity are estimated. The examined refractivity error field is not randomly distributed, but it is associated with the areal density of reliable ground targets (i.e., higher values of of a sampled resolution gate close to 1). Random errors smaller than 1 N-unit are found in high-density areas of reliable targets, but larger errors with radial patterns are observed in areas with fewer targets. The quantification of the phase uncertainty for each individual ground target further offers insights into future improvement of the refractivity-estimating method and ground target selection in the data processing. The characterization of refractivity errors benefits the quantitative applications of radar-estimated refractivity by providing solid knowledge on observational errors for data assimilation and instrument synergies.

Besides the uncertainties of the phase measurements, uncertainties caused by the assumed target height and the estimated vertical refractivity profiles for the refractivity correction are examined. In flat terrain, there are nearly negligible impacts of these uncertainties on the refractivity field. On the contrary, strong correlated uncertainties are observed in areas with steep terrain. This leads to the difficulties in correcting for refractivity errors in such regions. In summary, for better understanding of the data quality of radar-estimated N obtained from different radars, the examination of should be performed according to the environments surrounding the individual radar site, that is, terrain and reliable ground target distribution.

Acknowledgments

The authors thank Drs. Dominik Jacques and Luc Fillion for providing the model data used in this study and the many discussions. Financial support for this work was supported by Environment and Climate Change Canada and the Natural Sciences and Engineering Research Council of Canada.

APPENDIX

Ingesting Continental-Scale Radar Refractivity into Regional Models

The radar-estimated refractivity might be implemented in operational radar networks in the near future (Bluestein et al. 2014). Previous studies have experimentally integrated some radars for expanding the coverage of the radar-estimated refractivity field (Hao et al. 2006; Roberts et al. 2008; Fritz and Chandrasekar 2009; Ozturk et al. 2014). Even if the main advantage of radar-estimated refractivity is currently thought to provide the rapidly evolving low-level moisture distribution at mesoscale, there are many other potential applications for NWP models. Here, we further investigate whether the radar refractivity from an operational radar network could constrain the regional NWP models. The uncertainty of the areal-mean radar-derived refractivity is based on the observational error quantification. With the increasing sample size of refractivity data in a given area, the accuracy of the areal-mean observation data would be higher and its uncertainty lower. Regional models have larger grid spacing than convective-scale models, and the average of few pixels of radar-derived refractivity field would better represent the average condition of the whole model grid box than a point measurement such as surface stations.

The information added by observations to model variables through data assimilation are determined by both the background and observation error covariances. The background error statistic provides an estimation of forecast uncertainty and quantifies the linear multivariate relationship within the model state. The correlation length of the background error covariance is conventionally used to indicate the impact distance that the information added by observation, or increment, is spread in space. Thus, this correlation length of background error of a regional model will be preliminary examined to demonstrate the impact regions of assimilating radar refractivity. There are three common ways to diagnose background error statistics: the innovation method using the difference between observations and background (Hollingsworth and Lonnberg 1986), the National Meteorological Center (NMC) method using the difference fields between two forecasting times (Parrish and Derber 1992) and the ensemble method using the ensemble distribution as an estimate of error statistics (Fisher 2003).

We examined the background error covariance based on ensemble model outputs from the Regional Ensemble Prediction System (REPS), version 2.2.0, of Environment and Climate Change Canada (ECCC). This model covers North America and adjacent oceans. The horizontal grid is 600 × 635 latitude–longitude with a 0.1375° resolution (about 15 km), and there are 48 vertical levels. A 20-member forecast is produced. We used 12-h forecasts for all calculations to avoid the correlations coming from the global system and correlated noises used for model initial perturbations. The prognostic variables are winds, temperature, specific humidity, pressure, liquid water content, and turbulent kinetic energy. A detailed model description can be found on the ECCC website (http://collaboration.cmc.ec.gc.ca/cmc/CMOI/product_guide/docs/tech_specifications/tech_specifications_REPS_e.pdf).

The background error correlations of refractivity from the McGill radar and state variables over the whole spatial grid are examined. Figure A1a is a monthly average (July 2016) of the autocorrelation of the refractivity errors between the point closest to the McGill radar and other model grid points. The correlation pattern shows anisotropy with elliptical contours whose major axis tilts to the east–west direction. The autocorrelation length of refractivity error is about 300 km in radius, which implies that the information of the point observation is spread over a substantial area. The correlation pattern of refractivity error and specific humidity error (Fig. A1b) shows a pattern similar to the autocorrelation of the refractivity error field. In contrast, the correlation has a much smaller magnitude for the temperature error fields (Fig. A1c). This can be explained from the fact that refractivity in the surface layer in summer depends much more on the specific humidity variations than on temperature variations.

Fig. A1.
Fig. A1.

Maps of the horizontal correlation between the errors in refractivity over the McGill radar site (black star) and that of (a) refractivity, (b) specific humidity, and (c) temperature in the rest of the domain from the REPS ensemble model outputs.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

Would the impact of assimilating refractivity from the operational radar network be the same throughout the large domain? We performed a simple examination of the autocorrelations corresponding to various geographic conditions and for two different forecasting times at 0000 and 1200 UTC. Figure A2 shows the correlation of the background error in refractivity with that at the center of each subdomain. The correlation length is generally shorter and anisotropic in complex topography, but it is longer over the Midwest plains and ocean areas. In areas with longer correlation lengths, the average radar-estimated N could provide useful information on the initialization of the regional NWP models. In areas with shorter background error correlation lengths, a higher density of observations is needed to reduce the forecasting uncertainties. Furthermore, the error correlation length also shows diurnal variations being generally longer during early morning (Fig. A2a; 1200 UTC) and shorter in the late afternoon (Fig. A2b; 0000 UTC).

Fig. A2.
Fig. A2.

Autocorrelation of the refractivity error at the first level of the model for two times: (a) 1200 UTC (early morning local time) and (b) 0000 UTC (late afternoon local time). Each small grid is 4° of latitude and longitude.

Citation: Journal of Atmospheric and Oceanic Technology 35, 10; 10.1175/JTECH-D-18-0008.1

This preliminary result suggests that assimilating near-surface refractivity in larger-scale regional models could have a significant value for some areas with longer correlation lengths of the background errors in specific humidity fields. Nevertheless, model background error statistics depend on the numerical model, the evolving atmospheric states, and stages of the storms. A more detailed analysis of the model background error is thus required. For example, more ensembles are needed to ensure the reliability and accuracy of the correlations (Stuart and Ord 1986). In addition, evaluating the impact of assimilating refractivity data from the radar network on the analysis of thermodynamic fields and on forecasting is worthy of further investigation.

REFERENCES

  • Besson, L., C. Boudjabi, O. Caumont, and J. Parent du Chatelet, 2012: Links between weather phenomena and characteristics of refractivity measured by precipitation radar. Bound.-Layer Meteor., 143, 7795, https://doi.org/10.1007/s10546-011-9656-7.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Besson, L., and Coauthors, 2016: Comparison of real-time refractivity measurements by radar with automatic weather stations, AROME-WMED and WRF forecast simulations during SOP1 of the HyMeX campaign. Quart. J. Roy. Meteor. Soc., 142, 138152, https://doi.org/10.1002/qj.2799.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bluestein, H. B., and Coauthors, 2014: Radar in atmospheric sciences and related research: Current systems, emerging technology, and future needs. Bull. Amer. Meteor. Soc., 95, 18501861, https://doi.org/10.1175/BAMS-D-13-00079.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bodine, D., P. L. Heinselman, B. L. Cheong, R. D. Palmer, and D. Michaud, 2010: A case study on the impact of moisture variability on convection initiation using radar refractivity retrievals. J. Appl. Meteor. Climatol., 49, 17661778, https://doi.org/10.1175/2010JAMC2360.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bodine, D., and Coauthors, 2011: Understanding radar refractivity: Sources of uncertainty. J. Appl. Meteor. Climatol., 50, 25432560, https://doi.org/10.1175/2011JAMC2648.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Buban, M. S., C. L. Ziegler, E. N. Rasmussen, and Y. P. Richardson, 2007: The dryline on 22 May 2002 during IHOP: Ground-radar and in situ data analyses of the dryline and boundary layer evolution. Mon. Wea. Rev., 135, 24732505, https://doi.org/10.1175/MWR3453.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Crook, N. A., 1996: Sensitivity of moist convection forced by boundary layer processes to low-level thermodynamic fields. Mon. Wea. Rev., 124, 17671785, https://doi.org/10.1175/1520-0493(1996)124<1767:SOMCFB>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dabberdt, W. F., and T. W. Schlatter, 1996: Research opportunities from emerging atmospheric observing and modeling capabilities. Bull. Amer. Meteor. Soc., 77, 305323, https://doi.org/10.1175/1520-0477(1996)077<0305:ROFEAO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Desroziers, G., L. Berre, B. Chapnik, and P. Poli, 2005: Diagnosis of observation, background and analysis-error statistics in observation space. Quart. J. Roy. Meteor. Soc., 131, 33853396, https://doi.org/10.1256/qj.05.108.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K., and Coauthors, 1995: Report of the first prospectus development team of the U.S. weather research program to NOAA and the NSF. Bull. Amer. Meteor. Soc., 76, 11941208.

    • Search Google Scholar
    • Export Citation
  • Fabry, F., 2004: Meteorological value of ground target measurements by radar. J. Atmos. Oceanic Technol., 21, 560573, https://doi.org/10.1175/1520-0426(2004)021<0560:MVOGTM>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fabry, F., 2006: The spatial variability of moisture in the boundary layer and its effect on convection initiation: Project-long characterization. Mon. Wea. Rev., 134, 7991, https://doi.org/10.1175/MWR3055.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fabry, F., and C. R. Pettet, 2002: A primer to the interpretation of refractivity imagery during IHOP_2002. IHOP_2002 Refractivity Manual, 11 pp., https://archive.eol.ucar.edu/docs/isf/projects/ihop_2002/spol/summary/info/IHOP_N_Manual.pdf.

  • Fabry, F., and J. Sun, 2010: For how long should what data be assimilated for the mesoscale forecasting of convection and why? Part I: On the propagation of initial condition errors and their implications for data assimilation. Mon. Wea. Rev., 138, 242255, https://doi.org/10.1175/2009MWR2883.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fabry, F., C. Frush, I. Zawadzki, and A. Kilambi, 1997: On the extraction of near-surface index of refraction using radar phase measurements from ground targets. J. Atmos. Oceanic Technol., 14, 978987, https://doi.org/10.1175/1520-0426(1997)014<0978:OTEONS>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feng, Y.-C., 2017: The essential problem of radar-estimated refractivity—Quantifying its biases and errors. Ph.D. thesis, McGill University, 103 pp.

  • Feng, Y.-C., and F. Fabry, 2013: Improving the accuracy of near-surface 3-D radar refractivity retrievals. 36th Conf. on Radar Meteorology, Breckenridge, CO, Amer. Meteor. Soc., 151, https://ams.confex.com/ams/36Radar/webprogram/Paper228748.html.

  • Feng, Y.-C., and F. Fabry, 2016: The imperfect phase pattern of real parabolic radar antenna and data quality. J. Atmos. Oceanic Technol., 33, 26552661, https://doi.org/10.1175/JTECH-D-16-0143.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feng, Y.-C., F. Fabry, and T. M. Weckwerth, 2016: Improving radar refractivity retrieval by considering the change in the refractivity profile and the varying altitudes of ground targets. J. Atmos. Oceanic Technol., 33, 9891004, https://doi.org/10.1175/JTECH-D-15-0224.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fisher, M., 2003: Background error covariance modelling. Seminar on Recent Developments in Data Assimilation for Atmosphere and Ocean, Reading, United Kingdom, ECMWF, 45–63, https://www.ecmwf.int/sites/default/files/elibrary/2003/9404-background-error-covariance-modelling.pdf.

  • Fritz, J., and V. Chandrasekar, 2009: Implementation and analysis of networked radar refractivity retrieval. J. Atmos. Oceanic Technol., 26, 21232135, https://doi.org/10.1175/2009JTECHA1182.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gasperoni, N. A., M. Xue, R. D. Palmer, and J. Gao, 2013: Sensitivity of convective initiation prediction to near-surface moisture when assimilating radar refractivity: Impact tests using OSSEs. J. Atmos. Oceanic Technol., 30, 22812302, https://doi.org/10.1175/JTECH-D-12-00038.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ha, S.-Y., and C. Snyder, 2014: Influence of surface observations in mesoscale data assimilation using an ensemble Kalman filter. Mon. Wea. Rev., 142, 14891508, https://doi.org/10.1175/MWR-D-13-00108.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hanley, K. E., D. J. Kirshbaum, S. E. Belcher, N. M. Roberts, and G. Leoncini, 2011: Ensemble predictability of an isolated mountain thunderstorm in a high-resolution model. Quart. J. Roy. Meteor. Soc., 137, 21242137, https://doi.org/10.1002/qj.877.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hao, Y., D. Goeckel, R. Janaswamy, and S. Frasier, 2006: Surface refractive index field estimation from multiple radars. Radio Sci., 41, RS3002, https://doi.org/10.1029/2005RS003288.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hollingsworth, A., and P. Lonnberg, 1986: The statistical structure of short-range forecast errors as determined from radiosonde data. Part I: The wind field. Tellus, 38A, 111136, https://doi.org/10.1111/j.1600-0870.1986.tb00460.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kalnay, E., 2003: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 368 pp.

    • Crossref
    • Export Citation
  • Keeler, R., and S. Ellis, 2000: Observational error covariance matrices for radar data assimilation. Phys. Chem. Earth, 25B, 12771280, https://doi.org/10.1016/S1464-1909(00)00193-3.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Koch, S. E., W. Feltz, F. Fabry, M. Pagowski, B. Geerts, K. M. Bedka, D. O. Miller, and J. W. Wilson, 2008: Turbulent mixing processes in atmospheric bores and solitary waves deduced from profiling systems and numerical simulation. Mon. Wea. Rev., 136, 13731400, https://doi.org/10.1175/2007MWR2252.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Madaus, L. E., and G. J. Hakim, 2016: Observable surface anomalies preceding simulated isolated convective initiation. Mon. Wea. Rev., 144, 22652284, https://doi.org/10.1175/MWR-D-15-0332.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mardia, K. V., 1972: Statistics of Directional Data. Academic Press, 380 pp., https://doi.org/10.1016/C2013-0-07425-7.

    • Crossref
    • Export Citation
  • Montmerle, T., A. Caya, and I. Zawadzki, 2002: Short-term numerical forecasting of a shallow storms complex using bistatic and single-Doppler radar data. Wea. Forecasting, 17, 12111225, https://doi.org/10.1175/1520-0434(2002)017<1211:STNFOA>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nicol, J. C., and A. J. Illingworth, 2013: The effect of phase-correlated returns and spatial smoothing on the accuracy of radar refractivity retrievals. J. Atmos. Oceanic Technol., 30, 2239, https://doi.org/10.1175/JTECH-D-12-00077.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nicol, J. C., A. J. Illingworth, T. Darlington, and M. Kitchen, 2013: Quantifying errors due to frequency changes and target location uncertainty for radar refractivity retrievals. J. Atmos. Oceanic Technol., 30, 20062024, https://doi.org/10.1175/JTECH-D-12-00118.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nicol, J. C., A. J. Illingworth, and K. Bartholomew, 2014: The potential of 1 h refractivity changes from an operational C-band magnetron-based radar for numerical weather prediction validation and data assimilation. Quart. J. Roy. Meteor. Soc., 140, 12091218, https://doi.org/10.1002/qj.2223.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ozturk, S., T.-Y. Yu, L. Ding, R. Palmer, and N. Gasperoni, 2014: Application of compressive sensing to refractivity retrieval using networked weather radars. IEEE Trans. Geosci. Remote Sens., 52, 27992809, https://doi.org/10.1109/TGRS.2013.2266277.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Parent du Chatelet, J., C. Boudjabi, L. Besson, and O. Caumont, 2012: Errors caused by long-term drifts of magnetron frequencies for refractivity measurement with a radar: Theoretical formulation and initial validation. J. Atmos. Oceanic Technol., 29, 14281434, https://doi.org/10.1175/JTECH-D-12-00070.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Park, S., and F. Fabry, 2010: Simulation and interpretation of the phase data used by the radar refractivity retrieval algorithm. J. Atmos. Oceanic Technol., 27, 12861301, https://doi.org/10.1175/2010JTECHA1393.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Parrish, D. F., and J. C. Derber, 1992: The National Meteorological Center’s spectral statistical-interpolation analysis system. Mon. Wea. Rev., 120, 17471763, https://doi.org/10.1175/1520-0493(1992)120<1747:TNMCSS>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roberts, R. D., and Coauthors, 2008: REFRACTT 2006: Real-time retrieval of high-resolution, low-level moisture fields from operational NEXRAD and research radars. Bull. Amer. Meteor. Soc., 89, 15351548, https://doi.org/10.1175/2008BAMS2412.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Seko, H., E.-I. Sato, H. Yamauchi, and T. Tsuda, 2017: Data assimilation experiments of refractivity observed by JMA operational radar. Data Assimilation for Atmospheric, Oceanic and Hydrologic Applications (Vol. III), S. K. Park and L. Xu, Eds., Springer, 327–336, https://doi.org/10.1007/978-3-319-43415-5_14.

    • Crossref
    • Export Citation
  • Stuart, A., and K. Ord, 1986: Distribution Theory. Vol. 1, Kendall’s Advanced Theory of Statistics, 5th ed. Charles Griffin and Company Limited, 604 pp.

  • Sun, J., 2005: Convective-scale assimilation of radar data: Progress and challenges. Quart. J. Roy. Meteor. Soc., 131, 34393463, https://doi.org/10.1256/qj.05.149.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Waller, J. A., D. Simonin, S. L. Dance, N. K. Nichols, and S. P. Ballard, 2016: Diagnosing observation error correlations for Doppler radar radial winds in the Met Office UKV model using observation-minus-background and observation-minus-analysis statistics. Mon. Wea. Rev., 144, 35333551, https://doi.org/10.1175/MWR-D-15-0340.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weber, R. O., 1997: Estimators for the standard deviation of horizontal wind direction. J. Appl. Meteor., 36, 14031415, https://doi.org/10.1175/1520-0450(1997)036<1403:EFTSDO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weckwerth, T. M., T. W. Horst, and J. W. Wilson, 1999: An observational study of the evolution of horizontal convective rolls. Mon. Wea. Rev., 127, 21602179, https://doi.org/10.1175/1520-0493(1999)127<2160:AOSOTE>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weckwerth, T. M., C. R. Pettet, F. Fabry, S. J. Park, M. A. LeMone, and J. W. Wilson, 2005: Radar refractivity retrieval: Validation and application to short-term forecasting. J. Appl. Meteor., 44, 285300, https://doi.org/10.1175/JAM-2204.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WMO, 2015: Statement of guidance for nowcasting and very short range forecasting (VSRF). Tech. Rep., 19 pp., https://www.wmo.int/pages/prog/www/OSY/SOG/SoG-Nowcasting-VSRF.pdf.

  • Zawadzki, I., E. Torlaschi, and R. Sauvageau, 1981: The relationship between mesoscale thermodynamic variables and convective precipitation. J. Atmos. Sci., 38, 15351540, https://doi.org/10.1175/1520-0469(1981)038<1535:TRBMTV>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
Save
  • Besson, L., C. Boudjabi, O. Caumont, and J. Parent du Chatelet, 2012: Links between weather phenomena and characteristics of refractivity measured by precipitation radar. Bound.-Layer Meteor., 143, 7795, https://doi.org/10.1007/s10546-011-9656-7.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Besson, L., and Coauthors, 2016: Comparison of real-time refractivity measurements by radar with automatic weather stations, AROME-WMED and WRF forecast simulations during SOP1 of the HyMeX campaign. Quart. J. Roy. Meteor. Soc., 142, 138152, https://doi.org/10.1002/qj.2799.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bluestein, H. B., and Coauthors, 2014: Radar in atmospheric sciences and related research: Current systems, emerging technology, and future needs. Bull. Amer. Meteor. Soc., 95, 18501861, https://doi.org/10.1175/BAMS-D-13-00079.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bodine, D., P. L. Heinselman, B. L. Cheong, R. D. Palmer, and D. Michaud, 2010: A case study on the impact of moisture variability on convection initiation using radar refractivity retrievals. J. Appl. Meteor. Climatol., 49, 17661778, https://doi.org/10.1175/2010JAMC2360.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bodine, D., and Coauthors, 2011: Understanding radar refractivity: Sources of uncertainty. J. Appl. Meteor. Climatol., 50, 25432560, https://doi.org/10.1175/2011JAMC2648.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Buban, M. S., C. L. Ziegler, E. N. Rasmussen, and Y. P. Richardson, 2007: The dryline on 22 May 2002 during IHOP: Ground-radar and in situ data analyses of the dryline and boundary layer evolution. Mon. Wea. Rev., 135, 24732505, https://doi.org/10.1175/MWR3453.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Crook, N. A., 1996: Sensitivity of moist convection forced by boundary layer processes to low-level thermodynamic fields. Mon. Wea. Rev., 124, 17671785, https://doi.org/10.1175/1520-0493(1996)124<1767:SOMCFB>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dabberdt, W. F., and T. W. Schlatter, 1996: Research opportunities from emerging atmospheric observing and modeling capabilities. Bull. Amer. Meteor. Soc., 77, 305323, https://doi.org/10.1175/1520-0477(1996)077<0305:ROFEAO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Desroziers, G., L. Berre, B. Chapnik, and P. Poli, 2005: Diagnosis of observation, background and analysis-error statistics in observation space. Quart. J. Roy. Meteor. Soc., 131, 33853396, https://doi.org/10.1256/qj.05.108.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Emanuel, K., and Coauthors, 1995: Report of the first prospectus development team of the U.S. weather research program to NOAA and the NSF. Bull. Amer. Meteor. Soc., 76, 11941208.

    • Search Google Scholar
    • Export Citation
  • Fabry, F., 2004: Meteorological value of ground target measurements by radar. J. Atmos. Oceanic Technol., 21, 560573, https://doi.org/10.1175/1520-0426(2004)021<0560:MVOGTM>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fabry, F., 2006: The spatial variability of moisture in the boundary layer and its effect on convection initiation: Project-long characterization. Mon. Wea. Rev., 134, 7991, https://doi.org/10.1175/MWR3055.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fabry, F., and C. R. Pettet, 2002: A primer to the interpretation of refractivity imagery during IHOP_2002. IHOP_2002 Refractivity Manual, 11 pp., https://archive.eol.ucar.edu/docs/isf/projects/ihop_2002/spol/summary/info/IHOP_N_Manual.pdf.

  • Fabry, F., and J. Sun, 2010: For how long should what data be assimilated for the mesoscale forecasting of convection and why? Part I: On the propagation of initial condition errors and their implications for data assimilation. Mon. Wea. Rev., 138, 242255, https://doi.org/10.1175/2009MWR2883.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fabry, F., C. Frush, I. Zawadzki, and A. Kilambi, 1997: On the extraction of near-surface index of refraction using radar phase measurements from ground targets. J. Atmos. Oceanic Technol., 14, 978987, https://doi.org/10.1175/1520-0426(1997)014<0978:OTEONS>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feng, Y.-C., 2017: The essential problem of radar-estimated refractivity—Quantifying its biases and errors. Ph.D. thesis, McGill University, 103 pp.

  • Feng, Y.-C., and F. Fabry, 2013: Improving the accuracy of near-surface 3-D radar refractivity retrievals. 36th Conf. on Radar Meteorology, Breckenridge, CO, Amer. Meteor. Soc., 151, https://ams.confex.com/ams/36Radar/webprogram/Paper228748.html.

  • Feng, Y.-C., and F. Fabry, 2016: The imperfect phase pattern of real parabolic radar antenna and data quality. J. Atmos. Oceanic Technol., 33, 26552661, https://doi.org/10.1175/JTECH-D-16-0143.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feng, Y.-C., F. Fabry, and T. M. Weckwerth, 2016: Improving radar refractivity retrieval by considering the change in the refractivity profile and the varying altitudes of ground targets. J. Atmos. Oceanic Technol., 33, 9891004, https://doi.org/10.1175/JTECH-D-15-0224.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fisher, M., 2003: Background error covariance modelling. Seminar on Recent Developments in Data Assimilation for Atmosphere and Ocean, Reading, United Kingdom, ECMWF, 45–63, https://www.ecmwf.int/sites/default/files/elibrary/2003/9404-background-error-covariance-modelling.pdf.

  • Fritz, J., and V. Chandrasekar, 2009: Implementation and analysis of networked radar refractivity retrieval. J. Atmos. Oceanic Technol., 26, 21232135, https://doi.org/10.1175/2009JTECHA1182.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gasperoni, N. A., M. Xue, R. D. Palmer, and J. Gao, 2013: Sensitivity of convective initiation prediction to near-surface moisture when assimilating radar refractivity: Impact tests using OSSEs. J. Atmos. Oceanic Technol., 30, 22812302, https://doi.org/10.1175/JTECH-D-12-00038.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ha, S.-Y., and C. Snyder, 2014: Influence of surface observations in mesoscale data assimilation using an ensemble Kalman filter. Mon. Wea. Rev., 142, 14891508, https://doi.org/10.1175/MWR-D-13-00108.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hanley, K. E., D. J. Kirshbaum, S. E. Belcher, N. M. Roberts, and G. Leoncini, 2011: Ensemble predictability of an isolated mountain thunderstorm in a high-resolution model. Quart. J. Roy. Meteor. Soc., 137, 21242137, https://doi.org/10.1002/qj.877.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hao, Y., D. Goeckel, R. Janaswamy, and S. Frasier, 2006: Surface refractive index field estimation from multiple radars. Radio Sci., 41, RS3002, https://doi.org/10.1029/2005RS003288.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hollingsworth, A., and P. Lonnberg, 1986: The statistical structure of short-range forecast errors as determined from radiosonde data. Part I: The wind field. Tellus, 38A, 111136, https://doi.org/10.1111/j.1600-0870.1986.tb00460.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kalnay, E., 2003: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 368 pp.

    • Crossref
    • Export Citation
  • Keeler, R., and S. Ellis, 2000: Observational error covariance matrices for radar data assimilation. Phys. Chem. Earth, 25B, 12771280, https://doi.org/10.1016/S1464-1909(00)00193-3.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Koch, S. E., W. Feltz, F. Fabry, M. Pagowski, B. Geerts, K. M. Bedka, D. O. Miller, and J. W. Wilson, 2008: Turbulent mixing processes in atmospheric bores and solitary waves deduced from profiling systems and numerical simulation. Mon. Wea. Rev., 136, 13731400, https://doi.org/10.1175/2007MWR2252.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Madaus, L. E., and G. J. Hakim, 2016: Observable surface anomalies preceding simulated isolated convective initiation. Mon. Wea. Rev., 144, 22652284, https://doi.org/10.1175/MWR-D-15-0332.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mardia, K. V., 1972: Statistics of Directional Data. Academic Press, 380 pp., https://doi.org/10.1016/C2013-0-07425-7.

    • Crossref
    • Export Citation
  • Montmerle, T., A. Caya, and I. Zawadzki, 2002: Short-term numerical forecasting of a shallow storms complex using bistatic and single-Doppler radar data. Wea. Forecasting, 17, 12111225, https://doi.org/10.1175/1520-0434(2002)017<1211:STNFOA>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nicol, J. C., and A. J. Illingworth, 2013: The effect of phase-correlated returns and spatial smoothing on the accuracy of radar refractivity retrievals. J. Atmos. Oceanic Technol., 30, 2239, https://doi.org/10.1175/JTECH-D-12-00077.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nicol, J. C., A. J. Illingworth, T. Darlington, and M. Kitchen, 2013: Quantifying errors due to frequency changes and target location uncertainty for radar refractivity retrievals. J. Atmos. Oceanic Technol., 30, 20062024, https://doi.org/10.1175/JTECH-D-12-00118.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nicol, J. C., A. J. Illingworth, and K. Bartholomew, 2014: The potential of 1 h refractivity changes from an operational C-band magnetron-based radar for numerical weather prediction validation and data assimilation. Quart. J. Roy. Meteor. Soc., 140, 12091218, https://doi.org/10.1002/qj.2223.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ozturk, S., T.-Y. Yu, L. Ding, R. Palmer, and N. Gasperoni, 2014: Application of compressive sensing to refractivity retrieval using networked weather radars. IEEE Trans. Geosci. Remote Sens., 52, 27992809, https://doi.org/10.1109/TGRS.2013.2266277.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Parent du Chatelet, J., C. Boudjabi, L. Besson, and O. Caumont, 2012: Errors caused by long-term drifts of magnetron frequencies for refractivity measurement with a radar: Theoretical formulation and initial validation. J. Atmos. Oceanic Technol., 29, 14281434, https://doi.org/10.1175/JTECH-D-12-00070.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Park, S., and F. Fabry, 2010: Simulation and interpretation of the phase data used by the radar refractivity retrieval algorithm. J. Atmos. Oceanic Technol., 27, 12861301, https://doi.org/10.1175/2010JTECHA1393.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Parrish, D. F., and J. C. Derber, 1992: The National Meteorological Center’s spectral statistical-interpolation analysis system. Mon. Wea. Rev., 120, 17471763, https://doi.org/10.1175/1520-0493(1992)120<1747:TNMCSS>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roberts, R. D., and Coauthors, 2008: REFRACTT 2006: Real-time retrieval of high-resolution, low-level moisture fields from operational NEXRAD and research radars. Bull. Amer. Meteor. Soc., 89, 15351548, https://doi.org/10.1175/2008BAMS2412.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Seko, H., E.-I. Sato, H. Yamauchi, and T. Tsuda, 2017: Data assimilation experiments of refractivity observed by JMA operational radar. Data Assimilation for Atmospheric, Oceanic and Hydrologic Applications (Vol. III), S. K. Park and L. Xu, Eds., Springer, 327–336, https://doi.org/10.1007/978-3-319-43415-5_14.

    • Crossref
    • Export Citation
  • Stuart, A., and K. Ord, 1986: Distribution Theory. Vol. 1, Kendall’s Advanced Theory of Statistics, 5th ed. Charles Griffin and Company Limited, 604 pp.

  • Sun, J., 2005: Convective-scale assimilation of radar data: Progress and challenges. Quart. J. Roy. Meteor. Soc., 131, 34393463, https://doi.org/10.1256/qj.05.149.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Waller, J. A., D. Simonin, S. L. Dance, N. K. Nichols, and S. P. Ballard, 2016: Diagnosing observation error correlations for Doppler radar radial winds in the Met Office UKV model using observation-minus-background and observation-minus-analysis statistics. Mon. Wea. Rev., 144, 35333551, https://doi.org/10.1175/MWR-D-15-0340.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weber, R. O., 1997: Estimators for the standard deviation of horizontal wind direction. J. Appl. Meteor., 36, 14031415, https://doi.org/10.1175/1520-0450(1997)036<1403:EFTSDO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weckwerth, T. M., T. W. Horst, and J. W. Wilson, 1999: An observational study of the evolution of horizontal convective rolls. Mon. Wea. Rev., 127, 21602179, https://doi.org/10.1175/1520-0493(1999)127<2160:AOSOTE>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weckwerth, T. M., C. R. Pettet, F. Fabry, S. J. Park, M. A. LeMone, and J. W. Wilson, 2005: Radar refractivity retrieval: Validation and application to short-term forecasting. J. Appl. Meteor., 44, 285300, https://doi.org/10.1175/JAM-2204.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WMO, 2015: Statement of guidance for nowcasting and very short range forecasting (VSRF). Tech. Rep., 19 pp., https://www.wmo.int/pages/prog/www/OSY/SOG/SoG-Nowcasting-VSRF.pdf.

  • Zawadzki, I., E. Torlaschi, and R. Sauvageau, 1981: The relationship between mesoscale thermodynamic variables and convective precipitation. J. Atmos. Sci., 38, 15351540, https://doi.org/10.1175/1520-0469(1981)038<1535:TRBMTV>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fig. 1.

    The data processing flowchart of obtaining near-surface refractivity from radar measurements (Fabry and Pettet 2002).

  • Fig. 2.

    (a)–(c) Distribution of the correlation coefficients ρ of different combinations of phase time series observed from the McGill radar within a 50-km radius during 1100–1400 UTC (UTC = LST + 4 h) 30 Oct 2012. (a) Correlation coefficients between data at two low elevations angles , 0.3° and 0.5°. (b) Correlation coefficients between horizontal and vertical polarization at 0.3° elevation. (c) Autocorrelation of phase time series at horizontal polarization and at 0.3° elevation. (d)–(f) Histograms of each correlation shown in (a)–(c) for data within a 50-km range.

  • Fig. 3.

    Relationship between average wind speed from surface stations and areal-average (red circles), (blue triangles), and (black crosses). The average ρ is calculated from the data within a 62.5-km radius of McGill radar. The time period of this dataset is from 20 to 31 Aug 2012.

  • Fig. 4.

    Correlation coefficient ρ between two time series of phase measurements having a random noise with a standard deviation . Multiple simulations have been done with varying (blue dots). A fitted Gaussian relation is also shown (red). Note that only simulations with ρ greater than 1/e (green dashed line) are used in the regression, because there is no clear skill in connecting ρ and when ρ is less than 1/e.

  • Fig. 5.

    Illustration of the results of the simulation of errors in estimated refractivity. (a) Correlation coefficient of phases at two elevations . (b) Error of refractivity obtained from one simulation of the noisy phases perturbed based on (a). (c) Mean of based on 30 simulations of randomly perturbed noisy phases based on Gaussian statistics with a mean of zero and the assigned of given . (d) Standard deviation of based on 30 simulations.

  • Fig. 6.

    Relationship between the mean and the areal fraction of higher-quality ground targets (; i.e., with the phase errors less than 45°) within an area of 5° in azimuth by 4 km in range. The total area considered here is a range from 20 to 40 km from the radar in Fig. 5.

  • Fig. 7.

    Examination of associated with the uncertainties of the height difference between the radar and the targets under given changes in . (a) Height difference (, m) between the terrain in the Montreal area and the McGill radar. The targets here are assumed at the height of the terrain. The origin is the location of the radar, and the black rings show the radial distances of 20 and 40 km, respectively. (b) The standard deviation of based on 30 simulations, when is randomly perturbed within ±10 m.

  • Fig. A1.

    Maps of the horizontal correlation between the errors in refractivity over the McGill radar site (black star) and that of (a) refractivity, (b) specific humidity, and (c) temperature in the rest of the domain from the REPS ensemble model outputs.

  • Fig. A2.

    Autocorrelation of the refractivity error at the first level of the model for two times: (a) 1200 UTC (early morning local time) and (b) 0000 UTC (late afternoon local time). Each small grid is 4° of latitude and longitude.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 320 93 7
PDF Downloads 297 57 7