Real-Time Radar Rainfall Estimation. Part I: Algorithm Formulation

Emmanouil N. Anagnostou Iowa Institute of Hydraulic Research, University of Iowa, Iowa City, Iowa

Search for other papers by Emmanouil N. Anagnostou in
Current site
Google Scholar
PubMed
Close
and
Witold F. Krajewski Iowa Institute of Hydraulic Research, University of Iowa, Iowa City, Iowa

Search for other papers by Witold F. Krajewski in
Current site
Google Scholar
PubMed
Close
Full access

Abstract

A multicomponent radar-based algorithm for real-time precipitation estimation is developed. The algorithm emphasizes the combined use of weather radar observations and in situ rain gauge rainfall measurements. The temporal and spatial scales of interest are hourly to storm-total accumulations for areas of 4 km2 to approximately 16 km2. The processing steps include beam–height-effect correction, vertical integration, convective–stratiform classification, conversion from radar observables to rainfall rate, range-effect correction, and transformation of the estimated rainfall rates from polar coordinates to a Cartesian grid. Additionally, the algorithm applies advection correction to the gridded rainfall rates to minimize the temporal sampling effect and, subsequently, aggregates the corrected rainfall rates to 1-hourly, 3-hourly, and storm-total accumulations. The system applies different parameter values for convective and stratiform regimes. The calibration of the system is formulated as a global optimization problem, which is solved using the Gauss–Newton adaptive stochastic method. The algorithm is cast in a recursive formulation with parameters adjusted in real time. Evaluation of the system is based on an extensive dataset from the Melbourne, Florida, WSR-88D radar site.

* Current affiliation: Department of Civil and Environmental Engineering, University of Connecticut, Storrs, Connecticut.

Corresponding author address: Dr. Emmanouil N. Anagnostou, University of Connecticut, 261 Glenbrook Road, U-37, Storrs, CT 06269.

Abstract

A multicomponent radar-based algorithm for real-time precipitation estimation is developed. The algorithm emphasizes the combined use of weather radar observations and in situ rain gauge rainfall measurements. The temporal and spatial scales of interest are hourly to storm-total accumulations for areas of 4 km2 to approximately 16 km2. The processing steps include beam–height-effect correction, vertical integration, convective–stratiform classification, conversion from radar observables to rainfall rate, range-effect correction, and transformation of the estimated rainfall rates from polar coordinates to a Cartesian grid. Additionally, the algorithm applies advection correction to the gridded rainfall rates to minimize the temporal sampling effect and, subsequently, aggregates the corrected rainfall rates to 1-hourly, 3-hourly, and storm-total accumulations. The system applies different parameter values for convective and stratiform regimes. The calibration of the system is formulated as a global optimization problem, which is solved using the Gauss–Newton adaptive stochastic method. The algorithm is cast in a recursive formulation with parameters adjusted in real time. Evaluation of the system is based on an extensive dataset from the Melbourne, Florida, WSR-88D radar site.

* Current affiliation: Department of Civil and Environmental Engineering, University of Connecticut, Storrs, Connecticut.

Corresponding author address: Dr. Emmanouil N. Anagnostou, University of Connecticut, 261 Glenbrook Road, U-37, Storrs, CT 06269.

1. Introduction

A main objective of the National Weather Service’s Next Generation Weather Radar (NEXRAD) program is to provide, in real time, accurate quantitative precipitation estimates from a network of weather radars (Heiss et al. 1990; Klazura and Imy 1993). These estimates primarily support flash flood forecasting at Weather Forecast Offices, river-stage forecasts at River Forecast Centers, and numerical weather prediction models at the National Centers for Environmental Prediction (Hudlow 1988). For this purpose, a radar rainfall estimation algorithm, named Precipitation Processing Subsystem (PPS), has been designed to provide rainfall fields at different spatial (1° × 2 km up to 4 km × 4 km grid boxes) and temporal scales (1-hourly, 3-hourly, and storm-total accumulations) of aggregation from reflectivity data (Hudlow et al. 1991; Seo et al. 1995; Fulton et al. 1998).

Recent studies by Seo et al. (1995), Smith et al. (1996), Anagnostou and Krajewski (1999), and Anagnostou et al. (1998) show that PPS has not reached its potential in providing accurate rainfall estimates. First, PPS operates with a default set of parameters that are not optimal and do not account for the regional and seasonal rainfall regime differences. Second, there is mean-field systematic underestimation with respect to rain gauge rainfall. Third, there are radar calibration problems that create significant rainfall estimation differences in radar-to-radar comparisons. Finally, Smith et al. (1996) and Seo et al. (1995) show significant range-dependent biases. For example, they show in the cold season (October–March), up to 100% overestimation (underestimation) for radar ranges between 50 and 80 km (>100 km). They also show up to 150% underestimation for close ranges (<50 km), which is attributed to the hybrid-scan construction strategy of the PPS.

This research, inspired by the PPS design, focuses on issues related to the improvement of the accuracy of real-time quantitative precipitation estimation by radar. We attempt to answer several fundamental questions. Is improvement in real-time radar rainfall estimation possible? If so, how significant can this be? How does the algorithm performance depend on radar range? What are the most appropriate space–timescales of aggregation for the algorithm parameter selection? To answer these questions, several existing and herein proposed methodologies are formulated into an integrated precipitation processing system for real-time radar rainfall estimation. The new system includes hybrid scan construction from multiple-tilt radar observations, real-time rainfall regime classification, reflectivity-to-rainfall rate (Z–R) conversion, mean-field, and range-dependent systematic error correction, advection correction of the final gridded rainfall products, and recursive parameter estimation.

Special attention is paid to the uncertainty of the Z–R conversion, which can be potentially reduced by applying different Z–R relationships based on real-time convective–stratiform classification. Rain classification also offers potential for range-effect correction according to storm morphology. Investigations of rainfall classification effects were carried out by Steiner et al. (1995), Rosenfeld et al. (1995), and Ciach et al. (1997), among others. These studies, which concentrated on daily-to-monthly timescales of aggregation, showed negligible improvement in radar rainfall accuracy by applying rainfall classification. However, we believe that this was a temporal resolution problem. In this research, classification is investigated at a finer timescale (hourly accumulations).

Another important aspect of this study is the calibration of the algorithm. The parameters are estimated in real time, which is a completely different approach than the conventional data-fitting exercises done in the past (Battan 1973). The problem is solved by optimizing a selected rainfall product quality criterion (objective function). This procedure estimates the system’s parameters, simultaneously accounting for their possible interactions. It is designed to handle difficulties such as the high dimensionality and nonlinear structure of the system, feedback and system memory, and the high cost of computing the objective function. These features make the use of standard optimization techniques infeasible. We propose the use of a recursive stochastic optimization approach (Ljung and Soderstrom 1981), combined with highly efficient data preprocessing (Anagnostou and Krajewski 1999).

The algorithm also includes a mean-field bias model for real-time adjustment of the systematic rainfall estimation error. Mean-field bias is modeled as a state–space stochastic–dynamic system (Anagnostou et al. 1998). State estimates are obtained on an hourly basis from corresponding rain gauge and radar rainfall accumulations. Bias estimations and 1-h-ahead predictions are based on Kalman filter equations (Gelb 1974), which optimally combine observations and model estimates, taking into account uncertainties associated with both. This bias adjustment scheme, although conceptually similar to the PPS (both schemes use Kalman filter equations), employs a different method for evaluating the Kalman filter’s model and observation error variances. Data-based Monte Carlo simulation experiments, performed by Anagnostou et al. (1998), showed that the proposed bias prediction algorithm was unbiased and outperformed the PPS bias scheme at different scales (1-hourly, 3-hourly, and 6-hourly accumulations) and seasons [warm (May–October) and cold (November–April)].

Other important features of our algorithm are the following. First, a beam–height-effect correction is applied at the level of raw volume scan reflectivity data. Second, an advection correction is used to estimate rainfall accumulations. Correcting for beam–height effect, in real time, is particularly important for events with strong vertical reflectivity gradients (i.e., bright band). Our algorithm uses a mean-field vertical reflectivity profile-based technique, proposed by Andrieu and Creutin (1995), for reducing the beam–height effect due to brightband and snow region sampling. The advection correction procedure uses velocity fields that are calculated based on a modified cross-correlation method (Bellon et al. 1991).

We present development of the algorithm and its testing as a two-paper series. This paper is organized as follows. Detailed description of the algorithm’s components is provided in section 2. In section 3, we discuss the parameter estimation procedure. We summarize the proposed algorithm in section 4. The paper includes two appendixes. Appendix A describes the advection correction scheme, and appendix B presents the Gauss–Newton adaptive stochastic optimization method. The results of the algorithm implementation and performance demonstration are described in the companion paper (Anagnostou and Krajewski 1999).

2. Algorithm description

a. Algorithm summary

The purpose of the proposed algorithm is to produce real-time 1-hourly, 3-hourly, and storm-total rainfall accumulation maps based on volume scan radar reflectivity measurements. The algorithm satisfies the following general features. First, it provides unbiased hourly rainfall estimates. Second, it accepts external information, that is, rain gauge observations in real time. Third, it is formulated in a general way, parameterized to adjust to seasonal and geographic rainfall regime variations. Finally, its calibration, performed in real time, forces statistical consistency and convergence for the parameter values.

The algorithm produces rainfall maps in the Hydrologic Rainfall Analysis Project (HRAP) coordinates (Fulton et al. 1998), which cover a range of 200 km and have spatial resolution of approximately 16 km2. The aforementioned spatiotemporal scale is based on WSR-88D operational product requirements. The structure of the algorithm’s processing components is described herein.

The first step in the algorithm is a beam–height correction based on a mean vertical reflectivity profile (VRP) method, activation of which depends on the type of the precipitation system. The second step is construction of a hybrid radar reflectivity observation map by integrating the two lowest sweeps. The hybrid map reflectivities are classified into two types, convective and stratiform, and are converted to rainfall rates by applying the Z–R transformation and range-effect correction. The Z–R transformation and range correction use different parameter values for each precipitation type. Every time a volume scan is collected, the algorithm produces the scan-to-scan rainfall accumulations. These accumulations are interpolated from polar coordinates to a 2 km × 2 km Cartesian grid, corrected for advection, accumulated to form hourly rainfall, and subsequently projected to the HRAP grid plane. The HRAP gridded hourly rainfall accumulations are corrected for mean-field systematic errors. Every so often, when an adequate number of rain gauge observations are available, the algorithm updates its parameter values using an adaptive global optimization scheme. Three-hourly and storm-total accumulations are constructed from the hourly maps.

b. Vertical reflectivity profile effect correction

A vertical reflectivity gradient is created when the phase or intensity of precipitation changes with height. If this gradient is strong, radar measurements, which are taken at high elevations (1–4 km) in the atmosphere, are not representative of surface rainfall. Interaction between droplets, updrafts and downdrafts, evaporation and accretion of drops under the cloud base, and mixed-phase precipitation (bright band) are the physical causes that can create strong gradients in the vertical reflectivity profile. Studies related to this problem have been reported by Zawadzki (1984), Austin (1987), Joss and Waldvogel (1990), and Kitchen and Jackson (1993), among others.

The beam–height effect due to VRP is particularly important in radar measurements of stratiform precipitation systems. The VRP of these systems results in radar underestimation or overestimation of rainfall depending on the range from the radar (e.g., Joss and Waldvogel 1990; Kitchen and Jackson 1993). The main factors for this beam–height effect are 1) strong reflectivity enhancement at ranges in which the beam intercepts the melting layer (bright band), 2) reflectivity reduction when the beam samples the snow region, and 3) nondetection at far ranges in which the beam overshoots the cloud tops. The influence of bright band is significant, resulting in overestimation up to a factor of 10, at which the zero isotherm is at low altitudes relative to the radar (see Smith et al. 1996). Partial detection and nondetection are important in cases of low-top precipitating clouds (e.g., widespread precipitation, warm rain processes, and orographic enhancement processes) and in cases in which the beam is at a far range from the radar (i.e., >150 km).

This algorithm is particularly effective in correcting beam–height effects due to strong VRP gradients. Such gradients can originate from strong reflectivity enhancements due to bright band in midlatitude stratiform clouds and from range degradation of reflectivity due to partial beamfilling in widespread precipitation systems (Seo et al. 1996). The procedure uses mean VRP values determined in real time (Andrieu and Creutin 1995). The attractive features of this procedure include the use of 1) the Kalman filter inverse method to deduce mean VRP from observed ratio curves (the ratio of reflectivities from two sweeps at discrete ranges from the radar) and 2) the radar beam geometry in the construction of the beam–height correction function.

A limitation of this procedure is the assumption of spatial uniformity of VRP. As a result, application to precipitation systems with spatially varying reflectivity profiles (i.e., squall lines, tropical convective storms, and midlatitude convective systems, etc.) would introduce additional uncertainty to the radar rainfall estimates. Therefore, the VRP correction method is deactivated in these cases. Instead, a simpler procedure, which uses a climatologically based range-effect correction formula, is applied to the rainfall rates at the 1° × 1 km scale. The procedure is discussed in section 2e.

On the other hand, widespread stratiform precipitation systems, whose dominant vertical structure (brightband) is less spatially variable, should be better predicted by this technique. A simulation study by Borga et al. (1997) has shown that, for these systems, mean VRP-based beam–height corrections can significantly [∼40% root-mean-square error (rmse) reduction] reduce the error due to bright band. Little improvement (less than 10% rmse reduction) was shown, though, at distances beyond the range in which the 0° isotherm intercepts the radar beam and in which the 0° isotherm is at high altitudes (>3 km).

c. Hybrid reflectivity scan construction

After the raw volume scan reflectivity data have been corrected for the beam–height effect, the algorithm produces a hybrid reflectivity map that consists of a weighted averaging of reflectivities from the two lowest sweeps. The following formulas are used to calculate the weights applied to each sweep:
i1520-0426-16-2-189-e1
and
i1520-0426-16-2-189-e2
where W0 and W1 are the first and second sweep’s reflectivity weights, respectively; S is the distance (km) of the radar cell from the radar; and Sx (km) is the range beyond which only the first sweep’s reflectivities are used in the hybrid scan construction. The range Sx is defined as a parameter.

Vertical reflectivity integration has the following two justifications. First, it is expected to reduce the high temporal and spatial variability of the radar data. Second, it includes the algorithm information relevant to surface rainfall accumulation (Green and Clark 1972; Ciach et al. 1997). The weighted averaging is performed to provide a smooth transition between the two lower sweeps. Note that the presented formulation is not applicable to radar operations in mountainous regions in which portions of the lower beam may be embedded in the terrain. In such situations, different schemes, which account for the whole volume scan information (Joss and Lee 1995), may be more appropriate.

d. Classification of reflectivity measurements

Many studies in the past (e.g., Atlas and Chmela 1957; Zawadzki 1984; Austin 1987; Smith and Krajewski 1993) have shown significant variability in the relationship between radar reflectivity and surface rainfall rate. This variability sources from differences in the microphysical properties and vertical structure of raining clouds associated with different precipitation systems. These systems can be distinguished based on geographic location (tropical, maritime, continental, orographic, and warm rain processes, etc.), season (warm, cold), and precipitation type (convective, stratiform).

Classification of reflectivity measurements associated with the aforementioned precipitation systems, prior to their conversion to rainfall rate, has strong physical and observational justification. Houze (1993), using cloud models and radar observations, presents significant differences in the microphysical properties and vertical structure of raining clouds associated with convective and stratiform regimes. Also, Tokay and Short (1996) show significant differences in the multiplier coefficient of the Z–R relationship associated with convective and stratiform rain types. Anagnostou and Kummerow (1997) show that convective and stratiform clouds have a different effect on the spatial variability of the 85-GHz microwave brightness temperature observed by satellites. It is expected that uncertainty in the Z–R conversion can potentially be reduced by applying different Z–R relationships for different precipitation systems, seasons, and types.

A modified form of the approach presented by Steiner et al. (1995) is used to classify instantaneous reflectivity patterns to convective and stratiform origin. The original approach uses the instantaneous horizontal radar reflectivity patterns, and the reflectivity itself, as predictors of the echo type. This algorithm has been evaluated objectively based on radar reflectivity fields taken from a shipborne radar during the Tropical Ocean Global Atmosphere Coupled Ocean–Atmosphere Response Experiment (Kucera et al. 1996). Modification of this technique consists of applying the classification results at the instantaneous volume scan reflectivities. First, the reflectivities in polar coordinates are interpolated to a 2 km × 2 km Cartesian grid. Second, the algorithm by Steiner et al. (1995) is used to classify the gridded reflectivity values. Third, the gridded classification map is converted to the radar’s polar coordinate system. Based on this coordinate transformation, each radar cell’s reflectivity value is assigned a convective–stratiform index.

Reports from other radar rainfall studies regarding this classification scheme did not show any significant benefit to radar rainfall estimation (Ciach et al. 1997; Steiner and Houze 1996; Yuter and Houze 1996). However, these studies concerned a very specific precipitation system (i.e., tropical oceanic convection) and much higher temporal scales (i.e., daily to monthly accumulations). The question of how well this technique can apply to hourly scales of aggregation in continental mesoscale systems is still open for research.

e. Conversion of reflectivities to rainfall rates

The reflectivities of the hybrid reflectivity map, which exceed a specified minimum reflectivity threshold (Zmin), are converted to rainfall rates through the following nonlinear operation:
i1520-0426-16-2-189-e3
where Zp and Rp are the corresponding integrated reflectivity (mm6 m−3) and rainfall rate (mm h−1) values at hour s, scan t, radar cell azimuth θ, and range r (km);A and B are the Z–R relationship parameters, which correspond to the conventional Z–R relationship form.

Note that reflectivity values greater than a maximum reflectivity threshold (Zmax) are assigned the maximum reflectivity value. This procedure is similar to PPS and is considered a quick and inexpensive way to reduce the hail contamination effect (Austin 1987).

In cases of mesoscale convective systems and tropical storms, a climatologically based range-effect correction procedure is applied. (In these types of storms, beam–height correction based on the mean VRP-based method is not applied.) The range-effect procedure uses different parameterization for convective and stratiform rain types. The range-effect-correction equations for these types are given below:
i1520-0426-16-2-189-e4
where bc is a parameter that differentiates the convective and stratiform multipliers of the Z–R relationship. Parameters Arc and Ars control the range correction applied to the rainfall estimates of the convective and stratiform types, respectively. Both classification (bc) and range-correction (Arc, Ars) parameters are applied uniformly across the radar domain. In Eq. (4), S0 equals 200 km, which is the algorithm’s effective radar range for rainfall estimation.

f. Rainfall products generation

The instantaneous rainfall-rate maps are used to compute the scan-to-scan and hourly accumulation maps. First, the instantaneous maps in polar coordinates are interpolated to a large domain (400 km × 400 km) Cartesian grid with a 2 km × 2 km pixel resolution. The spatial interpolation is performed by dividing the radar sampling volume into many elementary subdivisions along the azimuth and then taking the average rainfall rates for those that project into the Cartesian pixels. This approach is fully parameterized to handle any combination of radar characteristics and Cartesian field specifications. The transformation is performed with the use of lookup tables to accelerate the conversion.

The next step is to create the scan-to-scan accumulation map from two consecutive instantaneous maps. A typical way (i.e., PPS) of doing so is by averaging the corresponding values of the two maps. However, recent studies (e.g., Bellon et al. 1991; Liu and Krajewski 1996) have shown that in cases of fast-moving storms the temporal sampling effect of the radar observations can lead to significant errors in the estimated rainfall accumulation maps. Our algorithm uses a temporal interpolation scheme (advection correction procedure) that accounts for the shift of rainfall patterns between consecutive radar rainfall maps. This advection correction procedure converts the two consecutive radar rainfall maps into a scan-to-scan accumulation. Details about the advection correction procedure are provided in appendix A. Note that advection correction is not applied when the time between the consecutive scans is greater than 30 min. This time interval is selected following previous studies, suggesting that the error tolerance of statistical extrapolation techniques is significant at larger time lags (Fabry et al. 1994). When the sampling interval exceeds 30 min, the algorithm follows a procedure, similar to the PPS, that flags the excess time period, centered midway between the two scan times, as a missing period. The incremental period accumulations, 15 min before and after the missing period, are computed using the corresponding single-scan rain-rate maps.

Subsequently, the hourly accumulation rainfall maps are computed by summing the scan-to-scan accumulations from the incremental periods falling within the hour. Note that if the missing periods within an hour are more than a certain threshold (10 min), then no accumulation is computed for this hour. From the hourly accumulations, the algorithm computes the 3-hourly and storm-total accumulations.

Finally, the accumulations in Cartesian coordinates are projected to the HRAP grid plane [otherwise known as 1/40th Limited Fine Mesh (LFM) grid], which is used for the entire National Weather Service River Forecasting System operational system within the Office of Hydrology of the National Weather Service. The LFM grid is a limited polar-stereographic projection and covers essentially the coterminous (i.e., lower 48) United States, plus some surrounding territory.

g. Mean-field systematic error adjustment

The mean-field systematic error (bias) adjustment is applied to the final (i.e., HRAP grid) hourly rainfall products. The decision of applying range correction (4), prior to mean-field bias adjustment, is supported by recent studies based on NEXRAD radar rainfall products (Seo et al. 1995). Mean-field bias adjustment is applied by scaling the rainfall accumulations by a constant factor (Bs):
As, jAcs, jBs
where Ac and A (mm h−1) are the hourly rainfall accumulations at hour s and HRAP pixel j before and after the bias adjustment, respectively. The bias adjustment factor Bs is estimated based on an hourly mean-field bias model described herein.
The bias governing equation is
βsβs−1Ws
where βs is the loge–bias, and WsN(0, Q) is the model error that is a normally distributed random variable with zero mean and variance Q. The model error Ws accounts for mean-field bias fluctuations, which are due mainly to temporal variations in the hydrometeors’ size distribution and the transmitted beam power. The bias and the data are linked by the observation equation
YsβsMs
where Ys is the natural logarithm of the observed bias at hour s:
i1520-0426-16-2-189-e8
where Rg is the rain gauge hourly rainfall accumulation, j is the rain gauge index, and Ng is the total number of rain gauges under the radar umbrella. It should be noted that bias is computed only from the common radar–rain gauge pairs. Therefore, one should expect significant bias observation error due to limited sampling of the rain gauge network. Anagnostou et al. (1998) have shown that for a typical rain gauge network density (i.e., 30–40 gauges within a 200-km radius from the radar) the bias observation sampling error variance can be up to 300% of the mean bias, depending on the season and precipitation type. In this study, the observation error Ms is defined as a normally distributed variable with zero mean and variance RM.
The loge-bias prediction and update are based on Kalman filter equations (Gelb 1974). The Kalman filter requires specification of two unknown parameters: the model error variance Q and the observation error variance RM. These parameters are adjusted recursively so that the Kalman filter’s innovation sequence becomes uncorrelated. Innovations are the differences between predicted and observed biases and are uncorrelated if the Kalman filter works optimally (Mehra 1972; Anagnostou et al. 1998). If the initial estimates of Q and RM lead to a correlated innovation sequence, a number of steps are followed, based on a procedure by Mehra (1972), to obtain better estimates of Q and RM. This procedure has been used by Anagnostou et al. (1998) in their comparison of radar-rainfall mean-field bias estimation methods. The mean of the bias adjustment factor Bs and its estimation variance ΣB are computed from the predicted log-bias mean β̂s and variance Vs using the following transformations:
i1520-0426-16-2-189-e9
and
i1520-0426-16-2-189-e10

With the analysis of the mean-field systematic error correction procedure, we complete the description of the algorithm-processing stages. The algorithm’s parameter estimation procedure is described next.

3. Parameter estimation procedure

The proposed system has several parameters that control the different processing components. The parameters of the proposed algorithm are listed in Table 1. Proper implementation of the algorithm to a given radar-rainfall regime requires determination of its optimal parameter values.

The estimation of the algorithm’s parameters is formulated as a global optimization problem. The optimization criterion is a minimization of the root-mean-square (rms) difference between radar (HRAP grid average) and rain gauge hourly rainfall accumulations:
i1520-0426-16-2-189-e11
where all variables have been previously defined. The rms is assessed after the mean radar–rain gauge bias has been adjusted. This is performed by excluding parameter A of the Z–R relationship from the optimization and by tuning its value to remove the mean bias. As mentioned earlier, the objective function is applied on the final radar rainfall products. This approach is conceptually similar to the radar rainfall optimization approach proposed by Ciach et al. (1997). Use of a global optimization procedure has two main justifications. First, global procedures provide an integral assessment of the algorithm’s performance. Second, because of the highly complex and nonlinear processes involved in radar rainfall measurement and estimation, separate optimization of selected processing steps does not ensure optimal performance of the algorithm at the final stage.

The main feature that differentiates our procedure from the approach proposed by Ciach et al. (1997) is that parameters are adjusted adaptively by optimizing the objective function (11) in real time. Because of the high zero intermittence and variability of rainfall (Seed and Austin 1990; Crane 1990) at the hourly timescale, only conditional radar–rain gauge pairs are included in the rms calculations. Solution of the real-time calibration problem is based on an adaptive global optimization procedure.

The adaptive optimization procedure is the stochastic Gauss–Newton method (Ljung and Soderstrom 1981). The choice of a stochastic optimization method stems from the fact that optimal estimation algorithms are difficult to implement in this situation because 1) the statistical characteristics of the model parameters are not well defined, 2) the error processes are likely to be non-Gaussian, and 3) the model structure is highly nonlinear for accurate approximation by linearization. In these cases, stochastic approximation algorithms, although not optimal in a strict sense of optimizing the true error characteristics, yield recursive model parameter estimates with well-defined convergence properties. The Gauss–Newton method is described in appendix B.

4. Closing remarks

This work presents a multicomponent radar rainfall estimation algorithm suitable for real-time applications. This algorithm provides a potential framework for operational rainfall estimation from the nationwide WSR-88D radar network. New parameterizations for hybrid reflectivity scan construction, reflectivity to rainfall rate conversion, and range-effect correction are introduced. In addition, the algorithm includes procedures for beam–height-effect correction, rainfall classification, advection correction, and recursive parameter estimation. The new parameterizations and procedures distinguish our approach from the operational PPS and other real-time radar algorithms.

The parameter estimation procedure is based on the stochastic Gauss–Newton optimization method. The rms of the radar–rain gauge conditional hourly rainfall difference is used as the objective function. Estimation of the objective function at the final rainfall products was chosen since it provides an overall assessment of the algorithm’s performance. This calibration procedure is completely different from the conventional Z–R fitting problem. It is based on storm morphology (i.e., it has a physical basis), and the parameters are estimated in real time, accounting for possible interactions and feedbacks.

We point out that the choice of the minimization of the rms radar–rain gauge difference as the optimization criterion is arbitrary. The proposed framework remains valid even if a different criterion is used. The criterion should be selected based on the mission requirements for the system operators and users of the rainfall products. We decided to use the rms, as we believe it is a good overall criterion that serves well both the practical needs of flood forecasting and the other applications of the products, such as water resources system management and climate monitoring.

The global optimization approach provides the basis for assessing the significance of the different components of the algorithm in the context of rainfall estimation accuracy. This is presented in Anagnostou and Krajewski (1999), based on an extensive dataset of two months of volume scan reflectivity and rain gauge data from the Melbourne, Florida, WSR-88D radar site. Other issues investigated in the study by Anagnostou and Krajewski (1999) are 1) the convergence properties of the algorithm’s adaptive calibration procedure, 2) the sensitivity of the system with respect to changes in the parameter values, and 3) the relative rms reduction with respect to the operational PPS for the newly proposed algorithm.

Acknowledgments

We acknowledge and appreciate useful discussions with Dr. James A. Smith, from Princeton University, and Dr. Dong-Jun Seo, from the Office of Hydrology of the National Weather Service. We also thank Tim O’Bannon, Operational Support Facility of the National Weather Service, and two anonymous reviewers for their helpful comments on the original manuscript. This study was supported by the National Weather Service under a Cooperative Agreement between the Office of Hydrology and the Iowa Institute of Hydraulic Research and by the National Aeronautics and Space Administration under Grant NAG-5-2094.

REFERENCES

  • Anagnostou, E. N., and W. F. Krajewski, 1998: Calibration of the WSR-88D Precipitation Processing Subsystem. Wea. Forecasting,13, 396–406.

    • Crossref
    • Export Citation
  • ——, and ——, 1999: Real-time radar rainfall estimation. Part II: Case study. J. Atmos. Oceanic Technol.,16, 198–205.

    • Crossref
    • Export Citation
  • ——, and C. Kummerow, 1997: Stratiform–convective classification of rainfall using SSM/I 85-GHz brightness temperature observations. J. Atmos. Oceanic Technol.,14, 570–575.

    • Crossref
    • Export Citation
  • ——, W. F. Krajewski, D.-J., Seo, and E. R., Johnson, 1998: Mean-field radar rainfall bias studies for WSR-88D. ASCE J. Hydrol. Eng.,3, 149–159.

    • Crossref
    • Export Citation
  • Andrieu, H., and J.-D. Creutin, 1995: Identification of vertical profiles of radar reflectivities for hydrological applications using an inverse method. Part I: Formulation. J. Appl. Meteor.,34, 225–239.

    • Crossref
    • Export Citation
  • Atlas, D., and A. C. Chmela, 1957: Physical–synoptic variations of raindrop size parameters. Proc. Sixth Weather Radar Conf., Cambridge, MA, Amer. Meteor. Soc., 21–29.

  • Austin, P. M., 1987: Relation between measured radar reflectivity and surface rainfall. Mon. Wea. Rev.,115, 1053–1069.

    • Crossref
    • Export Citation
  • Battan, L. J., 1973: Radar Observation of the Atmosphere. The University of Chicago Press, 324 pp.

  • Bellon, A., F. Fabry, and G. L. Austin, 1991: Errors due to space–time sampling strategies in high-resolution radar data in hydrology. Preprints, 25th Conf. on Radar Meteorology, Paris, France, Amer. Meteor. Soc., 2040–2048.

  • Borga, M., E. N. Anagnostou, and W. F. Krajewski, 1997: A simulation approach for validation of brightband correction method. J. Appl. Meteor.,36, 1507–1518.

    • Crossref
    • Export Citation
  • Ciach, G. J., W. F. Krajewski, E. N. Anagnostou, M. L. Baeck, J. A. Smith, J. R. McCollum, and A. Kruger, 1997: Radar rainfall estimation for ground validation studies of the Tropical Rainfall Measuring Mission. J. Appl. Meteor.,36, 736–747.

    • Crossref
    • Export Citation
  • Crane, R. K., 1990: Space–time structure of rain rate field. J. Geophys. Res.,95, 2011–2020.

    • Crossref
    • Export Citation
  • Fabry, F., A. Bellon, M. R. Duncan, and G. L. Austin, 1994: High resolution rainfall measurements by radar for very small basins:The sampling problem reexamined. J. Hydrol.,161, 415–428.

    • Crossref
    • Export Citation
  • Fulton, R. A., J. P. Breidenbach, D. J. Seo, D. A. Miller, and T. O’Bannon, 1998: The WSR-88D rainfall algorithm. Wea. Forecasting,13, 377–395.

    • Crossref
    • Export Citation
  • Gelb, A., 1974: Applied Optimal Estimation. The MIT Press.

  • Green, D. R., and R. A. Clark, 1972: Vertically integrated liquid—A new analysis tool. Mon. Wea. Rev.,100, 548–552.

    • Crossref
    • Export Citation
  • Heiss, W. H., D. L. McGrew, and D. Sirmans, 1990: Next Generation Weather Radar (WSR-88D). Microwave J.,33, 79–98.

  • Houze, R. A., Jr., 1993: Cloud Dynamics. Academic Press, 573 pp.

  • Hudlow, M. D., 1988: Technological developments in real-time operational hydrologic forecasting in the United States. J. Hydrol.,102, 69–92.

    • Crossref
    • Export Citation
  • ——, J. A. Smith, M. L. Walton, and R. C. Shedd, 1991: NEXRAD:New era in hydrometeorology in the USA. Proceedings, Hydrological Applications of Weather Radar, I. D. Cluckie and C. G. Collier, Eds., Ellis Horwood, 602–613.

  • Joss, J., and A. Waldvogel, 1990: Precipitation measurement and hydrology. Radar in Meteorology, D. Atlas, Ed., Amer. Meteor. Soc., 577–606.

    • Crossref
    • Export Citation
  • ——, and R. Lee, 1995: The application of radar–gauge comparisons to operational precipitation profile corrections. J. Appl. Meteor.,34, 2612–2630.

    • Crossref
    • Export Citation
  • Kitchen, M., and P. M. Jackson, 1993: Weather radar performance at long range—Simulated and observed. J. Appl. Meteor.,32, 975–985.

    • Crossref
    • Export Citation
  • Klazura, G. E., and D. A. Imy, 1993: A description of the initial set of analysis products available from the NEXRAD WSR-88D system. Bull. Amer. Meteor. Soc.,74, 1293–1311.

    • Crossref
    • Export Citation
  • Kucera, P. A., D. A. Short, and O. W. Thiele, 1996: An analysis of rainfall intensity and vertical structure from shipborne radars in TOGA COARE. Preprints, Seventh Conf. on Mesoscale Processes, Reading, United Kingdom, Amer. Meteor. Soc., 131–134.

  • Liu, C., and W. F. Krajewski, 1996: A comparison of methods for calculation of radar-rainfall hourly accumulations. Water Resour. Bull.,32, 305–315.

    • Crossref
    • Export Citation
  • Ljung, L., and T. Soderstrom, 1981: Theory and Practice of Recursive Identification. The MIT Press.

    • Crossref
    • Export Citation
  • Mehra, R. K., 1970: On the identification of variance and adaptive Kalman filtering. IEEE Trans. Automatic Control,AC-15, 175–184.

    • Crossref
    • Export Citation
  • ——, 1972: Approaches to adaptive filtering. IEEE Trans. Automatic Control,AC-17, 693–698.

    • Crossref
    • Export Citation
  • Rajaram, H., and K. P. Georgakakos, 1987: Recursive parameter estimation of conceptual watershed response models. IIHR Report No. 319, Iowa Institute of Hydraulic Research, University of Iowa, 169 pp.

  • Rosenfeld, D., E. Amitai, and D. B. Wolff, 1995: Improved accuracy of radar WPMM estimated rainfall upon application of objective classification criteria. J. Appl. Meteor.,34, 212–223.

    • Crossref
    • Export Citation
  • Seed, A., and G. L. Austin, 1990: Variability of summer Florida rainfall and its significance for the estimation of rainfall by gauges, radar and satellites. J. Geophys. Res.,95, 2207–2215.

    • Crossref
    • Export Citation
  • Seo, D.-J., R. A. Fulton, J. P. Breidenbach, D. E. Miller, and E. Friend, 1995: Final report for interagency memorandum of understanding among the NEXRAD program, WSR-88D Operational Support Facility and the National Weather Service Office of Hydrology. Hydrologic Research Laboratory, Office of Hydrology, National Weather Service.

  • ——, ——, ——, M. Taylor, and D. A. Miller, 1996: Final report to interagency memorandum of understanding among the NEXRAD program, WSR-88D Operational Support Facility, and the National Weather Service Office of Hydrology. Hydrologic Research Laboratory, NOAA/NWS/OH/HRL.

  • Smith, J. A., and W. F. Krajewski, 1993: A modeling study of rainfall rate–reflectivity relationships. Water Resour. Res.,29, 2505–2514.

    • Crossref
    • Export Citation
  • ——, D.-J. Seo, M. L. Baeck, and M. D. Hudlow, 1996: An intercomparison study of NEXRAD precipitation estimates. Water Resour. Res.,32, 2035–2045.

    • Crossref
    • Export Citation
  • Steiner, M., and R. A. Houze, Jr., 1997: Sensitivity of the estimated monthly convective rain fraction to the choice of Z–R relation. J. Appl. Meteor.,36, 452–462.

    • Crossref
    • Export Citation
  • ——, ——, and S. E. Yutter, 1995: Climatological characterization of three-dimensional storm structure from operational radar and rain gauge data. J. Appl. Meteor.,34, 1978–2007.

    • Crossref
    • Export Citation
  • Tokay, A., and D. A. Short, 1996: Evidence from tropical raindrop spectra of the origin of rain from stratiform versus convective clouds. J. Appl. Meteor.,35, 355–371.

    • Crossref
    • Export Citation
  • Yuter, S. E., and R. A. Houze, Jr., 1997: Measurements of raindrop size distributions over the Pacific warm pool and implications for Z–R relations. J. Appl. Meteor.,36, 847–867.

    • Crossref
    • Export Citation
  • Zawadzki, I., 1984: Factors affecting the precision of radar measurements of rain. Preprints, 22d Conf. on Radar Meteorology, Zurich, Switzerland, Amer. Meteor. Soc., 251–256.

APPENDIX A

Advection Correction

The advection correction scheme used in the algorithm consists of the following steps. First, the rainfall maps’ Cartesian domain (200 × 200 pixels) is divided into N subdomains of equal size: in this study the subdomain size was 20 × 20 pixels. Second, for each subdomain the average advection vector Δuo(j) between two subsequent rainfall maps is determined based on the cross-correlation method (Bellon et al. 1991). The advection vector (unitless) is in terms of the number of radar pixels: j represents the subdomain’s index. The average advection vector is the spatial shift between two subsequent rainfall maps that maximizes the cross correlation between the two maps’ rainfall values of the corresponding subdomain:
i1520-0426-16-2-189-ea1
where ρ is the cross correlation; R1(u) and R2(u) are consecutive radar rainfall rates at pixel u; μ1j, μ2j and σ1j, σ2j (mm h−1) are the mean values and standard deviations of the jth subdomain’s rainfall; Δu is the distance (in terms of the number of pixels) between two points in the domain; and the summation is over all of the un pixels of the jth subdomain.
The mean advection vector Δuo of each subdomain is subsequently used to determine the subdomain’s scan-to-scan accumulation as
i1520-0426-16-2-189-ea3
where T (min) is the time period between the two consecutive rainfall fields and t is the time interval (1 min) of the discrete temporal interpolation.

APPENDIX B

Gauss–Newton Stochastic Optimization Method

The most common categories of recursive optimization algorithms are discussed in Ljung and Soderstrom (1981). These categories are 1) modifications of offline optimization methods, 2) nonlinear filtering methods (i.e., extended Kalman filter), 3) stochastic approximation methods, and 4) model reference approaches. These methods are described in detail by Rajaram and Georgakakos (1987). Optimization algorithms involve two main features. The first is the definition of the error function that will represent the discrepancies between model outputs and “true” physical values. The second is the specification of an objective function in terms of some statistics of the error function.

In this study we selected a stochastic approximation method to solve the algorithm’s optimization problem. We decided to use a stochastic approach for the following reason. It is not based on strong assumptions and/or approximations, such as the normality of noise processes, the linearity of process dynamics, and/or the well-defined statistical characterization of the parameters, among others. In the following, we present the Gauss–Newton stochastic optimization method. Further details can be found in Ljung and Soderstrom (1981).

The estimation error is defined by
t, θRgtAt, θ
where Rg and A represent average (over all rain gauge locations at hour t) rain gauge and radar hourly rainfall (mm h−1), respectively. The following equations, derived from the quadratic objective function of Eq. (11), consist of the Gauss–Newton adaptive optimization method:
i1520-0426-16-2-189-eb2
where t (unitless) denotes the discrete time increment (1 h); θ(t) is a vector containing the algorithm’s parameters (unitless); P(t) is a vector containing the parameter estimation error variance (unitless); W(t) is a weight matrix (mm2 h−2); γ(t) = 1/t (unitless), L(t) (mm−1 h−1), and S(t) (mm2 h−2) are intermediate matrices; λ(t) is
λtγtγtγt
and ψ(t) (mm h−1) is a vector containing the derivatives of the algorithm with respect to its parameter vector θ, at time step t (h),
i1520-0426-16-2-189-eb8
where f represents the algorithm’s equations and H are the radar and rain gauge data input to the algorithm during the [t − 1, t] time interval.

Table 1.

The parameters of the real-time radar rainfall estimation algorithm.

Table 1.
Save
  • Anagnostou, E. N., and W. F. Krajewski, 1998: Calibration of the WSR-88D Precipitation Processing Subsystem. Wea. Forecasting,13, 396–406.

    • Crossref
    • Export Citation
  • ——, and ——, 1999: Real-time radar rainfall estimation. Part II: Case study. J. Atmos. Oceanic Technol.,16, 198–205.

    • Crossref
    • Export Citation
  • ——, and C. Kummerow, 1997: Stratiform–convective classification of rainfall using SSM/I 85-GHz brightness temperature observations. J. Atmos. Oceanic Technol.,14, 570–575.

    • Crossref
    • Export Citation
  • ——, W. F. Krajewski, D.-J., Seo, and E. R., Johnson, 1998: Mean-field radar rainfall bias studies for WSR-88D. ASCE J. Hydrol. Eng.,3, 149–159.

    • Crossref
    • Export Citation
  • Andrieu, H., and J.-D. Creutin, 1995: Identification of vertical profiles of radar reflectivities for hydrological applications using an inverse method. Part I: Formulation. J. Appl. Meteor.,34, 225–239.

    • Crossref
    • Export Citation
  • Atlas, D., and A. C. Chmela, 1957: Physical–synoptic variations of raindrop size parameters. Proc. Sixth Weather Radar Conf., Cambridge, MA, Amer. Meteor. Soc., 21–29.

  • Austin, P. M., 1987: Relation between measured radar reflectivity and surface rainfall. Mon. Wea. Rev.,115, 1053–1069.

    • Crossref
    • Export Citation
  • Battan, L. J., 1973: Radar Observation of the Atmosphere. The University of Chicago Press, 324 pp.

  • Bellon, A., F. Fabry, and G. L. Austin, 1991: Errors due to space–time sampling strategies in high-resolution radar data in hydrology. Preprints, 25th Conf. on Radar Meteorology, Paris, France, Amer. Meteor. Soc., 2040–2048.

  • Borga, M., E. N. Anagnostou, and W. F. Krajewski, 1997: A simulation approach for validation of brightband correction method. J. Appl. Meteor.,36, 1507–1518.

    • Crossref
    • Export Citation
  • Ciach, G. J., W. F. Krajewski, E. N. Anagnostou, M. L. Baeck, J. A. Smith, J. R. McCollum, and A. Kruger, 1997: Radar rainfall estimation for ground validation studies of the Tropical Rainfall Measuring Mission. J. Appl. Meteor.,36, 736–747.

    • Crossref
    • Export Citation
  • Crane, R. K., 1990: Space–time structure of rain rate field. J. Geophys. Res.,95, 2011–2020.

    • Crossref
    • Export Citation
  • Fabry, F., A. Bellon, M. R. Duncan, and G. L. Austin, 1994: High resolution rainfall measurements by radar for very small basins:The sampling problem reexamined. J. Hydrol.,161, 415–428.

    • Crossref
    • Export Citation
  • Fulton, R. A., J. P. Breidenbach, D. J. Seo, D. A. Miller, and T. O’Bannon, 1998: The WSR-88D rainfall algorithm. Wea. Forecasting,13, 377–395.

    • Crossref
    • Export Citation
  • Gelb, A., 1974: Applied Optimal Estimation. The MIT Press.

  • Green, D. R., and R. A. Clark, 1972: Vertically integrated liquid—A new analysis tool. Mon. Wea. Rev.,100, 548–552.

    • Crossref
    • Export Citation
  • Heiss, W. H., D. L. McGrew, and D. Sirmans, 1990: Next Generation Weather Radar (WSR-88D). Microwave J.,33, 79–98.

  • Houze, R. A., Jr., 1993: Cloud Dynamics. Academic Press, 573 pp.

  • Hudlow, M. D., 1988: Technological developments in real-time operational hydrologic forecasting in the United States. J. Hydrol.,102, 69–92.

    • Crossref
    • Export Citation
  • ——, J. A. Smith, M. L. Walton, and R. C. Shedd, 1991: NEXRAD:New era in hydrometeorology in the USA. Proceedings, Hydrological Applications of Weather Radar, I. D. Cluckie and C. G. Collier, Eds., Ellis Horwood, 602–613.

  • Joss, J., and A. Waldvogel, 1990: Precipitation measurement and hydrology. Radar in Meteorology, D. Atlas, Ed., Amer. Meteor. Soc., 577–606.

    • Crossref
    • Export Citation
  • ——, and R. Lee, 1995: The application of radar–gauge comparisons to operational precipitation profile corrections. J. Appl. Meteor.,34, 2612–2630.

    • Crossref
    • Export Citation
  • Kitchen, M., and P. M. Jackson, 1993: Weather radar performance at long range—Simulated and observed. J. Appl. Meteor.,32, 975–985.

    • Crossref
    • Export Citation
  • Klazura, G. E., and D. A. Imy, 1993: A description of the initial set of analysis products available from the NEXRAD WSR-88D system. Bull. Amer. Meteor. Soc.,74, 1293–1311.

    • Crossref
    • Export Citation
  • Kucera, P. A., D. A. Short, and O. W. Thiele, 1996: An analysis of rainfall intensity and vertical structure from shipborne radars in TOGA COARE. Preprints, Seventh Conf. on Mesoscale Processes, Reading, United Kingdom, Amer. Meteor. Soc., 131–134.

  • Liu, C., and W. F. Krajewski, 1996: A comparison of methods for calculation of radar-rainfall hourly accumulations. Water Resour. Bull.,32, 305–315.

    • Crossref
    • Export Citation
  • Ljung, L., and T. Soderstrom, 1981: Theory and Practice of Recursive Identification. The MIT Press.

    • Crossref
    • Export Citation
  • Mehra, R. K., 1970: On the identification of variance and adaptive Kalman filtering. IEEE Trans. Automatic Control,AC-15, 175–184.

    • Crossref
    • Export Citation
  • ——, 1972: Approaches to adaptive filtering. IEEE Trans. Automatic Control,AC-17, 693–698.

    • Crossref
    • Export Citation
  • Rajaram, H., and K. P. Georgakakos, 1987: Recursive parameter estimation of conceptual watershed response models. IIHR Report No. 319, Iowa Institute of Hydraulic Research, University of Iowa, 169 pp.

  • Rosenfeld, D., E. Amitai, and D. B. Wolff, 1995: Improved accuracy of radar WPMM estimated rainfall upon application of objective classification criteria. J. Appl. Meteor.,34, 212–223.

    • Crossref
    • Export Citation
  • Seed, A., and G. L. Austin, 1990: Variability of summer Florida rainfall and its significance for the estimation of rainfall by gauges, radar and satellites. J. Geophys. Res.,95, 2207–2215.

    • Crossref
    • Export Citation
  • Seo, D.-J., R. A. Fulton, J. P. Breidenbach, D. E. Miller, and E. Friend, 1995: Final report for interagency memorandum of understanding among the NEXRAD program, WSR-88D Operational Support Facility and the National Weather Service Office of Hydrology. Hydrologic Research Laboratory, Office of Hydrology, National Weather Service.

  • ——, ——, ——, M. Taylor, and D. A. Miller, 1996: Final report to interagency memorandum of understanding among the NEXRAD program, WSR-88D Operational Support Facility, and the National Weather Service Office of Hydrology. Hydrologic Research Laboratory, NOAA/NWS/OH/HRL.

  • Smith, J. A., and W. F. Krajewski, 1993: A modeling study of rainfall rate–reflectivity relationships. Water Resour. Res.,29, 2505–2514.

    • Crossref
    • Export Citation
  • ——, D.-J. Seo, M. L. Baeck, and M. D. Hudlow, 1996: An intercomparison study of NEXRAD precipitation estimates. Water Resour. Res.,32, 2035–2045.

    • Crossref
    • Export Citation
  • Steiner, M., and R. A. Houze, Jr., 1997: Sensitivity of the estimated monthly convective rain fraction to the choice of Z–R relation. J. Appl. Meteor.,36, 452–462.

    • Crossref
    • Export Citation
  • ——, ——, and S. E. Yutter, 1995: Climatological characterization of three-dimensional storm structure from operational radar and rain gauge data. J. Appl. Meteor.,34, 1978–2007.

    • Crossref
    • Export Citation
  • Tokay, A., and D. A. Short, 1996: Evidence from tropical raindrop spectra of the origin of rain from stratiform versus convective clouds. J. Appl. Meteor.,35, 355–371.

    • Crossref
    • Export Citation
  • Yuter, S. E., and R. A. Houze, Jr., 1997: Measurements of raindrop size distributions over the Pacific warm pool and implications for Z–R relations. J. Appl. Meteor.,36, 847–867.

    • Crossref
    • Export Citation
  • Zawadzki, I., 1984: Factors affecting the precision of radar measurements of rain. Preprints, 22d Conf. on Radar Meteorology, Zurich, Switzerland, Amer. Meteor. Soc., 251–256.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1408 591 45
PDF Downloads 874 291 30