1. Introduction
Investigating the effects of ducts on EM wave propagation can be accurately conducted using simulations that utilize the parabolic equation to solve Maxwell’s equations, provided the refractive conditions are known (Sirkova 2012). However, estimating the atmospheric properties that influence refractivity has its own limitations and as such, several approaches to modeling the environment have been developed, each with its own strengths and weaknesses. One approach is to use similarity functions [e.g., Monin–Obukhov (MO) similarity theory] and bulk environmental measurements (Garratt 1992; Rowland et al. 1996; Fairall et al. 1996, 2003). Similarity theory–based models, such as the Navy Atmospheric Vertical Surface Layer Model (NAVSLAM; Frederickson 2017) or the Coupled Ocean–Atmosphere Response Experiment (COARE) algorithm (Fairall et al. 1996, 2003), are restricted to the surface layer, have limited representation of physical processes due to model assumptions, and have nonunique solutions in stable conditions (Wang and Bras 2010). Another approach is to model the atmosphere using mesoscale numerical weather prediction (NWP) models like the Weather Research and Forecasting (WRF) Model (Michalakes et al. 2001), the Coupled Ocean–Atmosphere Mesoscale Prediction System (COAMPS; Hodur 1997),1 or other similar models. However, because of their limited vertical resolution, particularly near the ocean surface, NWP model forecast variables are often blended with MO theory–based surface layer model variables, to increase resolution at the lowest altitudes.
Inversion methods represent another approach to estimating the refractive environment directly. Inversion methods use a measured EM signal, either clutter, or received power using separated transmitters and receivers (point-to-point radar measurements) (e.g., Rogers et al. 2000; Karimian et al. 2011; Penton and Hackett 2018; Pozderac et al. 2018; Pastore et al. 2022). Limitations of inversion methods include the adequacy of the parametric refractive model applied, nonunique solutions, and the various sources of uncertainty associated with the radar measurements such as the amount and location of data (Matsko and Hackett 2019). Rather than treat each of the approaches for characterizing the environment independently, one can seek to integrate them to estimate the environment more accurately or more quickly. A more rapid estimation method can allow for real-time characterization of the environment (as it evolves in time).
Karimian et al. (2013) merged an inversion method based on radar clutter observations with ensemble NWP model forecasts and found that use of the combined method yielded more accurate humidity and air–sea temperature difference estimates than using either method in isolation. This NWP–inversion hybrid method focused on evaporation ducts. Zhao and Huang (2014) also suggest that using NWP refractivity forecasts as a regularization term in an adjoint method inversion approach can improve accuracies and avoid convergence onto incorrect environments that predict the correct propagation, although the authors did not demonstrate this idea with NWP explicitly. Gordon et al. (2015) also discuss a “refractivity data fusion” approach that incorporates NWP forecasts into a refractivity from clutter inversion approach.
Here, we extend the ideas presented in these studies by incorporating NWP forecasts into an inversion method and evaluate whether the incorporation of this information reduces the duration or increases the accuracy of inversions for surface ducting conditions. Analogous to Gordon et al. (2015), we map ensemble NWP refractivity profiles onto the diagnostic parameters that the inversion is solving. Similar to ideas presented in Zhao and Huang (2014) and following the inversion method outlined in Penton and Hackett (2018), we evaluate a parametric model to describe surface ducting conditions and utilize genetic algorithms (GA) to solve the inversion problem by initiating and constraining the GA using parameters estimated from NWP ensemble forecasts. This incorporation of NWP forecasts into the GA is aimed at reducing the probability of converging onto an incorrect refractive environment, which can occur due to limitations of radio frequency data sampling (Matsko and Hackett 2019) and/or the influence of the sea state (Penton and Hackett 2018).
We test this fusion of NWP and the inversion approach in three numerical experiments performed with 13 surface ducting cases measured during the Wallops Island field experiment (Haack et al. 2010; Zhao et al. 2016), where one experiment does not use NWP and the other two introduce the NWP into the inversion approach in two separate ways. One way includes using the NWP ensembles to set the initial population used by the GA, while the other constrains the search space of environmental parameters estimated by the GA using NWP ensembles and also uses them for the initial population. These experiments allow investigation into the degree to which the NWP ensembles are able to aid the inversion process. We find that NWP ensembles can both reduce the duration and improve the accuracy of an inversion approach by restraining the GA search space, but not when used solely to set the GA’s initial population.
2. Data
a. Wallops Island field experiment
This study incorporates atmospheric data taken from an instrumented helicopter between 28 April and 4 May 2000 from the shoreline of Wallops Island, Virginia, to around 60 km offshore during the Wallops Island field experiment (Babin and Rowland 1992; Babin 1995, 1996; Haack et al. 2010). This coastal environment is favorable to a complex variety of spatially and temporally evolving refractivity structures including surface ducting scenarios. Furthermore, these data have been used to verify NWP data (Haack et al. 2010) and to assess the performance of NWP ensembles (Zhao et al. 2016).
Each helicopter dataset consists of vertical profiles of three different atmospheric variables: pressure, relative humidity, and temperature, measured simultaneously over ∼100 s at near-0.75-m vertical intervals within the lowest 150 m of the atmosphere (Babin 1995). Each helicopter dataset is used to calculate the vertical profile of atmospheric refractivity and modified refractivity via Eqs. (1) and (2).
Of all helicopter datasets measured during the Wallops Island field experiment, 13 exhibit modified refractivity profiles (M profiles) with clear surface ducting scenarios. These 13 profiles are used for analyses in this study and are referred to as separate surface ducting “cases.” Figure 1 shows M profiles during these surface ducting cases, and Table 1 indicates the start time of each M profile estimated from each of these helicopter datasets. The vertical distribution of each M profile is different, each containing between 48 and 86 points up to 110 m. No measurements of surface variables, and hence surface-modified refractivity, were made by the helicopter.
Thirteen cases of M profiles that contain surface ducts in the lower 100 m of altitude calculated from helicopter datasets during the Wallops Island field experiment. Since helicopter datasets do not include surface refractivity, surface points are from extrapolation of nonlinear least squares fits to the parametric model explained at the beginning of section 3.
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
Details of M profiles used in this study, including: helicopter measurement start time, the initialization time of the COAMPS ensemble forecasts, the number of hours after initialization for which each NWP ensemble forecast is valid (forecast hour), and the distance (km) of the COAMPS grid location from each case’s helicopter profile starting location.
b. COAMPS numerical weather prediction ensembles
COAMPS is used to generate ensembles of NWP forecasts used in this study, and are the same as those used in Zhao et al. (2016). Each ensemble contains 32 members that were generated by COAMPS using lateral boundary conditions and initial conditions estimated from the Navy Operational Global Atmospheric Prediction System (NOGAPS; Hogan and Rosmond 1991; Peng et al. 2004). Global perturbations seeding the NOGAPS ensembles are generated through the ensemble transform (ET) technique (McLay et al. 2008, 2010). Further information about mesoscale perturbations included in COAMPS’s initial conditions to obtain the ensemble forecasts can be found in Zhao et al. (2016); only a brief description is elaborated on below.
COAMPS is a high-resolution, nonhydrostatic mesoscale model based upon the Navier–Stokes equations that describe temporal changes in atmospheric variables: temperature, water vapor, wind components, turbulent kinetic energy, and five moisture species including clouds, rain, ice, snow, and graupel (Hodur 1997). To close the equations, some physical processes are parameterized, such as vertical turbulent mixing, surface energy exchange, and cloud microphysics. COAMPS has been used extensively since 1995 to provide operational forecasts to the U.S. Naval Fleet and in a research capacity by using historical case studies to validate and advance the modeling and forecasting skill (Haack and Burk 2001; Thompson and Haack 2011; Kulessa et al. 2017; Alappattu et al. 2022; Xu et al. 2022). The Wallops model setup comprised three nested domains with each inner grid having 3 times the horizontal resolution of the parent grid. All nests have 71 levels distributed vertically between 4 and 40 000 m, and 6 levels reside in the lowest 111 m, the lowest level being 4 m above the surface. In this study, we utilized only the highest-resolution third nest covering an area 484 km by 485 km, whose domain is represented in Fig. 2 and has an average horizontal grid spacing of 4 km. For the ensemble predictions, 32 COAMPS model runs were initialized 48 h prior to the period of interest using 32 sets of NOGAPS fields that had been seeded with observational data and the ensemble perturbations. At each subsequent 12-h forecast interval, current observational data were assimilated into forecasts to initialize the next 12-h forecast cycle, incrementally updating the fields and allowing mesoscale detail and vertical structure to develop and carry through the model during the experiment period.
Region covered by the third-level nested grid from COAMPS utilized in this study. Locations of helicopter measurements within the domain are illustrated by the colored stars (see the legend).
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
COAMPS modified refractivity ensemble members that are closest to the nearest hour and location of each helicopter dataset (Table 1) are used in this study. The distance between the COAMPS grid location and the helicopter’s starting location is computed using the Haversine distance formula. Figure 3 shows an example comparison between the helicopter data and the associated COAMPS ensemble members’ refractivity vertical profiles for case 2. In Fig. 3, it is evident that the ensemble covered the range of M in the measured data, but no single forecast accurately reflects the measured refractivity, similar to the results published in Zhao et al. (2016). Notice that similar to the helicopter data, the ensemble data do not contain surface estimates of modified refractivity.
An example of a COAMPS ensemble forecast and the corresponding helicopter refractivity profile for case 2 (see the legend).
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
3. Methods
Three numerical experiments are performed with the aforementioned 13 cases measured during the Wallops Island field experiment and coinciding NWP ensembles (Table 1). Helicopter refractivity datasets are fit to a parametric refractivity model, whose fit is scrutinized to ensure the parametric model is an accurate representation of measured surface ducting conditions. Fit helicopter profiles are used in a radar propagation simulation, and propagation predictions are used as simulated propagation measurements for an inversion method to determine refractivity, which is evaluated by comparing it with the refractivity used to generate the propagation predictions. Simultaneous NWP ensembles (see Table 1) are also fit to the parametric model, whose fits are examined for their accurate representation of the ensembles. Parameters from these ensemble fits are further used to initialize the inversion method. More details about the inversion method, the parametric refractivity model, and the propagation simulation are outlined in section 3a, while the numerical experiments are explained in section 3b.
a. Inversion method
The inversion method consists of a parametric refractivity model (PRM), a propagation simulation, the variable terrain radio parabolic equation (VTRPE) model (Ryan 1991), and the GA, where the last is the optimization engine for the inversion. The inversion method is driven by synthetic radar data generated from the VTRPE simulation using the fit helicopter profiles. The GA iteratively optimizes parameters of the PRM to best match the synthetic radar data.
PRM parameters estimated from fits to measured helicopter data and coinciding RMSEs between the PRM and helicopter data down sampled to the same levels (nz = 7) as COAMPS for each case.
Unvaried parameters used in propagation simulations associated with the transmitter, sea surface dielectric properties, and numerical domain.
Propagation loss pattern simulated by VTRPE using refractivity from the PRM-fit helicopter M profile for case 6.
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
The optimization method, which utilizes GA, follows closely the methods outlined in Penton and Hackett (2018), where sets of refractive parameters (i.e., ΔM, m1, and zd) are used to build M profiles, and each M profile is used in the radar propagation simulation (VTRPE). PL produced from the simulation (i.e., Fig. 4) is compared with a “known” PL domain using a fitness function. The GA minimizes the fitness function reaching a set of refractive parameters (generating a refractive environment) that accurately portrays the known PL domain. However, the current study differs from Penton and Hackett (2018) in that the inversion is being applied for a surface ducting scenario; hence, the PRM used is different but utilizes the same number of parameters. The current study also alters the initial population of the GA to incorporate information from NWP as well as limits the search space of the refractive parameters estimated by the GA based on the NWP data (these aspects are discussed more thoroughly in the next subsection). Similar to Penton and Hackett (2018), the inversion does not estimate the surface modified refractivity (M0); it is assumed to be known and set to the surface value estimated by the nonlinear fits of each helicopter profile (see Table 2).
GA implementation parameters.
b. Numerical experiments
This study includes 39 inverse solutions (13 cases; three experiments), which are computed in three numerical experiments. Two of the experiments incorporate NWP ensemble forecasts into the inversion process, and one experiment does not utilize any NWP data. In the first experiment, referred to as the Random experiment, inversions are carried out with a random initial GA population determined using a pseudorandom number drawn from a standard normal distribution that is used to select initial populates from within the following parameter ranges: 1–90 m for zd, 0.001–1 M units per meter for m1, and 0.001–45 M units for ΔM. All parameter estimates from the GA for this experiment are within this liberal but constrained search space, which is inclusive of typically observed ranges for these parameters (Sirkova 2015) and is comfortably inclusive of all parameter values from the helicopter-measured data and the NWP ensembles. The second experiment, referred to as the Ensemble experiment, fits ensemble numerical weather predictions corresponding with each helicopter case (Table 2) to the PRM, whose parameters are used as the initial population for the GA optimization. Specifically, each ensemble member acts as one member of the GA initial population. Unlike the random initial population (from the Random experiment), where it is possible that nonphysical combinations of parameters could be randomly selected, using an initial population based on the NWP ensembles guarantees all initial populates are physically realistic. The Ensemble experiment utilizes the same parameter search spaces as the Random experiment. For the third experiment, called the Spread experiment, the initial population is the same as the Ensemble experiment, but the parameter search spaces for the GA are determined from the range of the estimated ensemble members’ parameters for each case. These search spaces are shown in Table 5.
The constrained GA search space for each parameter based on the fit NWP ensemble data. The constrained search spaces are used in the Spread experiment.
GA initial population ensemble parameter sets, used in both Ensemble and Spread experiments, are estimated with nonlinear least squares regression, like the helicopter profiles, except that the surface refractivity M0 is not estimated in the regression and a weighting scheme is also applied. Coarse vertical resolution of the ensemble predictions in the lowest 100 m makes accurately estimating the parameters of the PRM more difficult than the helicopter data, particularly when estimating the surface refractivity M0. Fewer data points means lower accuracy using nonlinear least squares fitting to estimate M0 (i.e., the same method applied to helicopter profiles). Applying this technique to the NWP data results in converting many surface ducts to nonsurface ducts, so other means of estimating M0 are explored. Using extrapolation to estimate the surface refractivity (M0x) can result in profile changes that create nonsurface ducting conditions and largely depends on the slope between the lowest two points in the NWP (Fig. 3). Alternatively, surface refractivity can be calculated via Eq. (2) using the ensemble member’s estimated sea surface temperature (SST) and assuming a relative humidity of 98% (M0S) (Buck 1981). However, similar to using M0x, using M0S as a prediction of surface refractivity can transform M profiles to nonsurface ducts. It is found that an average of both surface refractivity estimations [
Histogram of RMSE between each ensemble member profile and associated PRM-fit profile for all cases and all levels (nz = 7).
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
Although using
Inversion solutions produced by the GA, which estimate the PRM parameters, zd, m1, and ΔM, are evaluated against the PRM-fit helicopter data using a variety of metrics. Percent errors are calculated between each parameter estimated by inverse solutions (zd, m1, and ΔM) and the corresponding parameters from fits of helicopter profiles (Table 2). RMSE is calculated using the M profiles of the inverse solutions [i.e., inverse parameters used in Eq. (3)] and the M profiles generated using estimated parameters of the helicopter profiles (Table 2) substituted into Eq. (3). Propagation loss (PL) using the inversion-based M profile is compared with PL patterns produced using the PRM-fit helicopter profiles via a weighted MSE [Eq. (6)]. Last, the duration of inverse solutions is evaluated by the number of generations required to reach a fitness score of less than 10 dB2, which is well within the accepted frame of error for propagation studies [e.g., Goldhirsh and Dockery (1998) suggest 25 dB2]. All metrics are evaluated for each inversion solution in the three experiments to evaluate whether the addition of NWP data to the inversion process reduces the duration or improves the accuracy of the inversion.
4. Results and discussion
M profiles resulting from the three inversion experiments, along with modified refractivity based on helicopter measurements, are illustrated in Fig. 6. This figure highlights the wide variety of surface ducts considered in this study, including those with weak M deficits (Figs. 6a,c), strong M deficits (Fig. 6m), low duct heights (Fig. 6b), high duct heights (Figs. 6a,m), and a variety of mixed layer slopes. M profiles from inversion results suggest the refractivity above the duct height is the least accurate part of the modified refractivity profile predicted by the inversions. Furthermore, although there are several cases where both the Random and Ensemble experiments result in accurate M profiles, there are also many cases where these inversion experiments result in inaccurate M profiles. On the contrary, the Spread experiment frequently reproduced the M profile accurately, with the exception of case 10 (Fig. 6j).
The M profiles from three inversion experiments (see the legend) with coinciding helicopter measurements of modified refractivity for each surface ducting case examined in this study.
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
Investigation of case 10’s Spread experiment results (Fig. 6j) revealed that the NWP ensemble did not encompass the refractivity parameters of the helicopter data; further, it was revealed that helicopter-based duct heights were also not encompassed within the NWP ensembles for cases 1 and 3 (Table 2). The parameter search spaces that do not include the helicopter-measured parameters could be due to the nonlinear least squares fitting of NWP ensembles to the PRM [Eq. (3)], or by the estimates of refractivity produced by the NWP ensemble. For the former, multiple methods of nonlinear regression were considered before settling on the method previously described in section 3b, which most often produced fits having RMSEs of 0–4 M units (Fig. 5), which is relatively low. Furthermore, ensembles of cases 1 and 3 produced RMSEs between 0 and 1 M units, while RMSEs for case 10 were between 0 and 5 M units, with a vast majority lying between 2 and 3 M units (still within the overall average). The relatively good performance of fits during these outlying cases leads the authors to think limitations of the NWP ensembles are the more likely reason for the search space inadequacies (Ulate et al. 2019; Zhao et al. 2016; Haack et al. 2010). Haack et al. (2010) state that a common difficulty of COAMPS during the Wallops Island field experiment was accurate prediction of the timing of ducting conditions. Since this timing issue may be the cause of the inaccurate PRM parameter estimates for cases 1, 3, and 10, the authors repeat the Spread experiment for these cases using multiple ensemble forecasts over an extended forecast window to set the search spaces for the inversions. Table 6 illustrates the number of forecast hours needed for the search space to encompass the helicopter data, which varies for each case. Table 6 also shows the resulting parameter search spaces for each experiment. Haack et al. (2010) report that COAMPS predictions tend to have a lag in the formation of surface ducts, and consistent with this result, most of the extended forecasts required to achieve a search space inclusive of the helicopter-based parameters are for forecast hours after the helicopter measurement time (Table 6). Figure 7 demonstrates that extended forecast hours for the Spread experiment improved the estimation of modified refractivity by the inversion process in cases 1 and 3 and especially case 10. As such, all future results and discussions will utilize these extended forecast windows in lieu of the single forecast for the Spread experiment in cases 1, 3, and 10 for the purposes of clarity and conciseness. It should also be noted that the range of each parameter’s search spaces (Table 6) is increased when including extended forecast windows during the Spread experiment; for case 10, the duct height spread (3.3–95 m) is quite similar to the search space set by the GA for the Random and Ensemble experiments (1–90 m).
Extended ensemble forecast hours used to estimate parameter search spaces for select Spread experiment cases. Note that boldface forecast hours are those used in the original Spread experiment. Boldface forecast hours do not reproduce parameter search spaces that contain the parameters estimated by the helicopter data (Table 2) but are forecasts that are closest in time to the helicopter measurements.
The M profiles estimated by Spread experiment inversions for cases (a) 1, (b) 3, and (c) 10, where green lines show results using the closest time ensemble forecast to set the parameter search space of the inversion (i.e., the same results as shown in Figs. 6a,c,j; see Table 5), and blue lines show inversion results using an extended forecast window to set the parameter search spaces of the inversion (see Table 6).
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
RMSEs are calculated between each inversion-estimated modified refractivity profile (
RMSEs between M profiles estimated by each inversion solution and the M profiles calculated from fits of the helicopter data to the PRM [Eq. (3)].
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
Percent errors σp between each experiment’s inversion-estimated refractivity parameter and that based on the helicopter data, for each case. The corresponding parameter estimated from the helicopter data for each case is shown by the black dashed line referenced to the right y axis.
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
Figure 10 shows the fitness scores [Eq. (6); PL MSE] for each case for all experiments. For 27 of the 39 cases examined, the inversions accurately predict PL, evidenced as bars below the PL fitness limit (Table 4); however, there are inversion results that did not reach the fitness limit (12/39). Of these cases, 5, 10, and 12 show higher PL MSEs for the Spread experiment, while cases 1, 4, 8, and 13 PL MSEs are highest during the Random experiment, and case 3 illustrates higher PL MSEs during the Ensemble experiment. For cases where the Spread experiment showed larger PL MSEs than the Random and Ensemble experiments, the difference in PL MSE between the experiments was essentially negligible. Furthermore, these minor differences are mainly driven by positioning of the multipath nulls, for which a small change in position can impact the MSE statistic (Penton and Hackett 2018). On the other hand, cases with high PL MSE in Random experiment cases (1, 4, 8, and 13) are significantly higher than that of the Spread experiment, suggesting that using NWP can improve the accuracy of inverse estimates of refractive parameters that influence PL. Case 13 had the highest PL MSE for all experiments, potentially due to the high duct height, which is higher than half of the altitudinal domain (∼60 m) and/or due to having the strongest M deficit (∼30 M units) of all cases. In fact, none of the inversion results for any of the experiments were able to predict case 13’s PL below the GA’s fitness threshold within 60 generations (Table 4; 0.2 dB2; Penton and Hackett 2018). Overall, the results from the Spread experiment show the most accurate estimates of PL; notably, all estimations of PL throughout all cases and experiments are less than the commonly referenced “baseline error” of 5 dB (MSE of ∼25 dB2) mentioned by Goldhirsh and Dockery (1998).
Weighted PL MSE [Eq. (6)] between PL based on inversion solutions and PL predictions based on the fit helicopter data. The PL fitness limit (Table 4) is shown by the black dashed line.
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
The results thus far have demonstrated that, on average, inversions were more accurate with the use of NWP to constrict the inversion search space; in addition, using NWP could also have advantages by reducing the duration required for the inversion to converge on an accurate solution. Obtaining solutions in less time could be integral for applications targeting approximately real-time environmental sensing. As such, we compare the duration required for the inversion technique to converge on an accurate solution using the number of generations required to estimate PL to an MSE threshold of less than 10 dB2, as illustrated in Fig. 11. We use the number of generations as the duration metric because computational times vary considerably based on computer hardware; thus, the use of generations is a machine-independent metric of duration.
Number of generations for each inversion to reach a PL MSE [Eq. (6)] of less than 10 dB2 along with associated statistics over all cases shown in the embedded text boxes.
Citation: Journal of Applied Meteorology and Climatology 62, 9; 10.1175/JAMC-D-22-0127.1
Figure 11 shows that, most conclusively, the Spread experiment had the shortest inversion duration a majority of the time (9/13 cases), suggesting that the use of NWP data to constrain the search space decreases the duration required to estimate an accurate PL environment. However, in 4/13 inversion cases (6, 7, 10, and 12), the Random experiment had the shortest duration of all experiments. This result is not surprising since the random initial population could serendipitously be closer to the actual solution than the Spread experiment on occasion, which would allow the inversion to evolve to a correct answer quickly by random chance via elitism. Conversely, the ensemble experiment performs slower than one (or both) of the other experiments for all cases. This result suggests that using NWP ensembles to set the initial population did not reduce the duration of the inversions. However, the Ensemble experiment likely performed worse than the Random experiment in terms of duration because of the lower spread of the initial population in comparison with the Random experiment initial population. Although the initial population used by the Ensemble experiment was presumably closer to the “true” answer and physically realistic, mutation and crossover to the optimal solution are more hindered by using NWP ensembles as the initial population due to its relative uniformity. These results align with those found by Zhao and Huang (2014), who found that too much regularization can hinder the accuracy of an inversion in reproducing accurate environments.
This uniformity of initial populations based on NWP ensembles likely occurs when NOGAPS initialization fields and the ensemble perturbations result in similar NWP forecasts for all ensemble members. Larger ensemble spreads could suggest larger uncertainty in the NWP forecasts, while smaller spreads could suggest less uncertainty in the NWP forecasts. In other words, a forecast that has a higher uncertainty may actually be more beneficial to the duration of the inversion since its initial population has a larger parameter spread. However, the occurrence of these uniform ensembles should be further investigated to determine the validity of this hypothesis.
The fusion of NWP ensemble data with a GA-based inversion approach clearly provided encouraging results, which in many cases benefited either the accuracy or duration (or both) of the inversion result; however, the necessity to use the extended ensemble forecasts during the Spread experiment in a few cases brings to light a few points of discussion. First, all Spread experiment cases, which required extended forecast hours to establish valid parameter search spaces for the inversion, were at least 5 h from the model initialization time. Second, parameters estimated using the helicopter profiles for cases 1 and 3, which required extended ensemble forecasts, both illustrate the smallest M deficits of all cases. These latter observations may suggest that utilizing multiple ensemble forecasts is necessary to aid inversion processes when M deficits are small, but a larger number of cases with small M deficits is needed to test this hypothesis. Last, case 10 required an extended time frame of many ensemble forecasts (Table 6) to produce parameter search spaces that contained the fit helicopter parameters (Table 2). Upon further inspection, the need for many ensemble forecasts stems from the fact that consecutive hourly ensemble forecasts were relatively uniform in terms of the (fit) parameter search spaces. Thus, to incorporate the helicopter fit parameters, many additional forecasts were needed. This fact makes it difficult for the authors to recommend a set number of ensemble forecasts that can be sufficiently used to ensure parameter search spaces contain the fit helicopter parameters, because it depends on the steadiness of the modeled environment. Further research should investigate more cases such as those in 1, 3, and 10 to determine how many ensemble forecasts are typically needed for the search spaces to be inclusive of fit helicopter parameters. Thus, although using ensemble NWP to aid refractivity inversions is seemingly beneficial to estimating surface ducting conditions, it is important to use these data only when NWP ensembles have a large spread and do not produce extremely similar environments; otherwise, a GA-based inversion process may not benefit from this additional information (and it may in fact hinder the inversion process).
5. Summary and conclusions
This study uses numerical weather prediction ensembles to aid a GA-based inversion technique, which uses synthetic propagation loss data based on measured refractivity profiles taken during surface ducting conditions off the coast of Wallops Island, Virginia. Refractivity profiles are modeled using a simple two-layer parametric refractivity model, which accurately describes modified refractivity profiles during surface ducting conditions, and is used to simplify the number of variables estimated by the inversion process. Numerical weather prediction ensembles are used to both initialize and constrain the search space of the inversion technique. These results are compared with a control inversion set that has no influence from NWP. Limited to no benefit is found by using each NWP ensemble member as an initial population member for the genetic algorithm inversion technique; however, using them to constrict the parameter search space of the inversion technique benefited either accuracy or duration (or both) for the majority of inversion results. Furthermore, when the ensemble spread is small, the “true” solution has a high chance of falling outside of the ensemble search space. If this happens, using these ensembles will have a negative impact on the inversion result. In fact, in a few cases, extended forecast hours had to be used to ensure that the ensembles contained the true solution. This forecast extension would be difficult to predict a priori, and further research on the likelihood of ensembles not containing an observed condition is needed. Thus, overall, the authors recommend initializing GA-based inversions using NWP only when NWP ensembles have a large spread, or during times when NWP forecasts are expected to contain high uncertainty. Admittingly with a few limitations, this study reveals that NWP ensembles can often be used to enhance inversion accuracy and reduce inversion duration, offering a promising step forward in the fusion of NWP with refractivity inversion problems.
COAMPS is a registered trademark of the Naval Research Laboratory.
Acknowledgments.
The authors thank Frank Ryan (Applied Technology, Inc.) for providing the VTRPE simulation, Stephen Penton for his assistance with the GA setup, Douglas Pastore for his assistance with some of the early GA experiments, and Andrew Kammerer for his help with minor revisions of the paper. We also thank the Office of Naval Research and Program Officer Dr. Steven Russell for their support of this research (Grant N00014-16-1-2075). This work was also supported in part by the Research Experiences for Undergraduates program at the National Science Foundation (Award AGS-1560210).
Data availability statement.
Access to the helicopter and NWP ensemble modified refractivity and their associated optimized refractivity parameters, inverse solutions, and associated propagation predictions are available at the Mendeley data repository (https://data.mendeley.com/datasets/2sv737k56h/draft?a=c409cffc-02fb-4bb2-94ff-f7e20a2ba859).
REFERENCES
Alappattu, D. P., Q. Wang, R. T. Yamaguchi, T. Haack, M. Ulate, H. J. Fernando, and P. Frederickson, 2022: Electromagnetic ducting in the near-shore marine environment: Results from the CASPER-East field experiment. J. Geophys. Res. Atmos., 127, e2022JD037423, https://doi.org/10.1029/2022JD037423.
Babin, S. M., 1995: A case study of subrefractive conditions at Wallops Island, Virginia. J. Appl. Meteor., 34, 1028–1038, https://doi.org/10.1175/1520-0450(1995)034%3C1028:ACSOSC%3E2.0.CO;2.
Babin, S. M., 1996: Surface duct height distributions for Wallops Island, Virginia, 1985–1994. J. Appl. Meteor., 35, 86–93, https://doi.org/10.1175/1520-0450(1996)035<0086:SDHDFW>2.0.CO;2.
Babin, S. M., and J. R. Rowland, 1992: Observation of a strong surface radar duct using helicopter acquired fine‐scale radio refractivity measurements. Geophys. Res. Lett., 19, 917–920, https://doi.org/10.1029/92GL00562.
Bean, B. R., and E. J. Dutton, 1968: Radio Meteorology. Dover Publications, 435 pp.
Bolton, D., 1980: The computation of equivalent potential temperature. Mon. Wea. Rev., 108, 1046–1053, https://doi.org/10.1175/1520-0493(1980)108<1046:TCOEPT>2.0.CO;2.
Buck, A. L., 1981: New equations for computing vapor pressure and enhancement factor. J. Appl. Meteor., 20, 1527–1532, https://doi.org/10.1175/1520-0450(1981)020<1527:NEFCVP>2.0.CO;2.
Fairall, C. W., E. F. Bradley, D. P. Rogers, J. B. Edson, and G. S. Young, 1996: Bulk parameterization of air-sea fluxes for Tropical Ocean-Global Atmosphere Coupled-Ocean Atmosphere Response Experiment. J. Geophys. Res., 101, 3747–3764, https://doi.org/10.1029/95JC03205.
Fairall, C. W., E. F. Bradley, J. E. Hare, A. A. Grachev, and J. B. Edson, 2003: Bulk parameterization of air–sea fluxes: Updates and verification for the COARE algorithm. J. Climate, 16, 571–591, https://doi.org/10.1175/1520-0442(2003)016<0571:BPOASF>2.0.CO;2.
Frederickson, P., 2017: Navy atmospheric measurements for EM propagation modeling (executive summary). Naval Postgraduate School 2016 Annual Report, Naval Postgraduate School, 155–159, https://nps.edu/documents/104914977/106108992/NRP+Annual+Report+FY16.pdf/7b1d009f-f4a1-4179-be2b-8f3d58a94583?version=1.3&t=1500406184000&download=true.
Garratt, J. R., 1992: The Atmospheric Boundary Layer. Cambridge University Press, 316 pp.
Gerstoft, P., L. T. Rogers, J. L. Krolik, and W. S. Hodgkiss, 2003: Inversion for refractivity parameters from radar sea clutter. Radio Sci., 38, 8053, https://doi.org/10.1029/2002RS002640.
Goldhirsh, J., and D. Dockery, 1998: Propagation factor errors due to the assumption of lateral homogeneity. Radio Sci., 33, 239–249, https://doi.org/10.1029/97RS03321.
Gordon, N. D., A. K. Ascencio, T. Rogers, T. Haack, and A. Zhao, 2015: Background covariance of atmospheric duct properties based on ensembles. 2015 USNC-URSI Radio Science Meeting (Joint with AP-S Symp.), Vancouver, BC, Canada, Institute of Electrical and Electronics Engineers, 248, https://doi.org/10.1109/USNC-URSI.2015.7303532.
Greenway, D. P., 2020: Parametric model development for heterogeneous atmospheric conditions. M.S. thesis, Dept. of Coastal and Marine Systems Science, Coastal Carolina University, 143 pp., https://digitalcommons.coastal.edu/cgi/viewcontent.cgi?article=1180&context=etd.
Haack, T., and S. D. Burk, 2001: Summertime marine refractivity conditions along coastal California. J. Appl. Meteor., 40, 673–687, https://doi.org/10.1175/1520-0450(2001)040<0673:SMRCAC>2.0.CO;2.
Haack, T., C. Wang, S. Garrett, A. Glazer, J. Mailhot, and R. Marshall, 2010: Mesoscale modeling of boundary layer refractivity and atmospheric ducting. J. Appl. Meteor. Climatol., 49, 2437–2457, https://doi.org/10.1175/2010JAMC2415.1.
Hodur, R. M., 1997: The Naval Research Laboratory’s Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS). Mon. Wea. Rev., 125, 1414–1430, https://doi.org/10.1175/1520-0493(1997)125<1414:TNRLSC>2.0.CO;2.
Hogan, T. F., and T. E. Rosmond, 1991: The description of the Navy Operational Global Atmospheric Prediction System’s spectral forecast model. Mon. Wea. Rev., 119, 1786–1815, https://doi.org/10.1175/1520-0493(1991)119<1786:TDOTNO>2.0.CO;2.
Karimian, A., C. Yardim, P. Gerstoft, W. S. Hodgkiss, and A. E. Barrios, 2011: Refractivity estimation from sea clutter: An invited review. Radio Sci., 46, RS6013, https://doi.org/10.1029/2011RS004818.
Karimian, A., C. Yardim, T. Haack, P. Gerstoft, W. S. Hodgkiss, and T. Rogers, 2013: Toward the assimilation of the atmospheric surface layer using numerical weather prediction and radar clutter observations. J. Appl. Meteor. Climatol., 52, 2345–2355, https://doi.org/10.1175/JAMC-D-12-0320.1.
Kulessa, A. S., and Coauthors, 2017: The Tropical Air–Sea Propagation Study (TAPS). Bull. Amer. Meteor. Soc., 98, 517–537, https://doi.org/10.1175/BAMS-D-14-00284.1.
Lentini, N. E., and E. E. Hackett, 2015: Global sensitivity of parabolic equation radar wave propagation simulation to sea state and atmospheric refractivity structure. Radio Sci., 50, 1027–1049, https://doi.org/10.1002/2015RS005742.
Matsko, I. J., and E. E. Hackett, 2019: Impact of radar data sampling on the accuracy of atmospheric refractivity inversions over marine surfaces. Radio Sci., 54, 704–714, https://doi.org/10.1029/2018RS006757.
McLay, J. G., C. H. Bishop, and C. A. Reynolds, 2008: Evaluation of the ensemble transform analysis perturbation scheme at NRL. Mon. Wea. Rev., 136, 1093–1108, https://doi.org/10.1175/2007MWR2010.1.
McLay, J. G., C. H. Bishop, and C. A. Reynolds, 2010: A local formulation of the ensemble transform (ET) analysis perturbation scheme. Wea. Forecasting, 25, 985–993, https://doi.org/10.1175/2010WAF2222359.1.
Michalakes, J., S. Chen, J. Dudhia, L. Hart, J. Klemp, J. Middlecoff, and W. Skamarock, 2001: Development of a next-generation regional weather research and forecast model. Developments in Teracomputing, World Scientific, 269–276.
Pastore, D. M., D. P. Greenway, M. J. Stanek, S. E. Wessinger, T. Haack, Q. Wang, and E. E. Hackett, 2021: Comparison of atmospheric refractivity estimation methods and their influence on radar propagation predictions. Radio Sci., 56, e2020RS007244, https://doi.org/10.1029/2020RS007244.
Pastore, D. M., S. E. Wessinger, D. P. Greenway, M. J. Stanek, R. J. Burkholder, T. Haack, Q. Wang, and E. E. Hackett, 2022: Refractivity inversions from point-to-point X-band radar propagation measurements. Radio Sci., 57, e2021RS007345, https://doi.org/10.1029/2021RS007345.
Peng, M. S., J. A. Ridout, and T. F. Hogan, 2004: Recent modifications of the Emanuel convective scheme in the Navy Operational Global Atmospheric Prediction System. Mon. Wea. Rev., 132, 1254–1268, https://doi.org/10.1175/1520-0493(2004)132<1254:RMOTEC>2.0.CO;2.
Penton, S. E., and E. E. Hackett, 2018: Rough ocean surface effects on evaporative duct atmospheric refractivity inversions using genetic algorithms. Radio Sci., 53, 804–819, https://doi.org/10.1029/2017RS006440.
Pozderac, J., J. Johnson, C. Yardim, C. Merrill, T. de Paolo, E. Terrill, F. Ryan, and P. Frederickson, 2018: X-band beacon-receiver array evaporation duct height estimation. IEEE Trans. Antennas Propag., 66, 2545–2556, https://doi.org/10.1109/TAP.2018.2814060.
Rogers, L. T., C. P. Hattan, and J. K. Stapleton, 2000: Estimating evaporation duct heights from radar sea echo. Radio Sci., 35, 955–966, https://doi.org/10.1029/1999RS002275.
Rowland, J. R., G. C. Konstanzer, M. R. Neves, R. E. Miller, J. H. Meyer, and J. R. Rottier, 1996: Seawasp: Refractivity characterization using shipboard sensors. Proc. 1996 Battlespace Atmospheric Conf., San Diego, CA, Naval Command, Control and Ocean Surveillance Center, 155–164.
Ryan, F. J., 1991: User’s guide for the VTRPE (variable terrain radio parabolic equation) computer model. Naval Ocean Systems Center Tech. Rep. 1456, 59 pp., https://apps.dtic.mil/sti/pdfs/ADA248112.pdf.
Saeger, J. T., N. G. Grimes, H. E. Rickard, and E. E. Hackett, 2015: Evaluation of simplified evaporation duct refractivity models for inversion problems. Radio Sci., 50, 1110–1130, https://doi.org/10.1002/2014RS005642.
Sirkova, I., 2012: Brief review on PE method application to propagation channel modeling in sea environment. Cent. Eur. J. Eng., 2, 19–38, https://doi.org/10.2478/s13531-011-0049-y.
Sirkova, I., 2015: Duct occurrence and characteristics for Bulgarian Black sea shore derived from ECMWF data. J. Atmos. Sol.-Terr. Phys., 135, 107–117, https://doi.org/10.1016/j.jastp.2015.10.017.
Skolnik, M. I., 1990: Radar Handbook. 2nd ed. McGraw-Hill, 846 pp.
Thompson, W. T., and T. Haack, 2011: An investigation of sea surface temperature influence on microwave refractivity: The Wallops-2000 experiment. J. Appl. Meteor. Climatol., 50, 2319–2337, https://doi.org/10.1175/JAMC-D-10-05002.1.
Ulate, M., Q. Wang, T. Haack, T. Holt, and D. P. Alappattu, 2019: Mean offshore refractive conditions during the CASPER East field campaign. J. Appl. Meteor. Climatol., 58, 853–874, https://doi.org/10.1175/JAMC-D-18-0029.1.
Wang, J., and R. L. Bras, 2010: An extremum solution of the Monin–Obukhov similarity equations. J. Atmos. Sci., 67, 485–499, https://doi.org/10.1175/2009JAS3117.1.
Xu, L., C. Yardim, and T. Haack, 2022: Evaluation of COAMPS boundary refractivity forecast accuracy for 2–40 GHz electromagnetic wave propagation. Radio Sci., 57, e2021RS007404, https://doi.org/10.1029/2021RS007404.
Zhao, Q., T. Haack, J. McLay, and C. Reynolds, 2016: Ensemble prediction of atmospheric refractivity conditions for EM propagation. J. Appl. Meteor. Climatol., 55, 2113–2130, https://doi.org/10.1175/JAMC-D-16-0033.1.
Zhao, X., and S. Huang, 2014: Atmospheric duct estimation using radar sea clutter returns by the adjoint method with regularization technique. J. Atmos. Oceanic Technol., 31, 1250–1262, https://doi.org/10.1175/JTECH-D-13-00025.1.