Introduction
Spatial filtering techniques are well known through their wide usage in reducing noise effects of different observing systems. The nominal objective is to determine a function (filter) over a spatially varying measurement that provides an optimal (in some sense) measurement estimate. Currently, in the routine processing of the Geostationary Operational Environmental Satellite (GOES) sounder spectral measurements, linear averaging over 3 × 3 elements is used as the spatial filter for all spectral channels. This uniform spatial filter inadequately reduces the noise effects for some channels and overly smoothes the spatial variations for other channels. Our goal is to find an optimal size for the averaging area, also called the field of regard (FOR) in this paper, for each GOES-8 sounder spectral channel.
In section 2, we consider the physical aspects of the noise filtering problem in atmospheric remote sensing. In section 3, a traditional mathematical model of noise filtering is introduced; then in section 4 we consider the results of a statistical spatial analysis of the spectral measurements and estimate the appropriate size of the spatial filter for each GOES-8 sounder spectral channel. In section 5, results of temperature profile retrievals using spatially filtered spectral measurements are presented. Conclusions are offered in section 6.
Physical considerations
GOES sounder measurements contain noise that varies substantially from one spectral channel to another. The measured radiances are a composite function of the optical properties of the GOES sounder instrument and the thermodynamical properties of the “earth surface and atmosphere” system. The latter are described by the surface emissivity, surface temperature, and atmospheric vertical profiles of moisture and temperature. These parameters have different spatial distributions (that can also be thought of as spectra). Surface properties of land can vary drastically and are found in the shortwave part of the spatial spectrum. Atmospheric moisture fields are smoother and correspondingly they are attributed to the median-wave part of the spatial spectrum; and atmospheric temperature fields are attributed in the first approximation to the longwave part of the spatial spectrum. Temperature and moisture fields become smoother with increasing height, and thus their spatial spectral properties shift in the direction of the longer spatial waves. We observe these spatial properties in the GOES sounder spectral measurements of outgoing thermal radiances of the “earth surface–atmosphere” system; a spectral measurement describes a specific atmospheric layer (sometimes in combination with the surface) and will have the corresponding spatial properties. Spectral bands sensitive to upper tropospheric and stratospheric layers, where radiances are not disturbed by clouds or the surface, exhibit large spatial uniformity and, therefore, shortwave spatial variation of the radiances describes the noise component of these measurements. The differences between spatial spectrums of measurement noise and meteorological parameters can be effectively used to reduce the influence of noise on the solution of the atmospheric profile retrieval;the objective is to estimate the spatial distribution of a meteorological parameter on the basis of measurements in the radiance spectrum.
The physical model of a spectral measurement is based upon the radiative transfer equation (RTE), which is Fredholm’s equation of the first kind. The corresponding inverse problem is ill posed. There is no one-to-one relation between spectral measurements and meteorological parameters. The solution of the problem is unstables; a small variation in a measurement and/or a physical model of a measurement can cause significant variation in the solution. It must be noted that the RTE is nonlinear with respect to all parameters: surface emissivity and temperature as well as atmospheric temperature and moisture profiles. For such an ill-posed problem, the mean solution of individual measurements (after spatial averaging of solutions within the field of regard) could substantially differ from the solution for the mean measurement (after spatial averaging of measurements within the field of regard). Thus, noise filtering will depend on the noise spectral distribution, the signal spectral and spatial distribution, the physical properties of the desired parameters and model parameters, and the numerical properties of the corresponding inverse problem.
Noise filtering
In principle, we can use this approach {measuring σ2[δf(Δ)] for different Δ} to estimate model components, σξ, M̈ from which we can estimate the optimal
Analysis of measurements
GOES-8 sounder spectral channels and their intended purposes are presented in Table 1. The temperature-weighting functions, moisture sensitivities, and atmospheric transmittances are shown in Fig. 1. It follows from Fig. 1 that there are many similarities in the vertical distribution of the contributions to the measurement among the different longwave and shortwave spectral bands: channels 3 and 15 (in Fig. 1a), channels 4, 5, and 14 (in Fig. 1a), and channels 6, 7, 13, and 16 (in Fig. 1b) have very similar weighting functions. From Figs. 1b,c, it follows that the measurements in channels 10 and 11 will have similar spatial characteristics with respect to both temperature and moisture. Then the horizontal spatial structure of measurement variations in channels 10 and 11 with respect to the temperature should correspond to the horizontal spatial structure of measurements in spectral channels 3–5 and 13–15.
Instrument noise values (converted into a temperature value for a target temperature appropriate to each spectral channel observing a typical meteorological scene) are presented in Fig. 2. Significant variations from one spectral channel to another are evident. The statistical functions (13–21) have been applied to measurements from 1000 UTC on 13 August 1999; this nighttime scene was selected because the conditions on the surface were somewhat homogenous and solar reflection in the shortwave bands was avoided. All 18 channels were analyzed. We are especially interested in channels 1, 2, 3, 4, 12, 14, and 15 because they are substantially affected by noise. They are not disturbed by surface effects (see Fig. 1) and are sensitive to layers of the atmosphere where the temperature fields are sufficiently smooth. We expect the spatial smoothing to be most effective for noise reduction in these channels.
To summarize the results of the spatial analysis of the spectral measurements in GOES sounder channel 1, see the following:
The measurements are very contaminated by noise, so that substantially different properties are observed than those described by a white noise model. The noise is spatially correlated.
Variations in the thermal field are sufficiently small that a noise spatial filtering with an averaging domain of 11 × 11 elements can be used. The comparison of median and linear estimates shows that the latter is preferable. The linear estimate indicates that the approximation accuracy variance is better than 0.06 K2 for a field of regard with 11 × 11 elements.
Estimates of spatial roughness σ2[δL(f̂)] of averaged measurements for median and linear estimates in spectral channels of the GOES-8 sounder for different averaging domains (or fields of regard) are presented in Table 3. The spectral field is modeled using the temperature and moisture fields derived from the Eta Model forecast (Black 1994; Rogers et al. 1996) up to 100 hPa and extrapolated into the upper pressure levels 100–0.1 hPa. The spatial roughness is less than 0.057 K2 in all spectral channels under a constant surface temperature and emissivity. The minimum spatial roughness of the averaged measurements should be found in the stratospheric channels 1 and 2 and upper-tropospheric channels 3, 12, and 15 (see Fig. 1), starting from 0.057 K2. The spatial roughness should increase in the midtropospheric channels and reach a maximum of about 0.44–0.60 K2 in channels 7, 8, 17, and 18 (the “atmospheric window”). Using (25) to compare the spatial roughness for the median and linear estimations, we find that the linear estimate is optimal in channels 1, 2, 3, and 12. Figure 4 shows the spatial roughness σ2[δL(f̂)] with spatial averaging of 3 × 3 elements for all the spectral channels of the GOES-8 sounder (see Table 3, median estimate n = 1). The spectral distribution of spatial roughness does not correspond to the associated horizontal thermal structure of the atmosphere; consequently, the solution to the inverse problem will not reproduce them either. Comparing Figs. 2 and 4 shows that spatial roughness from Fig. 4 reproduces spectral distribution of the noise maximums from Fig. 2. This means that a uniform 3 × 3 spatial averaging is not effective.
Statistics for channels 3 and 4 demonstrate different properties than the statistics in channels 1 and 2. We observe a linear increase of σ2(δf) with increasing Δ that can be attributed to the signal spatial variation. Channel 8 atmospheric window measurements, which have a maximum surface contribution and therefore significant spatial variation, demonstrate a linear increase as well. Thus channels 3 and 4 cannot be processed in the same way as channels 1 and 2. Signal spatial variations σ2[δL(f)] for channels 3 and 4 equal 4.0 and 4.1 K2, respectively, which is 3 orders of magnitude larger than the spatial variation obtained for channel 2 (Fig. 5c). Measurements in channels 3 and 4 are not contaminated by surface effects or atmospheric moisture. Channel 3 must be spatially smoother than channel 4. In Figs. 5a,c, we find that the appropriate dimension for the spatial averaging is n3 = 2 for channel 3 and n4 = 1 for channel 4. Figure 2 suggests an approximation accuracy of better than 0.2 K for channels 3 and 4. Measurements in channel 4 can be affected by clouds, thus a median estimate is preferable.
Channel 5 measurements are noticeably noisier (by a factor of at least 3) than measurements in channel 4 (after averaging) and channel 6 (Fig. 2). Channel 5 measurements are affected by the surface and midtropospheric moisture (see Figs. 1c,d). Figures 5b,d statistics for channel 5, σ2(δf5) and σ2[δL(f̂5)], show features associated with window channels, in which measurement variations are mostly affected by spatial variations in surface temperature/emissivity and lower-tropospheric moisture. Channel 5 should have substantially different spatial properties than an atmospheric window, but Fig. 5d shows that the atmospheric signal in channel 5 has features dominated by the large surface signal in channel 8 (with respect to the spatial averaging). This contradiction suggests that the statistics in channels sensitive to the mid- and lower troposphere are affected by another factor. Another indication is the linear increase of σ2[δL(f̂6–8)] with respect to Δ (Fig. 5b). According to (13) and (20), σ2[δL(f̂6–8)] should increase with Δ4; the discrepancy between measurement and prediction could be explained by an interaction of nonhomogeneity effects in the data sample between “cloudy–clear” nonhomogeneity of atmospheric conditions, and “land surface–sea surface” nonhomogeneity of surface conditions. In different conditions, the estimate of the second derivative M̈ in (13) and (20) will be substantially different. For example, in overcast conditions window channel measurements can be spatially smoother than atmospheric channel measurements. The same can be true for measurements in cloudless atmospheres over sea surfaces. Last, in channel 5 we note that spatial averaging n5 = 1 avoids the spatial oscillation of moisture estimates in the midtroposphere (see Fig. 1c) and provides the same spatial smoothness as channel 4: σ2[δL(f̂5)] = 0.4 K2. In comparison, the natural signal spatial variation is σ2[δL(f5)] = 4.7 K2.
Channels 6–8 have significant signal spatial variation. The statistics σ2[δL(f6–8)] have values 6.0, 6.2, and 6.0 K2, respectively. There is no physical reason to apply spatial averaging with these signal properties.
Statistics for channels 9–16 are shown in Fig. 6. Measurements in channel 9 depend on surface temperature and emissivity, upper-tropospheric temperature, and ozone. Channel 9 statistics are similar to those in channels 4 and 5 in Figs. 5a,c, from which we conclude that n9 = 1 should be applied. Measurements in channels 10–12 depend on mid- and upper-tropospheric temperature and moisture. The surface slightly affects measurements in channel 10. The statistics σ2[δL(f10–12)] have values 3.1, 2.4, and 9.1 K2, respectively. For comparison, in channels 7 and 8 the corresponding statistics have values 6.2 and 6.0 K2, respectively. Measurements in channels 10 and 11 are smooth, in comparison with channels 3–8. Channel 12 is noisy. Figure 6a shows that channels 10 and 11 statistics have spatial variations. Figure 6c shows that spatial filtering in channels 10 and 11 can cause a loss of information regarding moisture spatial variations. In Figure 6a, σ2(δf12) is slowly increasing with increasing n (or Δ). Channel 12 reveals the spatial variations of midtropospheric temperature and upper-tropospheric moisture; both fields are sufficiently smooth. Corresponding thermal fields are described by measurements in channels 3 and 4 (see Fig. 5a), for which we estimated the spatial variation to be 0.18–0.38 K2. From Fig. 6c, we see that the filter dimension n12 = 2 provides the required spatial smoothness in channel 12; a linear estimate is preferable. In Figs. 6a,c, the observed noise in channel 12 is noticeably larger, by a factor of at least 4–5, than the noise in Fig. 2. As with channels 1 and 2, we conclude that the noise in channel 12 has a spatially correlated component. When filtering channel 12, the scale of spatial variations in channels 11 and 12 must be similar (see Figs. 1b,c). To make them comparable in this sense, we use the filter with the dimension n11 = 1 in channel 11 (see Fig. 6c). Last, we conclude from the statistics that channel 10 n10 = 1 should be used to provide vertical homogeneous property to the inverse problem solution.
Channels 17 and 18 have σ2[δL(f17,18)] of 9.3 and 7.8 K2, respectively; these values are noticeably larger than σ2[δL(f7,8)] in the longwave window channels 7 and 8 (6.2 and 6.0 K2, respectively). Here, σ2(δf) and σ2[δL(f̂)] in channels 17 and 18 are presented in Fig. 7 (along with channel 8 for comparison). Figure 7a shows that σ2(δf) in channels 8, 17, and 18 is similar, indicating that there are some similarities in the measurement properties of the short- and longwave window channels. However, Fig. 7b shows that the measurements in the short- and longwave window channels have noticeably different spatial properties (see also Fig. 4). Those differences cannot be attributed to differences in noise. Here, σ2(δf) for channels 17 and 18 decreases faster than in channel 8; it becomes even less in channels 17 and 18 than in channel 8 with increasing n (or Δ). At larger n (or Δ) the difference seems to become constant. In contrast, channels 5–8 in Fig. 5d do not demonstrate such properties. Observed differences in σ2[δL(f17,18)], σ2[δL(f7,8)], σ2[δL(f̂17,18)], and σ2[δL(f̂8)] could be explained by variations in surface optical properties within the spectrum. Thus properties (spatial and spectral) of the measurements in channels 13, 16–18 noticeably differ from the properties of the measurements in channels 5–8. The longwave spectral measurements play a basic role in the solution of inverse problem. The spatial smoothing is not applied to the measurements in channels 6–8, because the signal has a substantial spatial variation and the noise influence is comparatively small. However, the spatial filtering in channels 13, 16–18 is mostly responding to the properties of the inverse problem and the spectral model used, and therefore the consideration of the signal filtering is appropriate. Figures 6d and 7b (as compared with Fig. 5d) show that we can reduce observed differences between short- and longwave spectral measurements using the spatial filter with dimensions n13 = 2, n16 = 2, n17 = 2, and n18 = 2 in channels 13 and 16–18.
Table 4 presents a summary of the spatial averaging;it presents the dimensions of the spatial filter Δ, an estimate of the spatial roughness σ2[δL(f̂)] (K2), and the approximation accuracy
Comparing temperature retrievals for two spatial averaging strategies
Measurements from the GOES-8 sounder at 1000 UTC on 13 August 1999 were processed using two spatial averaging strategies: the variable spatial averaging suggested in Table 3 and the uniform 3 × 3 spatial averaging currently used routinely (Menzel et al. 1998). Temperature profiles for the two datasets were compared with radiosonde observations (raob) from 1200 UTC on 13 August 1999. The collocation distance is within 0.5° latitude and 0.5° longitude. Twenty-seven raobs and 831 retrievals (in cloud-free conditions) were matched. The geographical location of the collocated soundings is shown in Fig. 8a. The average absolute differences of GOES sounder temperature profiles versus raob temperature measurements for 20–400 hPa are shown in Fig. 8b. The results of processing radiances with the variable spatial averaging (plot 2) are noticeably better than the results of processing radiances with the uniform 3 × 3 spatial averaging (plot 1).
Conclusions
Noise reduction in the GOES sounder measurements was investigated in order to estimate the appropriate size of a simple square filter for each spectral channel as a function of the instrument noise and spatial variability of the detected radiation. A data analysis technique was developed using a traditional statistical approach to spatial filtering of noise. The physical basis for the technique is that estimates of the radiance fields (resulting from the spatial filtering) should be sufficiently smooth spatially and spectrally so that the retrieved meteorological fields exhibit appropriate spatial smoothness. In this sense, the technique can be considered as a simplification of 3D to 2D filtering, with some restrictions imposed on the spatial and spectral roughness of the spectral measurements.
Analysis of GOES-8 sounder data indicates that the measurements are noisier than the instrument noise specification. In addition, the noise exhibits spatial correlation. Visual inspection of the spectral images reveals line to line spatially correlated noise attributed to detector recovery or smearing (after a “hot scene” the detector observes a “cold scene”) or to calibration instability.
For the GOES-8 sounder dataset from 1000 UTC 13 August 1999, a spatial filter was estimated for each spectral channel. Profiles were retrieved from the radiative transfer equation. Solving the inverse problem involved estimating the surface emissivity and temperature (attributed to the shortwave spatial domain) as well as the atmospheric temperature and moisture profiles (where the spatial domain varies strongly with height from the shortwave in the atmospheric boundary layer to the longwave in the upper troposphere and stratosphere). The linear dimension of the spatial averaging filter ranges from 1 element in the longwave spectral window (channels 6–8) to 13 elements in the shortwave sounding channel 15. Retrievals from the variable filter are improved over those from a constant 3-element square filter.
Acknowledgments
The authors gratefully acknowledge the useful discussions with Mr. Tim Schmit of the NESDIS Office of Research and Applications in the drafting of this paper. This work was supported by the NOAA/NESDIS Grant NA67EC0100.
REFERENCES
Black, T. L., 1994: The new NMC Mesoscale Eta Model: Description and forecast examples. Wea. Forecasting,9, 265–278.
Hall, E. L., 1979: Computer Image Processing and Recognition. Academic Press, 584 pp.
Menzel, W. P., F. C. Holt, T. J. Schmit, R. M. Aune, A. J. Schreiner, G. S. Wade, G. P. Ellrod, and D. G. Gray, 1998: Application of the GOES-8/9 soundings to weather forecasting and nowcasting. Bull. Amer. Meteor. Soc.,79, 2059–2078.
Rogers, E., T. L. Black, D. G. Deaven, G. J. DiMego, Q. Zhao, M. Baldwin, N. W. Junker, and Y. Lin, 1996: Changes to the operational “early” Eta analysis/forecast system at the National Centers for Environmental Prediction. Wea. Forecasting,11, 391–413.
Rosenfeld, A., and A. C. Kak, 1982: Digital Picture Processing. 2d ed. Vol. 1, Academic Press, 435 pp.
Spectral channels of GOES-8 atmospheric sounder
Spatial statistical characteristics of measurements from channel 1 (GOES-8 sounder) for various fields of regard; there are (2n + 1)2 fields of view in the field of regard
Spatial roughness of σ2[δL(f̂)] (K2) of measurements in spectral channels of the GOES-8 sounder (median and linear estimations) for various fields of regard; there are (2n + 1)2 fields of view in the field of regard
Dimensions of spatial filter for noise reduction, spatial roughness, and approximation accuracy of measurement estimate in spectral channels of GOES-8 sounder (L—linear, M—median)