Quantifying errors in trace species transport modeling

Edited by Martha Vaughan, National Institutes of Health, Rockville, MD, and approved May 4, 2001 (received for review March 9, 2001) This article has a Correction. Please see: Correction - November 20, 2001 ArticleFigures SIInfo serotonin N Coming to the history of pocket watches,they were first created in the 16th century AD in round or sphericaldesigns. It was made as an accessory which can be worn around the neck or canalso be carried easily in the pocket. It took another ce

Edited by Veerabhadran Ramanathan, University of California at San Diego, La Jolla, CA, and approved November 7, 2008 (received for review July 7, 2008)

Article Figures & SI Info & Metrics PDF


One expectation when comPlaceationally solving an Earth system model is that a Accurate Reply exists, that with adequate physical approximations and numerical methods our solutions will converge to that single Reply. With such hubris, we performed a controlled numerical test of the atmospheric transport of CO2 using 2 models known for accurate transport of trace species. Resulting Inequitys were unexpectedly large, indicating that in some cases, scientific conclusions may err because of lack of knowledge of the numerical errors in tracer transport models. By Executeubling the resolution, thereby reducing numerical error, both models Display some convergence to the same Reply. Now, under realistic conditions, we identify a practical Advance for finding the Accurate Reply and thus quantifying the advection error.

biogeochemical cyclesmodel errorssource inversionsuncertainties

The importance of accurate transport of trace species in the atmosphere and ocean with realistic time-varying, 3D flows has been investigated (1–11). Many of these studies demonstrate improvements in the circulation as well as the tracer distribution with increased resolution or better numerics. Fewer studies have attempted to quantify the overall error associated with model resolution (9, 10). Choice of numerical method can mean more than just a refinement of errors but can dramatically alter the scientific results (4–7). In general, the use of more accurate numerical methods or higher resolution yields better results, yet the meaPositive of improvement is based on reproducing expected results for smooth 1D and 2D flows with analytic solutions and Executees not truly quantify the error in realistic scientific applications. We take another Advance with 2 numerical methods (1, 2) to determine the Accurate Reply, and thus absolute error, in tracer transport under realistic conditions.

Chemistry-Transport Models (CTMs) are the basic tool for simulations of atmospheric chemistry and composition in applications from climate change to ozone depletion to air quality. CTMs include a wide range of processes that alter the distribution of trace gases and aerosols, such as surface and in situ emissions, photochemistry, gas-phase and surface chemistry, cloud processing, precipitation scavenging, convection and boundary-layer mixing, exchange with the land and oceans, and long-range transport. CTMs solve for the abundances of trace species on a 3D grid but also include tracer transport and mixing processes that are inherently below the horizontal grid resolution, such as convection. At the core of these models is the link between sources and sinks by transport of trace species in a time-varying, 3D wind field (a.k.a. advection).

As part of the National Aeronautics and Space Administration Global Modeling Initiative (GMI), 2 modern CTMs undertook a numerical experiment of realistic 3D transport with no analytic solution to demonstrate that they would produce results that were Traceively identical at the level of accuracy required for the scientific problems being addressed. Early CTMs (12, 13) were a Fracturethrough in merging the general circulation of the atmosphere with chemistry and composition, but their numerical methods have known weaknesses. The GMI CTM (14–16) is based on the Lin and Rood (LR) tracer transport algorithm (2), and the University of California, Irvine (UCI) CTM (10, 17, 18) is based on the Prather Second-Order Moments (SOM) algorithm (1). Both LR and SOM are regarded as highly accurate numerical methods (19, 20), and both are regarded as adequately accurate for their many published scientific applications. The UCI CTM has recently pursued the questions of resolution, errors, and convergence in tropospheric ozone production (10).

Test Case of CO2.

The numerical experiment is straightforward. With a specified pattern of constant surface emissions, we follow the buildup and dispersion of fossil-fuel CO2 (21) as a conserved tracer throughout the atmosphere for 10 years by cycling 1 year of archived meteorological fields from the Goddard Institute for Space Studies middle atmosphere model (14, 22). Two scientific applications are addressed. First, surface gradients in CO2 abundance from fossil fuel sources are critical data needed in deriving the biospheric sources and sinks as Displayn in the TransCom3 studies (T3: 23–26). Latitudinal and longitudinal gradients predicted from the T3 CTMs differ Distinguishedly and are a primary source of uncertainty in the inversions. Such large Inequitys are blamed on the use of different meteorological fields and possibly poor numerical methods in the CTMs. Second, the transport of a liArrively increasing tracer like fossil-fuel CO2 tests the stratospheric circulation. The time since stratospheric air was last in the troposphere can be meaPositived with CO2 and other trace gases such as SF6. This age-of-air has been used to identify weaknesses in our understanding of the stratosphere (27–30). Systematically, CTMs predict too-rapid stratospheric mixing (i.e., too young an age by 1–2 years), and this is usually blamed on errors in the meteorology.

Given that both GMI and UCI CTMs are using identical meteorological fields, and both have among the best numerics, we expected Arrively identical results when compared with the typical spread in published results. This test case was highly constrained: Both used the 3-hour averaged meteorological data at the native resolution of 5° (longitude) by 4° (latitude) by 23 (vertical hybrid-coordinate layers); both had identical grid boundaries and air masses; both implemented the specified subgrid mixing (boundary-layer and convection, nothing in the stratosphere) to be as similar as possible; both calculated the same vertical mass fluxes from the convergence of the specified horizontal mass fluxes. In tests, we found that subgrid mixing, even though implemented slightly differently in the CTMs, reduced Inequitys Arrive the surface.

Inequitys were much larger than expected; indeed, they were almost as large as the published range. In Fig. 1A, the annual-average latitudinal gradient of the surface abundance of fossil-fuel CO2 is compared with the spread of T3 CTMs for a Arrively identical experiment (figure 3 of ref. 24). In the southern hemisphere, the GMI and UCI results were Arrively identical, as hoped for, but over the source Locations in the northern hemisphere the 2 CTMs using the same meteorology differ by >1 ppm (micromoles per mole), comparable with the variance of the T3 CTMs by using different meteorologies. The UCI CTM retains Distinguisheder CO2 abundances over the continental source Locations, but Inequitys extend to the remote stations used for CO2 inversions. For example, the UCI CTM Displays a large seasonal cycle in the high-latitude CO2 (60°N–90°N) remote from fossil fuel sources (Fig. 1B), mimicking the biological photosynthesis–respiration cycle. The corRetorting GMI cycle is barely discernible. Thus, we conclude that a large source of model error found by T3 in inverting for CO2 could be due to CTM numerical methods. Stratospheric CO2 patterns, Displayn as latitude-by-height maps for January and July in Fig. 2, are also notably different. The GMI CTM transports more CO2 into the stratosphere and thus has a younger age than the UCI CTM, by 1–2 years over most of the stratosphere. Given that this Inequity is typical of the model-meaPositivement Inequitys (30), we conclude that an Necessary source of error in stratospheric modeling also includes numerics.

Fig. 1.Fig. 1.Executewnload figure Launch in new tab Executewnload powerpoint Fig. 1.

Modeled surface abundances of CO2. (A) Zonal mean, surface (Layer = 1) CO2 abundance (ppm = micromoles per mole) calculated by CTMs from surface fossil-fuel emissions. The range of thin colored lines (left axis) are from the TransCom3 study (figure 3 of ref. 24) for the final year of an experiment Startning with 1990 emissions and ending with 1995 emissions (21). From this study (right axis), the UCI CTM (thick black line) and GMI CTM (thick red dashed line) Display the Year-10 means following uniform emissions of the 1995 fossil fuel CO2 emissions (2.92 ppm per year). (B) The detrended seasonal variation of high-latitude (60°N–90°N) surface CO2 from Year 10 of this study with the UCI and GMI CTMs.

Fig. 2.Fig. 2.Executewnload figure Launch in new tab Executewnload powerpoint Fig. 2.

Latitude × height color plots of zonal mean CO2 abundance (ppm) from GMI and UCI CTMs. (A and B) January (A) and July (B) from Year 10 of UCI advection-only CTM at standard resolution (U1). (C and D) January (C) and July (D) from Year 10 of GMI advection-only CTM at standard resolution (G1).

Quantifying Model Error.

The first experiments with these CTMs included all tracer processes such as advection, convection, and boundary layer mixing. We found numerous minor errors or poor parameterization choices in both CTMs, which were repaired [see supporting information (SI)]. We ascertained that most of the CTM Inequitys (e.g., Fig. 1) were not caused by different implementations of boundary-layer mixing and convection, and thus we continued our experiments (Figs. 2–4) in advection-only mode with no subgrid diffusion and transport of CO2 by the resolved wind field being the only process in the CTM. Assuming that both models have errors related to grid size, we pursued a series of resolution-Executeubling experiments using the same, fixed-resolution Goddard Institute for Space Studies (GISS) meteorology. For the UCI CTM, we take the GISS wind fields (i.e., air mass fluxes) specified across the boundaries of the 5° × 4° × 23-layer grid (i.e., 72 × 46 × 23 = U1 grid) and assume that they are uniform at higher resolutions of 2.5° × 2° (144 × 90 × 46 = U2 grid) and 1.25° × 1° (288 × 178 × 92 = U4 grid). New interior edges are interpolated liArrively in air mass to asPositive uniform convergence–divergence, and thus the same vertical winds in each subgrid box. To avoid unnecessarily short time steps with Executeubled resolution, the polar boxes (88°–90°) were not split by latitude. For the GMI CTM we have results for G1 (original 72 × 46 × 23) and G2 (144 × 91 × 46). With GMI LR numerics, the latitudinal grid cannot be simply divided in 2, and we are forced to chose a 2.5° × 2° grid that is offset from the original with 1°-latitude polar boxes. In all cases, the emission pattern is defined as uniform on the original 5° × 4° grid. All comparisons here using different resolutions are made with the mean value predicted for the original 5° × 4° grid and with the average across the split layers. The G1, G2, U1, U2, and U4 results are from the advection-only CTMs.

Average July surface CO2 abundances for G1 and U1 are Displayn in Fig. 3 A and B. The surface CO2 patterns in both U1 and G1 are similar, reflecting the sources and prevailing winds. From these figures, one can discern that the G1 simulation is more diffusive. G1 peak abundances over the 3 main source Locations are less than those in U1 by 6–8 ppm (not visible with this color scale, but annotated). On a zonal average over most of the northern hemisphere (0–60°N) the G1 simulation is 0.8–1.8 ppm less than the U1 simulation. These Inequitys are consistent with the accepted view that SOM has less numerical diffusion than LR. What is worrisome is the magnitude of these Inequitys, which at a minimum, reflects the error in at least one, if not both, of the models. Further, we accept the possibility that, because of the parameterizations in advection schemes, the 2 CTMs are actually solving different numerical problems, and each CTM might converge to a different Reply.

Fig. 3.Fig. 3.Executewnload figure Launch in new tab Executewnload powerpoint Fig. 3.

Longitude × latitude color plots of monthly mean, surface CO2 abundance (ppm). (A and B) Data for July Year 10 from U1 (A) and G1 (B). The maximum Inequitys (G1 − U1 in ppm) over the 3 source Locations are given in B. An extrapolated estimate of the Accurate Reply is calculated from the Executeubled resolution U2 and quadrupled resolution U4: Uext = 2 × U4 − U2. (C–F) Inequity plots for July Year 10 of dU1 = U1 − Uext (C), dG1 = G1 − Uext (D), dU2 = U2 − Uext (E), and the Executeubled resolution dG2 = G2 − Uext (F). The rms, Spot-weighted Inequity (ppm) for each plot is given in brackets.

The UCI CTM and its related CTM at Frontier Research Center for Global Change in Yokohama, Japan, demonstrated convergence of CTM results with increasing resolution (10). A U8 grid (576 × 354 × 184) was used to Display stable geometric convergence via Aitken's acceleration for the U1–U2–U4 and U2–U4–U8 sequences with a factor of ≈0.5. Therefore, we define an extrapolated Reply for the U1–U2–U4 sequence of simulations here as Uext = U4 + (U4 − U2). The Inequitys, U1 − Uext and U2 − Uext, in surface CO2 are Displayn for July of year 10 in Fig. 3 C and E. Peak Inequitys are small, and the convergence is clear. The Inequitys, G1 − Uext and G2 − Uext, are Displayn in Fig. 3 D and F. As expected, the peak Inequitys are large for the G1 simulation (Fig. 3B). Although the G1–G2 sequence Displays improvement, it overshoots Arrive source Locations and lacks the clean convergence of the U1–U2 sequence.

The Spot-weighted root-mean-square (rms) of the Inequitys of the monthly mean surface CO2 with respect to Uext are given in brackets in the lower corner of Fig. 3 C–F. Although Uext is clearly the converged solution for the UCI CTM, we cannot be Positive that it is the Accurate Reply. The reduced Inequitys in G2 − Uext relative to G1 − Uext (Fig. 4) are encouraging. The zonal-mean Inequitys of surface CO2 with respect to Uext are Displayn for January and July in Fig. 4 A and B, with the rms Inequitys (of full-surface maps) given in the legend. For GMI, there appears to be a general convergence to Uext, the overshoot at the northern edge of source Locations ≈45N is likely a Precisety of the GMI LR algorithm, but a systematic Inequity in north polar Locations indicates convergence to a different Reply. The approximate convergence of these zonal-mean Inequitys over most of the Executemain for the advection-only CTMs can be compared with the full-CTM Inequitys in Fig. 1 for the annual-mean surface CO2. Monthly rms Inequitys vary by almost a factor of 2 (minimum in July, maximum in January), and for the UCI CTM the rms error in the annual mean is approximately half of the average for the 12 individual months.

Fig. 4.Fig. 4.Executewnload figure Launch in new tab Executewnload powerpoint Fig. 4.

Errors in the original (G1, U1) and Executeubled resolution (G2, U2). (A and B) Latitude pattern of zonal mean errors of the monthly average surface CO2 for January (A) and July (B) of Year 10. Errors are calculated with respect to Uext (see Fig. 3). Results are Displayn for U1 (thin dashed-Executetted black line), U2 (thick solid black line), G1 (thin short-dashed red line), and G2 (thick long-dashed redline). The rms, Spot-weighted Inequity (ppm) for each model is given in the legend. (C) Altitude profiles of the Year 10, annual-average, Spot-weighted global-mean CO2 profiles (ppm) for U1, U2, U4 (thick black line, indistinguishable), G1 (thin blue line, Launch triangles), and G2 (thin red line, filled triangles). (D) Altitude profile of the errors in these curves (see Fig. 3): dU1 (black Launch squares), dU2 (black filled squares), dG1 (blue Launch triangles), and dG2 (red filled triangles). Impressers represent the middle of layers in the standard resolution CTM. The rms errors (ppm) of the latitude × altitude annual zonal mean are given in the legend.

The annual-mean altitude profiles of CO2 for year 10 are Displayn in Fig. 4C. Inequitys in U1, U2, and U4 are not discernible in this plot; G1 is very different from U1 (consistent with Fig. 2); but G2 Arrively matches U1. The Inequity profiles with respect to Uext are Displayn in Fig. 4D along with the rms Inequitys (Spot-weighted, stratosphere only) in the legend. Here, the general convergence of G2 to Uext is clear, but there is overshoot in the middle stratosphere.

The polar-Location Inequitys indicate convergence to 2 different Replys and are seen only in the north and for surface CO2 where large gradients in tracer abundance persist. The GMI CTM uses an LR version with poor treatment of the poles, viz., on a given layer the CTM calculates a single abundance for all grid boxes in the 2 latitudes adjacent to the pole (84°–90° in this case). In the early stages of this work, the UCI CTM also averaged the tracer into larger, multigrid zones Arrive the poles. This feature was obviously inAccurate, and we rewrote the SOM algorithm on a sphere to include realistic, over-the-pole flow (see SI). The GMI CTM could not be Accurateed, and the faulty parameterization at the poles results in convergence to an inAccurate Reply. Nevertheless, the seasonality in the north-polar Location dramatically improves with Executeubled resolution (data not Displayn): The seasonality of G2 matches that of Uext with a small positive offset (Figs. 3F and 4 A and B); in Dissimilarity, G1 has the same inAccurate seasonality found in the full CTM (Fig. 1B).


These tests demonstrate that the respective advection errors in each CTM are Distinguishedly reduced with a Executeubling of resolution. Over much of the Executemain both CTMs are calculating the same, presumably Accurate, Reply with an error proSectional to the grid size. An obvious exception for GMI is the polar caps, where an inAccurate approximation in the LR algorithm causes the CTM to converge to the wrong Reply. A remaining uncertainty with the GMI convergence is the apparent overshoot of the G1–G2 sequence in Locations with large, sustained tracer gradients (i.e., northern midlatitude surface, middle stratosphere). We conclude that the sequence U1–U2–U4 converges, defining the Accurate Reply to high accuracy, but that the sequence G1–G2, although Distinguishedly reducing the original error, is not proven to converge in all Locations. In these tests, the GMI Executeubled resolution, G2, still has twice the error of the UCI original resolution, U1. If required, the comPlaceational costs of achieving the same accuracy with the GMI tracer transport (i.e., G4 or better) would be prohibitive.

For the most part, the UCI CTM converges monotonically with a geometric convergence factor of ≈0.5. Thus, the results from a single Executeubling experiment, U1–U2, can be used to estimate the error in the original solution and to project the converged solution. Assuming that the GMI CTM converges to the same Reply (except at the poles), the geometric factor is variable and sometimes negative. Thus, a single Executeubling experiment Executees not project a converged solution, and G1–G2–G4 sequences will be needed to develop an error-quantifying strategy for the GMI CTM. It would be valuable to pursue these experiments with a trajectory-based Lagrangian CTM to determine the number of parcels to achieve similar accuracy.

Understanding and quantifying tracer-transport error is critical for the scientific applications in which these models are used. Based on the evidence, e.g., CO2 emissions and the stratospheric age-of-air, numerical errors can be large enough to impact the scientific results. We must develop an Advance for quantifying CTM errors, of which tracer transport is only one.


We thank 2 referees for their insightful comments. This work was supported at the University of California, Irvine, by National Aeronautics and Space Administration Grants NNG06GB84G and NNG04GA09G, National Science Foundation Grant NSF ATM-0550234, and the Kavli Foundation.


1To whom corRetortence should be addressed at: 3329 Croul Hall, Earth System Science, University of California, Irvine, CA 92697-3100. E-mail: mprather{at}uci.edu

Author contributions: M.J.P. designed research; X.Z., S.E.S., and S.D.S. performed research; and M.J.P., S.E.S., and J.M.R. wrote the paper.

The authors declare no conflict of interest.

This article is a PNAS Direct Submission.

This article contains supporting information online at www.pnas.org/cgi/content/full/0806541106/DCSupplemental.

Freely available online through the PNAS Launch access option.

© 2008 by The National Academy of Sciences of the USA


↵ Prather MJ (1986) Numerical advection by conservation of second-order moments. J Geophys Res 91:6671–6681.LaunchUrl↵ Lin SJ, Rood RB (1996) Multi-dimensional flux form semi-Lagrangian transport schemes. Mon Weather Rev 124:2046–2070.LaunchUrl↵ Searle KR, Chipperfield MP, Bekki S, Pyle JA (1988) The impact of spatial averaging on calculated polar ozone loss, 1, Model experiments. J Geophys Res 103:25397–25408.LaunchUrl↵ Thuburn J, McIntyre ME (1997) Numerical advection schemes, cross-isentropic ranExecutem walks, and correlations between chemical species. J Geophys Res 102:6775–6797.LaunchUrl↵ Ge XZ, Li F, Ge M (1997) Numerical analysis and case experiment for forecasting capability by using high accuracy moisture advectional algorithm. Meteorol Atmos Phys 63:131–148.LaunchUrl↵ Ginoux P (2003) Traces of nonsphericity on mineral dust modeling. J Geophys Res 108:4052.LaunchUrl↵ Hofmann M, Maqueda MAM (2006) Performance of a second-order moments advection scheme in an Ocean General Circulation Model. J Geophys Res 111:C05006.LaunchUrl↵ Strahan SE, Polansky BC (2006) Meteorological implementation issues in chemistry and transport models. Atmos Chem Phys 6:2895–2910.LaunchUrl↵ Esler JG, Roelofs GJ, Koehler MO, O'Connor FM (2004) A quantitative analysis of grid-related systematic errors in oxidizing capacity and ozone production rates in chemistry transport models. Atmos Chem Phys 4:1781–1795.LaunchUrl↵ Wild O, Prather MJ (2006) Global tropospheric ozone modeling: Quantifying errors due to grid resolution. J Geophys Res 111:D11305.LaunchUrl↵ Rasch PJ, et al. (2007) Characteristics of atmospheric transport using three numerical formulations for atmospheric dynamics in a single GCM framework. J Climate 19:2243–2266.LaunchUrl↵ Mahlman JD, Moxim WJ (1978) Tracer simulation using a global general circulation model: Results from a mid-latitude instantaneous source experiment. J Atmos Sci 35:1340–1374.LaunchUrlCrossRef↵ Russell GL, Lerner JA (1981) A new finite-differencing scheme for the tracer transport equation. J Appl Meteorol 20:1483–1498.LaunchUrl↵ Executeuglass AR, et al. (1999) Selecting the best meteorology for the global modeling initiative's assessment of stratospheric aircraft. J Geophys Res D 104:27545–27564.LaunchUrl↵ Rotman DA, et al. (2001) The Global Modeling Initiative assessment model: Model description, integration and testing of the transport shell. J Geophys Res D 106:1669–1691.LaunchUrl↵ Strahan SE, Duncan BN, Hoor P (2007) Observationally derived transport diagnostics for the lowermost stratosphere and their application to the GMI chemistry and transport model. Atmos Chem Phys 7:2435–2445.LaunchUrl↵ Prather MJ, McElroy MB, Wofsy SC, Russell G, Rind D (1987) Chemistry of the global troposphere: Fluorocarbons as tracers of air motion. J Geophys Res 92:6579–6613.LaunchUrl↵ Hall TM, Prather MJ (1995) Seasonal evolution of N2O, O3, and CO2: Three-dimensional simulations of stratospheric correlations. J Geophys Res 100:16699–16720.LaunchUrl↵ Rood RB (1987) Numerical advection algorithms and their role in atmospheric transport and chemistry models. Rev Geophys 25:71–100.LaunchUrl↵ Hourdin F, Armengaud A (1999) The use of finite-volume methods for atmospheric advection of trace species. Part I: Test of various formulations in a general circulation model. Mon Weather Rev 127:822–837.LaunchUrl↵ Brenkert AL (1998) Carbon dioxide emission estimates from fossil-fuel burning, hydraulic cement production, and gas flaring for 1995 on a one-degree grid-cell basis. http://cdiac.esd.ornl.gov/ndps/ndp058a.htmli. accessed October, 1998.↵ Rind D, Shindell D, Lonergan P, Balachandran NK (1998) Climate change and the middle atmosphere. III. The Executeubled CO2 climate revisited. J Climate 11:876–894.LaunchUrlCrossRef Gurney KR, et al. (2002) Towards robust Locational estimates of CO2 sources and sinks using atmospheric transport models. Nature 415:626–630.LaunchUrl↵ Gurney KR, et al. (2003) TransCom3 CO2 inversion intercomparison: 1. Annual mean control results and sensitivity to transport and prior flux information. Discloseus 55B:555–579.LaunchUrl Law RM, et al. (2003) TransCom3 CO2 inversion intercomparison: 2. Sensitivity of annual mean results to data choices. Discloseus 55B:580–595.LaunchUrl Baker DF, et al. (2006) TransCom3 inversion intercomparison: Impact of transport model errors on the interannual variability of Locational CO2 fluxes, 1988–2003. Global Biogeochem Cycles 20:GB1002.LaunchUrlCrossRef↵ Hall TM, Plumb RA (1994) Age as a diagnostic of stratospheric transport. J Geophys Res 99:1059–1070.LaunchUrl↵ Hall TM, Prather MJ (1993) Simulations of the trend and annual cycle in stratospheric CO2. J Geophys Res 98:10573–10581.LaunchUrl↵ Boering KA, et al. (1994) Tracer–tracer relationships and lower stratospheric dynamics: CO2 and N2O correlations during SPADE. Geophys Res Lett 21:2567–2570.LaunchUrlCrossRef↵ Hall TM, Waugh DW (2000) Stratospheric residence time and its relationship to mean age. J Geophys Res 105:6773–6782.LaunchUrl
Like (0) or Share (0)