| Preface | vii |
| Chapter 1 | Introduction | 1 |
| 1.1 | The Beginnings | 2 |
| 1.2 | Atmospheric Remote Sounding Methods | 3 |
| 1.2.1 | Thermal emission nadir and limb sounders | 3 |
| 1.2.2 | Scattered solar radiation | 4 |
| 1.2.3 | Absorption of solar radiation | 6 |
| 1.2.4 | Active techniques | 6 |
| 1.3 | Simple Solutions to the Inverse Problem | 7 |
| Chapter 2 | Information Aspects | 13 |
| 2.1 | Formal Statement of the Problem | 13 |
| 2.1.1 | State and measurement vectors | 13 |
| 2.1.2 | The forward model | 14 |
| 2.1.3 | Weighting function matrix | 15 |
| 2.1.4 | Vector spaces | 15 |
| 2.2 | Linear Problems without Measurement Error | 17 |
| 2.2.1 | Subspaces of state space | 17 |
| 2.2.2 | Identifying the null space and the row space | 18 |
| 2.3 | Linear Problems with Measurement Error | 20 |
| 2.3.1 | Describing experimental error | 20 |
| 2.3.2 | The Bayesian approach to inverse problems | 21 |
| 2.3.2.1 | Bayes' theorem | 22 |
| 2.3.2.2 | Example: The Linear problem with Gaussian statistics | 24 |
| 2.4 | Degrees of Freedom | 27 |
| 2.4.1 | How many independent quantities can be measured? | 27 |
| 2.4.2 | Degrees of freedom for signal | 29 |
| 2.5 | Information Content of a Measurement | 32 |
| 2.5.1 | The Fisher information matrix | 32 |
| 2.5.2 | Shannon information content | 33 |
| 2.5.2.1 | Entropy of a probability density function | 33 |
| 2.5.2.2 | Entropy of a Gaussian distribution | 34 |
| 2.5.2.3 | Information content in the linear Gaussian case | 36 |
| 2.6 | The Standard Example: Information Content and Degrees of Freedom | 37 |
| 2.7 | Probability Density Functions and the Maximum Entropy Principle | 40 |
| Chapter 3 | Error Analysis and Characterisation | 43 |
| 3.1 | Characterisation | 43 |
| 3.1.1 | The forward model | 43 |
| 3.1.2 | The retrieval method | 44 |
| 3.1.3 | The transfer function | 45 |
| 3.1.4 | Linearisation of the transfer function | 45 |
| 3.1.5 | Interpretation | 46 |
| 3.1.6 | Retrieval method parameters | 47 |
| 3.2 | Error Analysis | 48 |
| 3.2.1 | Smoothing error | 48 |
| 3.2.2 | Forward model parameter error | 49 |
| 3.2.3 | Forward model error | 50 |
| 3.2.4 | Retrieval noise | 50 |
| 3.2.5 | Random and systematic error | 50 |
| 3.2.6 | Representing covariances | 51 |
| 3.3 | Resolution | 52 |
| 3.4 | The Standard Example: Linear Gaussian Case | 55 |
| 3.4.1 | Averaging kernels | 56 |
| 3.4.2 | Error components | 58 |
| 3.4.3 | Modelling error | 60 |
| 3.4.4 | Resolution | 61 |
| Chapter 4 | Optimal Linear Inverse Methods | 65 |
| 4.1 | The Maximum a Posteriori Solution | 66 |
| 4.1.1 | Several independent measurements | 68 |
| 4.1.2 | Independent components of the state vector | 69 |
| 4.2 | Minimum Variance Solutions | 71 |
| 4.3 | Best Estimate of a Function of the State Vector | 73 |
| 4.4 | Separately Minimising Error Components | 73 |
| 4.5 | Optimising Resolution | 74 |
| Chapter 5 | Optimal Methods for Non-linear Inverse Problems | 81 |
| 5.1 | Determination of the Degree of Nonlinearity | 82 |
| 5.2 | Formulation of the Inverse Problem | 83 |
| 5.3 | Newton and Gauss-Newton Methods | 85 |
| 5.4 | An Alternative Linearisation | 86 |
| 5.5 | Error Analysis and Characterisation | 86 |
| 5.6 | Convergence | 87 |
| 5.6.1 | Expected convergence rate | 87 |
| 5.6.2 | A popular mistake | 88 |
| 5.6.3 | Testing for convergence | 89 |
| 5.6.4 | Testing for correct convergence | 90 |
| 5.6.5 | Recognising and dealing with slow convergence | 91 |
| 5.7 | Levenberg-Marquardt Method | 92 |
| 5.8 | Numerical Efficiency | 93 |
| 5.8.1 | Which formulation for the linear algebra? | 93 |
| 5.8.1.1 | The n-form | 94 |
| 5.8.1.2 | The m-form | 97 |
| 5.8.1.3 | Sequential updating | 97 |
| 5.8.2 | Computation of derivatives | 98 |
| 5.8.3 | Optimising representations | 99 |
| Chapter 6 | Approximations, Short Cuts and Ad-hoc Methods | 101 |
| 6.1 | The Constrained Exact Solution | 101 |
| 6.2 | Least Squares Solutions | 105 |
| 6.2.1 | The overconstrained case | 105 |
| 6.2.2 | The underconstrained case | 106 |
| 6.3 | Truncated Singular Vector Decomposition | 107 |
| 6.4 | Twomey-Tikhonov | 108 |
| 6.5 | Approximations for Optimal Methods | 110 |
| 6.5.1 | Approximate a priori and its covariance | 110 |
| 6.5.2 | Approximate measurement error covariance | 111 |
| 6.5.3 | Approximate weighting functions | 111 |
| 6.6 | Direct Multiple Regression | 113 |
| 6.7 | Linear Relaxation | 114 |
| 6.8 | Nonlinear Relaxation | 116 |
| 6.9 | Maximum Entropy | 118 |
| 6.10 | Onion Peeling | 119 |
| Chapter 7 | The Kalman Filter | 121 |
| 7.1 | The Basic Linear Filter | 122 |
| 7.2 | The Kalman Smoother | 124 |
| 7.3 | The Extended Filter | 125 |
| 7.4 | Characterisation and Error Analysis | 126 |
| 7.5 | Validation | 127 |
| Chapter 8 | Global Data Assimilation | 129 |
| 8.1 | Assimilation as a Inverse Problem | 129 |
| 8.2 | Methods for Data Assimilation | 130 |
| 8.2.1 | Successive correction methods | 130 |
| 8.2.2 | Optimal interpolation | 131 |
| 8.2.3 | Adjoint methods | 132 |
| 8.2.4 | Kalman filtering | 134 |
| 8.3 | Preparation of Indirect Measurements for Assimilation | 135 |
| 8.3.1 | Choice of profile representation | 137 |
| 8.3.2 | Linearised measurements | 137 |
| 8.3.3 | Systematic errors | 138 |
| 8.3.4 | Transformation of a characterised retrieval | 139 |
| Chapter 9 | Numerical Methods for Forward Models and Jacobians | 141 |
| 9.1 | The Equation of Radiative Transfer | 141 |
| 9.2 | The Radiative Transfer Integration | 143 |
| 9.3 | Derivatives of Forward Models: Analytic Jacobians | 145 |
| 9.4 | Ray Tracing | 147 |
| 9.4.1 | Choosing a coordinate system | 148 |
| 9.4.2 | Ray tracing in radial coordinates | 149 |
| 9.4.3 | Horizontally homogeneous case | 149 |
| 9.4.4 | The general case | 151 |
| 9.5 | Transmittance Modelling | 152 |
| 9.5.1 | Line-by-line modelling | 153 |
| 9.5.2 | Band transmittance | 154 |
| 9.5.3 | Inhomogeneous paths | 155 |
| 9.5.3.1 | Curtis--Godson approximation | 155 |
| 9.5.3.2 | Emissivity growth approximation | 156 |
| 9.5.3.3 | McMillin--Fleming method | 156 |
| 9.5.3.4 | Multiple absorbers | 157 |
| Chapter 10 | Construction and Use of Prior Constraints | 159 |
| 10.1 | Nature of a Priori | 159 |
| 10.2 | Effect of Prior Constraints on a Retrieval | 161 |
| 10.3 | Choice of Prior Constraints | 162 |
| 10.3.1 | Retrieval grid | 162 |
| 10.3.1.1 | Transformation between grids | 162 |
| 10.3.1.2 | Choice of grid for maximum likelihood retrieval | 163 |
| 10.3.1.3 | Choice of grid for maximum a priori retrieval | 164 |
| 10.3.2 | Ad hoc Soft constraints | 165 |
| 10.3.2.1 | Smoothness constraints | 165 |
| 10.3.2.2 | Markov process | 165 |
| 10.3.3 | Estimating a priori from real data | 166 |
| 10.3.3.1 | Estimating a priori from independent sources | 166 |
| 10.3.3.2 | Maximum entropy and the estimation of a priori | 166 |
| 10.3.4 | Validating and improving a priori with indirect measurements | 168 |
| 10.3.4.1 | The nearly linear case | 169 |
| 10.3.4.2 | The moderately non-linear case | 170 |
| 10.4 | Using Retrievals Which Contain a Priori | 171 |
| 10.4.1 | Taking averages of sets of retrievals | 172 |
| 10.4.2 | Removing a priori | 172 |
| Chapter 11 | Designing an Observing System | 175 |
| 11.1 | Design and Optimisation of Instruments | 175 |
| 11.1.1 | Forward model construction | 176 |
| 11.1.2 | Retrieval method and diagnostics | 177 |
| 11.1.3 | Optimisation | 178 |
| 11.1.4 | Specifying requirements for the accuracy of parameters | 179 |
| 11.2 | Operational Retrieval Design | 179 |
| 11.2.1 | Forward model construction | 180 |
| 11.2.2 | State vector choice | 180 |
| 11.2.3 | Choice of vertical grid coordinate | 181 |
| 11.2.3.1 | Choice of parameters describing constitutents | 182 |
| 11.2.4 | A priori information | 183 |
| 11.2.5 | Retrieval method | 183 |
| 11.2.6 | Diagnostics | 183 |
| Chapter 12 | Testing and Validating an Observing System | 185 |
| 12.1 | Error Analysis and Characterisation | 186 |
| 12.2 | The X[superscript 2] Test | 187 |
| 12.3 | Quantities to be Compared and Tested | 188 |
| 12.3.1 | Internal consistency | 188 |
| 12.3.2 | Does the retrieval agree with the measurement? | 189 |
| 12.3.3 | Consistency with the a priori | 190 |
| 12.3.3.1 | Measured signal and a priori | 190 |
| 12.3.3.2 | Retrieval and a priori | 191 |
| 12.3.3.3 | Comparison of the retrieved signal and the a priori | 191 |
| 12.4 | Intercomparison of Different Instruments | 192 |
| 12.4.1 | Basic requirements for intercomparison | 192 |
| 12.4.2 | Direct comparison of indirect measurements | 193 |
| 12.4.3 | Comparison of linear functions of measurements | 194 |
| Appendix A | Algebra of Matrices and Vectors | 197 |
| A.1 | Vector Spaces | 197 |
| A.2 | Eigenvectors and Eigenvalues | 199 |
| A.3 | Principal Axes of a Quadratic Form | 200 |
| A.4 | Singular Vector Decomposition | 201 |
| A.5 | Determinant and Trace | 203 |
| A.6 | Calculus with Matrices and Vectors | 203 |
| Appendix B | Answers to Exercises | 205 |
| Appendix C | Terminology and Notation | 223 |
| C.1 | Summary of Terminology | 223 |
| C.2 | List of Symbols Used | 225 |
| Bibliography | 229 |
| Index | 235 |