22.15 | Fall 2014 | Graduate

Essential Numerical Methods

Course Notes

The course notes linked below serve as the primary textbook. Each chapter corresponds to the content covered in one lecture session. Note that they are © Professor Hutchinson, all rights reserved, and are not covered by the OCW Creative Commons license.

The notes have also been adapted and published in book form by Cambridge University Press:

  • Hutchinson, Ian. A Student’s Guide to Numerical Methods. Cambridge University Press, 2015. ISBN: 9781107479500.

Course notes home page, preface, & table of contents

LEC # NOTES TOPIC SUMMARIES
1 Chapter 1: Numerical fitting of data 1–D least squares fit of a line to a sequence of data. Its representation as a matrix pseudo-inversion problem to determine coefficients.
2 Chapter 2: Ordinary differential equations (ODEs)

Ordinary differential equation of order N in one dependent variable is equivalent to N simultaneous first-order ODEs, i.e. a first order vector ODE. The orbit of a field line or an electron in prescribed static EM fields.

Finite difference expressions for derivative. Accuracy and Stability. Implicit and explicit advancing schemes. Runge-Kutta techniques.

Simple Leapfrog scheme as an example of centered time differences.

3 Chapter 3: Two-point boundary conditions

Second order ODES. Two point boundary conditions.

Example(s) of two-point problems: Slab charge, cylindrical volumetrically-heated conduction.

Shooting method. Bisection.

Second order differences. Linear ODE: Expression of 2-point problem as a matrix equation. Finite difference boundary condition implementation in matrix. Non-uniform derivatives.

4 Chapter 4: Partial differential equations (PDEs)

Examples of partial differential equations of engineering physics.

Fluid flow and derivation of the continuity equation. Diffusion. Waves. Electromagnetism. Poisson’s equation.

Classification of PDEs. Elliptic, Parabolic, Hyperbolic. Consequences for boundary conditions. Finite difference representation of partial derivatives. Structured (and unstructured) meshes. Difference stencil.

5 Chapter 5: Diffusion; parabolic PDEs

The diffusion equation and boundaries in space and time.

Explicit FTCS scheme for time evolution of multidimensional PDEs first order in time (parabolic). Stability requirement.

Implicit BTCS scheme for time evolution: Unconditionally stable. Crank-Nicholson and θ–implicit schemes.

Expression of the time advance as a matrix equation. Requirement for inversion in implicit schemes. Multidimensional cases leading to non-tridiagonal sparse matrices. The matrix size difficulty for multiple dimensions.

Example of time-dependent diffusive relaxation to a steady state.

6 Chapter 6: Elliptic problems and iterative matrix solution

Elliptic equation as steady state of a parabolic equation. Need for matrix inversion. Iteration’s equivalence to diffusive relaxation. Solving matrix problem without explicit inversion.

Jacobi, Gauss-Seidel and SOR methods. Convergence.

Nonlinear equations, linearization and iteration.

7 Chapter 7: Fluid dynamics and hyperbolic equations

The fluid momentum conservation equation derived. Fluid closure.

The Navier-Stokes equation in conservation form. Hyperbolic equations in advection form. Eigenvalue of the Jacobian and Characteristics.

Finite differences and stability: FTCS unstable. Lax-Friedrichs and CFL condition. Lax Wendroff, second order accuracy.

8 Chapter 8: Boltzmann’s equation and its solution

The distribution function, and flux-density, energy-density.

Boltzmann’s equation derivation as an expression of particle conservation in the presence of collisions and sources.

Integration along orbits / characteristics. Vlasov equation distribution behavior.

The collision term. Simple collision process examples.

9 Chapter 9: Neutron transport

The Boltzmann equation in terms of flux. Neutron total loss, scattering and fission source terms. Reduction of Boltzmann equation to a (speed-resolved) diffusion equation.

Groups. Multigroup equations and their numerical representation. Leakage. Diffusive timestep stability.

Eigenvalue nature of the steady problem. Power iteration method to solve for dominant eigenvalue.

10 Chapter 10: Atomistic and particle-in-cell methods

Atomistic simulation. Time and space scales. Generic approach. Interparticle force examples: Lennard-Jones, Morse. Computational requirements. Neighbor lists and blocks.

The computational problem of long-range forces. Particle in Cell solution for plasmas. Pseudo-particle representation. Phase space. Direct Simulation Monte Carlo (DSMC) treatment of tenuous gas. Boundary conditions and their implementation.

11 Chapter 11: Monte Carlo techniques Collisions. Random numbers and statistical distributions. Basic introduction to probability (random variables, pdf, cumulative probability) and statistics (mean, variance, standard error). Random sampling from basic distributions used in Monte Carlo simulations (uniform, exponential, …) and rejection sampling technique. Flux weighted injection.
12 Chapter 12: Monte Carlo radiation transport

Transport and collisions. Random walk step length; Poisson statistics. Collision-type choice. New particle generation.

Tracking and tallying of collisions. Statistical uncertainty, and tallying methods to reduce it. Importance sampling.

13 Chapter 13: Next steps, e.g. finite elements  

Course Info

As Taught In
Fall 2014
Level
Learning Resource Types
Tutorial Videos
Problem Sets
Exams
Online Textbook
Programming Assignments
Instructor Insights