Douglas Hartree and the Self-Consistent Field: The Method Behind Every Quantum Chemistry Program

Whenever a chemist runs a computer calculation to find the shape, energy or colour of a molecule, there is a very good chance that the first step is a Hartree–Fock calculation. This method grew out of the work of the English mathematical physicist Douglas Rayner Hartree, who in 1927 proposed the self-consistent field (SCF) method for atoms. The idea is simple and beautiful: each electron moves in the average field created by the nucleus and all the other electrons, but that average field itself depends on where the electrons are. So you guess, calculate, update and repeat until the answer stops changing. In this article we explain the problem Hartree solved, the equations, and the exam-relevant results.

The Scientific Problem Before the Discovery

The Schrödinger equation can be solved exactly for hydrogen-like atoms (one electron). Already for helium, with two electrons, the term 1/r₁₂ describing electron–electron repulsion couples the motions of the electrons and makes exact solution impossible. For an atom with N electrons the Hamiltonian is:

H = Σ [ −(ħ²/2m)∇ᵢ² − Ze²/(4πε₀rᵢ) ] + Σ(i<j) e²/(4πε₀ rᵢⱼ)

The last term depends on the coordinates of two electrons at once, so the wavefunction cannot be separated into independent one-electron parts. In the 1920s, physicists such as Bohr could explain the periodic table qualitatively but could not calculate the sizes and energies of many-electron atoms. A practical method was needed, and one that could be done by hand or by the machines of that day.

The Discovery: Step by Step

Hartree's approach, published in 1928, used the following idea:

1. Product wavefunction. Write the many-electron wavefunction as a product of one-electron orbitals: Ψ = φ₁(1) φ₂(2) … φN(N).
2. Average field. Each electron i experiences the nuclear attraction plus the repulsion from the charge clouds of all the other electrons, with density |φⱼ|².
3. One-electron equation. Each orbital obeys its own Schrödinger-type equation:

[ −(ħ²/2m)∇² + V(nuc) + Σ(j≠i) ∫ |φⱼ(r')|² e²/|r − r'| dr' ] φᵢ(r) = εᵢ φᵢ(r)

4. Iterate. Start with a guessed set of orbitals (say, hydrogen-like), compute the field, solve for new orbitals, then use these to build a new field. Repeat until the input and output orbitals agree. At that point the field is self-consistent.

Hartree did the first calculations on atoms using a numerical approach with a desk calculator and later with the help of a mechanical differential analyser at Manchester, which he and his colleagues built using Meccano parts in 1934. His father, William Hartree, and his student Phyllis Nicolson also contributed to these calculations; she later co-developed the Crank–Nicolson method.

Adding Pauli: the Hartree–Fock method

Hartree's product wavefunction ignores the Pauli exclusion principle, because it does not change sign when two electrons are exchanged. In 1930 Vladimir Fock, and independently John Slater, replaced the product by an antisymmetric Slater determinant:

Ψ = (1/√N!) | φ₁(1) φ₂(1) … φN(1) |
             | φ₁(2) φ₂(2) … φN(2) |
             |  …                  |
             | φ₁(N) φ₂(N) … φN(N) |

This produces an extra term, the exchange interaction, which lowers the energy for electrons of the same spin. The Fock operator is F = h + Σ(2J − K), where J is the Coulomb operator and K is the exchange operator. The Hartree–Fock equations are Fφᵢ = εᵢφᵢ, solved by the same self-consistent iteration. For molecules, Roothaan (1951) expanded the orbitals in a basis set and converted the equations into matrix form:

F C = S C ε

The Chemistry Behind It

The key concepts are as follows.

• Mean-field approximation. Each electron sees the average of the others, not their instantaneous positions. This ignores electron correlation.
• Variational principle. The Hartree–Fock energy is always above (or equal to) the exact non-relativistic energy. The more flexible the orbitals, the lower the energy, until the "Hartree–Fock limit" is reached.
• Correlation energy. E(corr) = E(exact) − E(HF limit). It is usually about 1% of the total energy but is crucial for bond energies and reaction barriers.
• Koopmans' theorem. The orbital energy of an occupied orbital approximates the negative of the ionisation energy of that orbital: IE ≈ −εᵢ.
• Self-consistency check. Calculations are stopped when the change in energy or density matrix falls below a threshold such as 10⁻⁶ hartree.

The atomic unit of energy is named after him: 1 hartree = 27.211 eV ≈ 2625.5 kJ/mol. The hydrogen atom ground-state energy is −0.5 hartree.

Applications Today

• Starting point for accurate methods: MP2, coupled cluster and configuration interaction all start from a Hartree–Fock reference.
• Drug design: Geometry optimisation and charge calculation for drug molecules in pharma research, including in Indian institutes and companies.
• Spectroscopy: Predicting IR frequencies and orbital energies to assist interpretation of experiments.
• Atomic physics and astrophysics: The Hartree method gave atomic structure data that were used to understand stellar atmospheres.
• Education: Programs such as Gaussian, ORCA, PySCF and Psi4 allow students to run SCF calculations on a laptop.

Exam Corner: 5 Likely Points

• Hartree wavefunction is a simple product; Hartree–Fock wavefunction is a Slater determinant satisfying the Pauli principle.
• Fock operator: F = h + Σ(2Jⱼ − Kⱼ) for closed-shell systems; Roothaan equations FC = SCε.
• HF energy is an upper bound (variational); correlation energy is always negative.
• Koopmans' theorem: IE of an orbital ≈ −εᵢ.
• RHF is for closed shells; UHF and ROHF for open shells; UHF may suffer spin contamination.

Common Misconceptions

• "Hartree–Fock includes all electron–electron interactions." It includes the average Coulomb repulsion and the exchange, but not the instantaneous correlation.
• "Orbitals are real physical objects." They are mathematical functions in an approximate model; only the total density and energies are observable.
• "A converged SCF is the exact answer." It is only the best single-determinant answer for the chosen basis set.

FAQ

What does self-consistent mean?

The orbitals used to build the average field are the same as those obtained by solving the equations in that field. Once input equals output, the calculation has converged.

What is the difference between Hartree and Hartree–Fock?

Hartree used a simple product of orbitals and had no exchange term. Hartree–Fock uses a Slater determinant, so exchange arises automatically and the Pauli principle is respected.

Why is correlation energy important if it is only about 1%?

Chemical energy differences, like bond energies, are of the same order as the correlation energy, so ignoring it can give wrong answers.

Is DFT a replacement for Hartree–Fock?

DFT uses a similar self-consistent procedure (Kohn–Sham) but includes correlation through the exchange-correlation functional. Hybrid functionals such as B3LYP mix in some Hartree–Fock exchange.

Published by ABC Chemistry — IIT-JAM | CSIR-NET | GATE Chemistry Coaching. Visit abcchemistry.com