Phase Space, Microstates and the Microcanonical Ensemble
CSIR NET statistical physics: phase space, Liouville, micro- and macrostates, S = k ln Ω, microcanonical ideal gas, Sackur–Tetrode, negative temperature.
- 18 min
On this page · 15 sections
- Prerequisites
- The Hook: Why the Gas Never Gathers in One Corner
- Phase Space
- Microstates and Macrostates
- The Microcanonical Ensemble
- Example 1: Einstein Solid
- Example 2: Two-Level System and Negative Temperature
- Example 3: Classical Ideal Gas and the Sackur–Tetrode Entropy
- Memory Tricks
- Don’t Confuse
- Common Mistakes
- Practice
- Quick Revision Table
- Key Takeaways
- What’s Next
Prerequisites
- Laws of Thermodynamics, Entropy and Heat Engines: entropy, temperature and the fundamental relation, which this page derives microscopically.
- Hamilton’s equations and the idea of a Hamiltonian \( H(q, p) \).
- Combinations and Stirling’s approximation \( \ln N! \approx N\ln N - N \). Counting practice is in Counting, Probability and Number Properties.
- Identical Particles, Pauli Principle and Spin-Statistics for why identical particles are counted once.
The Hook: Why the Gas Never Gathers in One Corner
Phase Space
For a classical system with \( f \) degrees of freedom (\( f = 3N \) for \( N \) point particles in 3D), the state at an instant is the set of all coordinates and momenta \( (q_1, \ldots, q_f, p_1, \ldots, p_f) \). These \( 2f \) numbers define a point in phase space (\( \Gamma \)-space), of dimension \( 2f = 6N \). As time passes the point moves along a trajectory fixed by Hamilton’s equations, \( \dot q_i = \partial H/\partial p_i \), \( \dot p_i = -\partial H/\partial q_i \). For an isolated system the trajectory stays on the energy surface \( H(q, p) = E \).
Trajectories in phase space never cross: the state at one instant fixes the whole future and past.
Liouville’s theorem
Let \( \rho(q, p, t) \) be the density of an ensemble of system copies in phase space. Hamiltonian flow is incompressible:
$$\boxed{\frac{d\rho}{dt} = \frac{\partial\rho}{\partial t} + \{\rho, H\} = 0}$$A cloud of representative points moves like an incompressible fluid: its shape can distort but its volume is conserved. An equilibrium ensemble has \( \partial\rho/\partial t = 0 \), so \( \{\rho, H\} = 0 \): \( \rho \) is any function of the conserved quantities, most simply of \( H \) alone. That is exactly what the microcanonical (\( \rho \) constant on a shell) and canonical (\( \rho \propto e^{-\beta H} \)) ensembles are.
Simple phase-space pictures
| System | Trajectory at energy \( E \) | Area enclosed |
|---|---|---|
| 1D harmonic oscillator \( H = \dfrac{p^2}{2m} + \dfrac{1}{2}m\omega^2x^2 \) | ellipse with semi-axes \( \sqrt{2E/m\omega^2} \), \( \sqrt{2mE} \) | \( 2\pi E/\omega \) |
| Particle in a 1D box of length \( L \) | two horizontal lines \( p = \pm\sqrt{2mE} \) | \( 2L\sqrt{2mE} \) |
| Free fall / bouncing ball | parabolic arcs | — |
Counting states: the cell size \( h \)
Quantum mechanics gives each state a phase-space volume \( h \) per degree of freedom: \( h^f \) in all. Check with the oscillator: the number of states with energy below \( E \) is
$$\frac{2\pi E/\omega}{h} = \frac{E}{\hbar\omega}$$which matches the quantum spectrum \( E_n = (n + \tfrac{1}{2})\hbar\omega \) for large \( n \). For the particle in a box, \( 2L\sqrt{2mE}/h = L\sqrt{2mE}/(\pi\hbar) \), which is exactly the largest quantum number \( n \) with \( n^2\pi^2\hbar^2/(2mL^2) \leq E \). The semiclassical rule:
$$\boxed{\text{number of states} = \frac{1}{N!\,h^{3N}}\int d^{3N}q\,d^{3N}p \quad (\text{identical particles})}$$The \( N! \) removes the overcounting of permutations of identical particles; it is the classical shadow of the symmetrisation postulate.
Microstates and Macrostates
A microstate specifies the system completely: a phase-space point (classical) or a many-body quantum state. A macrostate specifies only macroscopic variables (\( E, V, N \), or a coarse property such as “how many spins point up”). The multiplicity \( \Omega \) of a macrostate is the number of microstates compatible with it.
The fundamental postulate
The postulate is supported by Liouville’s theorem (uniform density on the energy shell is stationary) and by the ergodic hypothesis: over long times the trajectory spends equal time in equal areas of the energy surface, so time averages equal ensemble averages.
Boltzmann entropy
$$\boxed{S = k_B\ln\Omega}$$with \( k_B = 1.380649\times10^{-23} \) J K\( ^{-1} \) (exact in SI). The logarithm makes \( S \) additive: for independent subsystems \( \Omega = \Omega_1\Omega_2 \), so \( S = S_1 + S_2 \). A more general form, valid for any probability distribution \( p_i \) over microstates, is the Gibbs entropy \( S = -k_B\sum_ip_i\ln p_i \), which reduces to \( k_B\ln\Omega \) when all \( p_i = 1/\Omega \).
The Microcanonical Ensemble
The microcanonical ensemble describes an isolated system with fixed \( E \) (in a thin shell \( E \) to \( E + \delta E \)), \( V \) and \( N \). Every accessible microstate has probability \( 1/\Omega(E, V, N) \). Thermodynamics follows from \( S(E, V, N) = k_B\ln\Omega \) and the fundamental relation \( dS = \dfrac{1}{T}dE + \dfrac{P}{T}dV - \dfrac{\mu}{T}dN \):
$$\boxed{\frac{1}{T} = \left(\frac{\partial S}{\partial E}\right)_{V,N}, \qquad \frac{P}{T} = \left(\frac{\partial S}{\partial V}\right)_{E,N}, \qquad \frac{\mu}{T} = -\left(\frac{\partial S}{\partial N}\right)_{E,V}}$$Why equal temperatures at equilibrium
Let two systems share total energy \( E = E_1 + E_2 \) through a wall that passes heat. The number of joint microstates with \( E_1 \) in system 1 is \( \Omega_1(E_1)\Omega_2(E - E_1) \). The most probable \( E_1 \) maximises \( \ln\Omega_1 + \ln\Omega_2 \):
$$\frac{\partial\ln\Omega_1}{\partial E_1} = \frac{\partial\ln\Omega_2}{\partial E_2} \Rightarrow T_1 = T_2$$The same argument with a movable wall gives \( P_1 = P_2 \), and with a permeable wall \( \mu_1 = \mu_2 \). Energy flows to whichever side gains more entropy per joule, i.e. from hot to cold: the second law in statistical form.
Example 1: Einstein Solid
\( N \) distinguishable oscillators of frequency \( \omega \) share \( q \) energy quanta (\( E = q\hbar\omega \) above the zero-point energy). Distributing \( q \) identical quanta among \( N \) oscillators (“stars and bars”):
$$\boxed{\Omega(N, q) = \binom{q + N - 1}{q}}$$For \( N, q \gg 1 \), Stirling gives \( S/k_B \approx (q + N)\ln(q + N) - q\ln q - N\ln N \). Then
$$\frac{1}{T} = \frac{1}{\hbar\omega}\frac{\partial S}{\partial q} = \frac{k_B}{\hbar\omega}\ln\frac{q + N}{q} \Rightarrow \frac{q}{N} = \frac{1}{e^{\hbar\omega/k_BT} - 1}$$the Planck mean occupation, from pure counting. The heat capacity of the \( N \) oscillators follows: \( C = Nk_B\dfrac{x^2e^x}{(e^x - 1)^2} \) with \( x = \hbar\omega/k_BT = \Theta_E/T \). A solid of \( N_a \) atoms has \( N = 3N_a \) oscillators, so \( C \) tends to the Dulong–Petit value \( 3N_ak_B \) at high \( T \) and vanishes exponentially at low \( T \) (real solids follow \( T^3 \), the Debye law).
Example 2: Two-Level System and Negative Temperature
\( N \) independent units, each with energy 0 or \( \varepsilon \). With \( n \) excited, \( E = n\varepsilon \) and \( \Omega = \binom{N}{n} \):
$$S = k_B\ln\binom{N}{n} \approx -Nk_B\left[x\ln x + (1 - x)\ln(1 - x)\right], \quad x = n/N$$$$\boxed{\frac{1}{T} = \frac{1}{\varepsilon}\frac{\partial S}{\partial n} = \frac{k_B}{\varepsilon}\ln\frac{N - n}{n}}$$| Population | \( \partial S/\partial E \) | Temperature |
|---|---|---|
| \( n < N/2 \) | positive | \( T > 0 \) |
| \( n = N/2 \) | zero | \( T = \pm\infty \) |
| \( n > N/2 \) (population inversion) | negative | \( T < 0 \) |
\( S(E) \) rises from zero, peaks at \( E = N\varepsilon/2 \) with \( S = Nk_B\ln2 \), and falls back to zero at \( E = N\varepsilon \). On the falling side, adding energy lowers entropy, so \( T < 0 \).
Example 3: Classical Ideal Gas and the Sackur–Tetrode Entropy
For \( N \) identical free particles in volume \( V \), the number of states with energy below \( E \) is
$$\Sigma(E) = \frac{V^N}{N!\,h^{3N}}\times\frac{\pi^{3N/2}}{\Gamma(3N/2 + 1)}(2mE)^{3N/2}$$(the momentum integral is the volume of a \( 3N \)-dimensional sphere of radius \( \sqrt{2mE} \)). For large \( N \) the shell and the full sphere give the same \( \ln\Omega \) to leading order: almost all the volume of a high-dimensional sphere lies near its surface. Stirling’s approximation then gives the Sackur–Tetrode equation:
$$\boxed{S = Nk_B\left[\ln\left(\frac{V}{N}\left(\frac{4\pi mE}{3Nh^2}\right)^{3/2}\right) + \frac{5}{2}\right] = Nk_B\left[\ln\frac{1}{n\lambda^3} + \frac{5}{2}\right]}$$with \( n = N/V \) and \( \lambda = h/\sqrt{2\pi mk_BT} \). From it:
- \( 1/T = \partial S/\partial E = \tfrac{3}{2}Nk_B/E \Rightarrow E = \tfrac{3}{2}Nk_BT \).
- \( P/T = \partial S/\partial V = Nk_B/V \Rightarrow PV = Nk_BT \).
- \( \mu = -T\,\partial S/\partial N = k_BT\ln(n\lambda^3) \).
The formula holds only where \( n\lambda^3 \ll 1 \). For helium at 300 K and 1 atm, \( \lambda \approx 0.050 \) nm and \( n\lambda^3 \approx 3\times10^{-6} \), so the classical treatment is excellent; Sackur–Tetrode then gives about 126 J mol\( ^{-1} \) K\( ^{-1} \).
The Gibbs paradox
Without the \( 1/N! \), the entropy is \( Nk_B[\ln(V\lambda^{-3}) + \tfrac{3}{2}] \), which is not extensive: doubling \( N \) and \( V \) does not double \( S \). Worse, removing a partition between two samples of the same gas at the same \( T \) and \( P \) would raise the entropy by \( 2Nk_B\ln2 \), though nothing macroscopic changes. Dividing by \( N! \) (identical particles are indistinguishable) removes the spurious term.
| Partition removed between | \( \Delta S \) |
|---|---|
| Two different ideal gases, \( N \) each, equal \( T, P \) | \( 2Nk_B\ln2 \) (genuine mixing) |
| Two samples of the same gas, equal \( T, P \) | 0 |
Memory Tricks
Don’t Confuse
| This | vs | That |
|---|---|---|
| Microstate: complete specification | Macrostate: a few macroscopic variables | |
| \( \Gamma \)-space: \( 6N \) dimensions, one point for the whole system | \( \mu \)-space: 6 dimensions, one point per particle | |
| Boltzmann \( S = k_B\ln\Omega \) (equal probabilities) | Gibbs \( S = -k_B\sum p_i\ln p_i \) (any distribution) | |
| Negative \( T \): hotter than any positive \( T \) | \( T \to 0^+ \): the coldest state | |
| Mixing different gases: \( \Delta S > 0 \) | “Mixing” identical gases: \( \Delta S = 0 \) | |
| Liouville: phase-space volume conserved | Entropy increase: coarse-grained volume grows |
Common Mistakes
Practice
All questions below are original practice questions written for this page. They are not from any CSIR NET paper.
Level 1: Foundation
- How many microstates have exactly two heads when four distinguishable coins are tossed?
- What is the dimension of the phase space of 10 point particles moving in three dimensions?
- What is the phase-space area enclosed by the trajectory of a 1D harmonic oscillator of energy \( E \) and angular frequency \( \omega \)?
Answers
- 6. \( \binom{4}{2} \).
- 60. \( 6N \).
- \( 2\pi E/\omega \). Ellipse of semi-axes \( \sqrt{2mE} \) and \( \sqrt{2E/m\omega^2} \); area \( \pi ab \).
Level 2: Part B Style
Practice Q1. Three distinguishable harmonic oscillators share three identical energy quanta. The number of microstates is:
(a) 6 (b) 10 (c) 20 (d) 27
Answer: (b) 10
\( \binom{q + N - 1}{q} = \binom{5}{3} = 10 \). Listing: (3,0,0) type: 3; (2,1,0) type: 6; (1,1,1): 1. Total 10. (d) treats quanta as distinguishable.
Practice Q2. A system of \( N \) independent two-level units (energies 0 and \( \varepsilon \)) is isolated with three-quarters of the units excited. Its temperature, in the microcanonical description, is:
(a) \( +0.91\,\varepsilon/k_B \) (b) \( -0.91\,\varepsilon/k_B \) (c) \( -1.10\,\varepsilon/k_B \) (d) infinite
Answer: (b) −0.91 ε/k_B
\( 1/T = (k_B/\varepsilon)\ln[(N - n)/n] = (k_B/\varepsilon)\ln(1/3) \). So \( T = -\varepsilon/(k_B\ln3) \approx -0.910\,\varepsilon/k_B \). (c) is \( -\ln 3 \), the reciprocal. More than half excited means negative temperature.
Practice Q3. For a particle of mass \( m \) in a one-dimensional box of length \( L \), the semiclassical number of states with energy below \( E \) is:
(a) \( \dfrac{L\sqrt{2mE}}{h} \) (b) \( \dfrac{2L\sqrt{2mE}}{h} \) (c) \( \dfrac{\pi L\sqrt{2mE}}{h} \) (d) \( \dfrac{2L\sqrt{2mE}}{\hbar} \)
Answer: (b)
The accessible region is \( 0 < x < L \), \( -\sqrt{2mE} < p < \sqrt{2mE} \): area \( 2L\sqrt{2mE} \). Divide by \( h \). Check: \( 2L\sqrt{2mE}/h = L\sqrt{2mE}/(\pi\hbar) \), the largest quantum number of the box. (a) forgets negative momenta.
Practice Q4. \( N \) atoms of a classical ideal gas expand isothermally from \( V \) to \( 2V \). The ratio of the number of accessible microstates after to before, \( \Omega_2/\Omega_1 \), is:
(a) 2 (b) \( 2N \) (c) \( 2^N \) (d) \( N^2 \)
Answer: (c) 2^N
At fixed \( E \) (isothermal ideal gas) \( \Omega \propto V^N \). So \( \Omega_2/\Omega_1 = 2^N \) and \( \Delta S = Nk_B\ln2 \), matching the thermodynamic result \( nR\ln2 \).
Level 3: Part C Style
Practice Q5. Two Einstein solids A and B, each of three oscillators, share six quanta and exchange energy freely. Consider:
- The total number of microstates of the combined system is 462.
- The most probable macrostate has three quanta in each solid.
- The probability of the most probable macrostate is about 0.22.
- The probability that solid A holds all six quanta is about 0.06.
Which are correct?
(a) 1 and 2 only (b) 1, 2 and 3 only (c) 2, 3 and 4 only (d) 1, 2, 3 and 4
Answer: (d) 1, 2, 3 and 4
\( \Omega_A(q_A) = \binom{q_A + 2}{q_A} \), \( \Omega_B = \binom{6 - q_A + 2}{6 - q_A} \).
| \( q_A \) | 0 | 1 | 2 | 3 | 4 | 5 | 6 |
|---|---|---|---|---|---|---|---|
| \( \Omega_A\Omega_B \) | 28 | 63 | 90 | 100 | 90 | 63 | 28 |
- Sum = 462, which also equals \( \binom{6 + 6 - 1}{6} = \binom{11}{6} \) for six oscillators. True.
- Peak at \( q_A = 3 \). True.
- \( 100/462 \approx 0.216 \). True.
- \( 28/462 \approx 0.061 \). True.
With six oscillators the peak is broad; with \( 10^{23} \) it becomes infinitely sharp in relative terms.
Practice Q6. For a classical monatomic ideal gas with entropy given by the Sackur–Tetrode equation, consider:
- Doubling \( N \), \( V \) and \( E \) together doubles \( S \).
- Removing a partition between two equal samples of the same gas at equal \( T \) and \( P \) raises \( S \) by \( 2Nk_B\ln2 \).
- The equation predicts \( S \to -\infty \) as \( T \to 0 \), signalling the breakdown of classical statistics.
- The chemical potential \( \mu = k_BT\ln(n\lambda^3) \) is negative whenever the classical description is valid.
Which are correct?
(a) 1 and 2 only (b) 1, 3 and 4 only (c) 2 and 3 only (d) 1, 2, 3 and 4
Answer: (b) 1, 3 and 4 only
- \( S \) depends on \( V/N \) and \( E/N \) times \( N \): extensive. True.
- With the \( N! \) correction the change is zero; \( 2Nk_B\ln2 \) is the Gibbs paradox result without it. False.
- \( \ln(1/n\lambda^3) \to -\infty \) as \( \lambda \to \infty \). True: the classical formula fails when \( n\lambda^3 \gtrsim 1 \).
- Validity requires \( n\lambda^3 \ll 1 \), so \( \ln(n\lambda^3) < 0 \). True.
Practice Q7. An isolated paramagnet of \( N \) spin-1/2 moments in field \( B \) has single-spin energies \( \mp\mu_BB \). Its energy is raised slowly from \( -N\mu_BB \) to \( +N\mu_BB \). Consider:
- The entropy is maximum at \( E = 0 \), where it equals \( Nk_B\ln2 \).
- The temperature passes from \( +0 \) through \( +\infty \) to negative values and ends at \( -0 \).
- In the range \( E > 0 \), placing the paramagnet in thermal contact with a gas at 300 K makes energy flow from the gas to the paramagnet.
- \( \beta = 1/k_BT \) varies continuously over the whole range.
Which are correct?
(a) 1 and 2 only (b) 1, 2 and 4 only (c) 2 and 3 only (d) 1, 2, 3 and 4
Answer: (b) 1, 2 and 4 only
- At \( E = 0 \), half the spins are up: \( \Omega = \binom{N}{N/2} \approx 2^N \). True.
- \( 1/T \) runs from \( +\infty \) through 0 to \( -\infty \). True.
- A negative-temperature system is hotter than any positive one: energy flows from the paramagnet to the gas. False.
- \( \beta \) passes smoothly through zero; only \( T \) jumps from \( +\infty \) to \( -\infty \). True.
Quick Revision Table
| Idea | Formula or fact |
|---|---|
| Phase space | \( 2f \) dimensions; \( 6N \) for \( N \) particles in 3D |
| Liouville | \( d\rho/dt = 0 \); equilibrium \( \rho = \rho(H) \) |
| State counting | \( d^{3N}q\,d^{3N}p/(N!\,h^{3N}) \) |
| Oscillator orbit | area \( 2\pi E/\omega \); states \( E/\hbar\omega \) |
| Boltzmann / Gibbs entropy | \( k_B\ln\Omega \); \( -k_B\sum p_i\ln p_i \) |
| Microcanonical | \( 1/T = \partial S/\partial E \), \( P/T = \partial S/\partial V \), \( \mu/T = -\partial S/\partial N \) |
| Einstein solid | \( \Omega = \binom{q + N - 1}{q} \) |
| Two-level | \( 1/T = (k_B/\varepsilon)\ln[(N - n)/n] \); \( T < 0 \) for \( n > N/2 \) |
| Sackur–Tetrode | \( S = Nk_B[\ln(1/n\lambda^3) + 5/2] \), \( \lambda = h/\sqrt{2\pi mk_BT} \) |
| Classical validity | \( n\lambda^3 \ll 1 \) |
| Gibbs paradox | \( 1/N! \) restores extensivity; same-gas mixing gives 0 |
Key Takeaways
What’s Next
- Canonical and Grand Canonical Ensembles: systems in contact with a heat bath and a particle reservoir, and the free energy from the partition function.
- Thermodynamic Potentials, Maxwell Relations and Phase Equilibria, if the derivatives of \( S \) need refreshing.
- The Boltzmann Distribution in Chemical Sciences, for the same counting applied to molecular energy levels.
- Thermodynamics and Statistical Physics (Core) overview.