Dark Energy and Why the Universe Is Accelerating Apart

When physicists talk about dark energy, they are describing something genuinely strange: a form of energy that fills all of space, does not dilute as the universe expands, and pushes everything in the universe away from everything else. We infer its existence from the accelerating expansion of the universe, observed first in 1998 by two independent teams studying distant supernovae. The discovery won its leaders — Saul Perlmutter, Brian Schmidt, and Adam Riess — the 2011 Nobel Prize in Physics. Today, dark energy is incorporated into the standard cosmological model (Lambda-CDM) as the dominant component of the universe's energy budget: about 68% of the total. We have confirmed it through multiple independent observations. We still do not know what it is.

What happened

The discovery came from measuring the distances and recession velocities of Type Ia supernovae. These stellar explosions have a known intrinsic brightness, making them "standard candles" — by comparing how bright they appear with how bright they must be, astronomers can calculate their distance precisely. Measuring their recession velocity from the redshift of their light gives the expansion rate at the time they exploded.

Both the High-Z Supernova Search Team (led by Schmidt and Riess) and the Supernova Cosmology Project (led by Perlmutter) expected to measure how fast the universe's expansion was slowing down — matter's gravity should be pulling everything back, gradually decelerating the expansion started by the Big Bang. Instead, the distant supernovae appeared slightly dimmer than expected. They were farther away than a decelerating universe would put them. The expansion was not slowing — it was speeding up.

The simplest mathematical description of this effect is Einstein's cosmological constant, Lambda — a term he originally introduced into his equations in 1917 to make a static universe and later abandoned as his "greatest blunder" once Hubble discovered the expansion. Ironically, Lambda has now been rehabilitated as the best description of dark energy: a constant energy density of empty space that does not change as the universe expands. This is mathematically equivalent to what quantum field theory calls vacuum energy — the zero-point energy of quantum fields filling all of space.

The problem is that when physicists calculate the vacuum energy from quantum field theory, they get a number roughly 10^120 times larger than the observed dark energy density. This is the worst prediction in the history of physics — the cosmological constant problem. Either there is a nearly exact cancellation between positive and negative vacuum energy contributions (which would require extraordinary fine-tuning), or our understanding of quantum field theory is incomplete, or dark energy is not vacuum energy at all but something else — a dynamical field (called quintessence) that varies in space and time, or a modification of general relativity on cosmological scales.

Why it matters

Dark energy is the reason the universe ends in something like the "heat death" scenario rather than a "big crunch." Because dark energy does not dilute as the universe expands, it will increasingly dominate over matter and radiation, causing the expansion rate to grow. Eventually — in many billions of years — galaxies outside the Local Group will recede faster than the speed of light and disappear beyond our cosmological horizon. The observable universe will gradually shrink to just our local cluster, and then to emptiness and thermal equilibrium.

On shorter timescales, dark energy affects the formation of cosmic structure. Its effect on the expansion rate influences when galaxy clusters form and how densely packed large-scale structure becomes. The detailed statistics of the cosmic web carry imprints of dark energy's properties, and surveys like the Dark Energy Spectroscopic Instrument (DESI), the Euclid satellite, and the Vera Rubin Observatory are measuring these imprints with increasing precision.

The deeper significance is that dark energy represents a fundamental gap in our understanding. We have accounted for 96% of the universe with things we cannot directly see or touch: 5% ordinary matter, 27% dark matter, 68% dark energy. The universe as we observe it is mostly made of stuff whose nature we do not understand.

How to think about it

Dark energy is most intuitively understood through an analogy to anti-gravity — not in the science-fiction sense, but in the sense that it has a negative pressure that causes space to push things apart rather than pull them together. In Einstein's general relativity, energy and pressure both contribute to gravity. Normal matter and radiation have positive pressure and attractive gravity. Dark energy has negative pressure, and its repulsive gravitational effect overwhelms the attractive contribution of its energy density when integrated over the whole universe.

The cosmological constant problem — why the vacuum energy is 10^120 smaller than quantum field theory naively predicts — is perhaps the most profound puzzle in all of physics. Some physicists invoke the anthropic principle: in a multiverse with different vacuum energies, only universes where Lambda is small enough for galaxies and stars to form will contain observers to measure it. Others find this argument deeply unsatisfying and seek a dynamical mechanism that naturally suppresses the vacuum energy. Neither camp has a convincing answer.

What the current surveys are testing is whether dark energy is constant (pure cosmological constant) or varies over time (dynamic dark energy). The DESI collaboration's 2024 results showed a slight hint that dark energy may not be constant — a result that, if confirmed, would be the most significant discovery in cosmology since 1998. The error bars are still large; more data is coming.

FAQ