For decades, investors and global institutions like the IMF have relied on the cyclically adjusted price to earnings ratio, better known as the Shiller CAPE ratio, to gauge whether the stock market is overpriced. The logic has always been simple: when the ratio is high, long term returns tend to be low. However, new research suggests that this gold standard of valuation may be fundamentally flawed, potentially masking just how expensive today’s market actually is.
A recent study titled Aggregation Consistency and Return Predictability argues that the traditional method of calculating CAPE creates a hidden weighting mismatch. By dividing the overall index price by summed earnings, the standard formula accidentally gives too much weight to companies with high earnings relative to their price. Meanwhile, the massive technology giants that dominate modern portfolios are often priced far above their current earnings. Because these mega cap stocks have a disproportionate influence on actual market returns but a smaller footprint in the aggregate earnings calculation, the conventional CAPE ratio systematically underestimates the valuation of the broader index.
To fix this, researchers propose switching to what they call a Component CAPE ratio. Instead of looking at the index as one giant block, they calculate a separate ratio for every single company in the S&P 500 and then average them based on their actual market value. This shift reveals a startling discrepancy. Between 1964 and 2024, the Component CAPE averaged nearly thirty percent higher than the Aggregate version. This gap becomes particularly wide during speculative bubbles, such as the dot com era or our current moment of extreme tech concentration, meaning investors who rely on traditional metrics might be flying blind into overvalued territory.
The evidence shows that this adjustment isn’t just academic; it provides significantly better predictions for where stocks are headed. When tested against historical data, the Component CAPE explained substantially more of the variation in ten year returns than its predecessor. More importantly for practitioners, strategies built around this refined metric outperformed static sixty forty portfolios and basic benchmarks in terms of risk adjusted returns. By accurately capturing the influence of expensive large cap stocks, this updated approach offers a clearer lens through which to view market risk and plan long term asset allocation.