Playing the Probabilities

The following is one of my favorite running stats on the stock market:

SPX Time Frames

Over the years I’ve noticed that whenever these types of long-term numbers are presented there tend to be two extreme responses:

  1. See, put your money in stocks, close your eyes and you’ll be fine in a couple decades.
  2. Who has a twenty year time horizon? How many people have the patience to wait that long?

There is some truth in each of these statements, but as with most things the historical data is never black or white, but a shade of gray. The future is uncertain, so investors should always think in terms of probabilities, never guarantees. What this data tells me is that the longer your time horizon, the higher your probability of seeing a gain in the stock market.

Does this mean that you’re guaranteed to earn a certain level of returns in stocks if you hold them for a specfied time frame? No.

Will these same results be guaranteed to repeat themselves in the future? No.

Has anyone figured out a better way of compounding your money in stocks beyond increasing your holding period? Not many.

Are there investors out there who actually have twenty year time horizons? Absolutely — Millennials just starting out in their career, middle-aged workers playing catch-up with their retirement savings and even retirees who will likely have 2-3 more decades to invest during their retirement years. The difference in each case comes down to how much each of these investors should hold in stocks and what their needs are in the meantime.

I like to think that every single retirement contribution has it’s own twenty or thirty year time horizon.

The usual caveats apply here — these numbers are before inflation, taxes or costs are taken into account (although one of the biggest benefits about a longer holding period is that you can reduce the impact of trading costs and taxes on your portfolio). With that disclaimer out of the way, here are a few more interesting long-term stock market stats I found while computing these numbers:

  • The worst total return over a 20 year period was 54%. But the worst 30 year total return was 854%.
  • The standard deviation of annual returns over 20 and 30 year time frames has been remarkably low — just 1.3% and 2.8%, respectively. The volatility in returns has historically fallen off a cliff as you extend the time horizon in the market.
  • Volatility in the stock market during the 1930s was insane. Not only did the market drop more than 80% during the Great Depression, but during that period there were two separate quarters that saw stocks rise in excess of 80%.
  • In contrast to the large losses seen in 1930s, the bull market of the 1980s and 1990s produced an amazing run of gains for long-term investors. If you would have invested at any point between 1973 and 1985 you would have earned anywhere from 12-18% per year over the following twenty years.
  • Annual returns are all over the place and rarely do investors experience average performance in any given year as you can see from this graph:
Annual SPX

Further Reading:
What Constitutes Long-Term in the Stock Market?

 

 

Download PDF

Full Disclosure: Nothing on this site should ever be considered to be advice, research or an invitation to buy or sell any securities, please see my Terms & Conditions page for a full disclaimer.

What's been said:

Discussions found on the web
  1. 10 Monday AM Reads | The Big Picture commented on Nov 09

    […] • The Discovery of Statistical Regression (Pricenomics) see also Playing the Probabilities (Wealth of Common Sense) • The Uberization of Money (WSJ) • Human Cost Rises as Old Bridges, Dams and Roads Go […]

  2. Rob Wilson commented on Nov 09

    Nice post, thanks Ben. One of the remarkable things from reviewing the historical data is that variance of equities is lower than that of bonds (and incredibly low as you pointed out) when the time horizon is expanded (remembering a chart from Jeremy Siegel’s book) due to the mean reverting nature of equities. The hard part I would think is knowing how to reallocate as one moves closer to retirement/withdrawals.

    • Ben commented on Nov 09

      Yup, one of the crazier stats out there. I agree that things become much more challenging as you approach retirement age.

  3. Michael Harris commented on Nov 09

    “The standard deviation of annual returns over 20 and 30 year time frames has been remarkably low — just 1.3% and 2.8%, respectively.”

    I am calculating a standard deviation of 17.6% for annual returns of SP500TR since 1988. The mean annualized standard deviation (rolling) is 7.32% with a standard deviation of 7.32%.

    • John Richards commented on Nov 09

      I agree, stock market SD’s seem to be 15%+ … a 60/40 portfolio about 12-13%… can’t get much below 5% even in cash. I think those are all annual measures though. It sounds like those low SD numbers are the result of taking a sequence of 20 (& 30) year average equity returns? Meaning, data point 1 is 1930-1950 return, data point 2 is 1931-1951 return, etc…. I expect that would produce a result on the order of these lower numbers that Ben notes above.

      • Michael Harris commented on Nov 09

        I think you are correct. He is actually talking about the stdev the average return over 20 or 30 years. Still this is of no cancellation to investors in 2003 and 2008 that faced a 50% drawdown and possibly sold everything and ran for cover. Ensemble averages can be quite misleading. It is rather time averages that reflect the risks in the markets.

        • John Richards commented on Nov 09

          No consolation indeed, but had they fully understood the implications of this chart, perhaps those who sold in panic might have held on? Emotions are a tricky business. Investing is as much or more about temperament & perspective than it is about IQ (aren’t most things?). “Anger, fear, aggression, the Dark Side of Investing are they… consume you it will…” ;>).

        • Ben commented on Nov 09

          Of course, no stats matter if you sell after a crash.

  4. Lonmin the loser | Vestact's – Quirk with quark commented on Nov 10

    […] has the the benefit of lower transaction fees and a higher probability of being positive – Playing the Probabilities. Even though the market as a whole has been up over the long term, buying individual stocks might […]

  5. Top Credit Cards,Awards to Alaska & Fiji,Bars in Strange Places commented on Nov 10

    […] Playing the probabilities. If I kept track of blogs I love in personal finance, the blog “A Wealth of Common Sense” would be on the top. Amazing run and talent! To top it off, he is a fellow hurting Detroit Lions fan lol. […]

  6. Francisco G commented on Nov 11

    Fantastic graphs on S&P time frame and S&P returns. Thanks so much. 46years of + returns vs 42 of negative ones but most positives being higher 41 of these +ves giving a return between 0 and 40%, as opposed to 36 giving a negative return between 0 and “just” -20%. Still a compelling case!

  7. Dave Shenton commented on Nov 11

    Just wondering. Since 2015 isn’t over yet. Is there an “as of” date for the data? I didn’t see one.

  8. Do People Want to be Fooled? | The Irrelevant Investor commented on Nov 11

    […] going to cut it. With investing, being average can actually be extraordinary.  My partner Ben Carlson recently showed that the worst thirty-year period ever for the S&P 500 was 850%! If only people […]

  9. Quantitative Lemming commented on Nov 12

    Nice statistic. On first sight, however, there are several issues which come to mind immediately :

    1.) There are 69 (technically 68, as 2015 is still not over) data points for the “20 years” time frame. That is hardly statistical significant.

    2.) The data is most likely not adjusted for inflation, is it? If we adjust for inflation, there will be “20 years” time frames with negative performance. Moreover if we look for instance at the “INFASPG Index” (S%P 500 in Gold Index), there are plenty of negative “20 years” time frames as well.

    3.) This statistic is “S&P 500” specific (or let’s say Western “market” specific).. Take for instance a look at the Nikkei 225, There are various “20 years” time frames with negative performance.

  10. 10 Weekend Reads | The Big Picture commented on Nov 14

    […] • The Discovery of Statistical Regression (Priceonomics) see also Playing the Probabilities (A Wealth of Common Sense) • Howard Buffett Is Getting His Hands Dirty (Bloomberg) • The Start-Up That Will Keep […]

  11. What’s The Message From Falling Commodity Prices? commented on Nov 15

    […] Ben Carson has a good reminder about keeping your personal time frame in mind. For most this is more successful than trying to guess the right times for big changes in asset allocation. Also check out his scatterplot of annual returns. You will see why “average” is misleading! […]

  12. Howard Siow tweeted on Nov 15

    The stats are essentially taking a 90 year US boom period (and tailwind of WW2 technology), and then tried to extrapolate it another 30 years. If I gave you a 3 day uptrend and told you tomorrow must be going up too, would that be sound advice?

    It’s not your fault though, because we simply do not have 2000 years of data, much less for other markets for 2000 years (eg. commodity markets, European/Asian fixed income and equity markets). Taking US economic data of the last 90 years and extrapolating it forward 30 years, is a bit akin to extrapolating China economic data for the last 30 years, and extrapolating it forward for the next 10. Or taking the last 30 minutes of NIKEI data and extrapolating the line 10 minutes. It’s not ridiculous, but I wouldn’t bet on it, much less invest on it.

    I highly recommend you read this book: http://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/0393310728

  13. Falling Commodity Prices commented on Nov 16

    […] Ben Carson has a good reminder about keeping your personal time frame in mind. For most this is more successful than trying to guess the right times for big changes in asset allocation. Also check out his scatterplot of annual returns. You will see why “average” is misleading! […]

  14. 2016 Prediction commented on Jan 08

    […] courtesy of A Wealth of Common Sense. Click image to […]