Our Standard Analysis Procedures
Posted: Sun Mar 20, 2005 12:47 pm
Our Standard Analysis Procedure
We have been applying these procedures ever since we discovered the tight relationship between Historical Surviving Withdrawal Rates and the percentage earnings yield of the S&P500, 100E10/P. We have had considerable success.
1) The first step is to collect historical data.
2) The next step is to plot the historical data versus 100E10/P. We use Excel calculations to determine the best linear curve fit (i.e., regression).
3) We determine confidence limits. Most of the time, we use eyeball estimates as a convenience. We have the appropriate formulas that we can use when we need better precision.
4) We refer to the linear curve fit itself as the Calculated Rate. We identify the lower confidence limit as the Safe Withdrawal Rate. We identify the upper confidence limit as the High Risk Rate.
5) We provide a baseline (or baselines) for comparisons. These days, we make sure to include TIPS at a 2% interest rate. We often include a baseline consisting only of 2% TIPS.
Collecting Historical Data
We collect historical sequence information with a variety of criteria and withdrawal algorithms. We use a procedure similar to that used with Historical Surviving Withdrawal Rates. We identify the highest withdrawal rate that satisfies the criteria with a precision of 0.1%. When we increase the withdrawal rate by 0.1%, the historical sequence fails to meet the criteria.
One of our criteria is the Half Failure Surviving Withdrawal Rate over a period of 30 years. The portfolio's balance is allowed to fall to one-half of its initial value within the 30-year period. It is not allowed to fall below one-half of its initial value.
Another example of our criteria is to maintain a Constant Terminal Value over a period of 30 years. The portfolio's balance at year 30 must be at least as high as the initial balance at this rate. But the portfolio's balance at year 30 must be less than its initial level when we increase the withdrawal rate by 0.1%.
Quite often, we have simply collected the final balances at specific withdrawal rates. This makes the analysis especially easy to perform. It can be a great time saver for making an initial survey.
With rare exceptions, we adjust withdrawals to match inflation in accordance with the CPI. Except when noted, we use an expense ratio of 0.20%.
We almost always look at a time frame of 30 years. The reason has to do with data analysis. It is not because 30 years is the most relevant period for retirees. It is a relevant for many retirees, but not all. It is relevant for very few early retirees, if any. Rather, it has to do with the stock market.
When we look at Historical Surviving Withdrawal Rates, we find that good times and bad times appear in intervals of 30 to 35+ years. Here are some key dates (rounded) when Historical Surviving Withdrawal Rates were low: 1930, 1965-1970 and 2000. If we extend our period to 40 years, the data show some bimodal statistical effects. That is, a historical sequence can have two bad times and one good time or it can have two good times and one bad time. Bimodal effects make analysis difficult.
Another reason for using 30 years has to do with using complete historical sequences. We have found that sequences that began in 1965-1970 are almost always worst-case sequences. If we extend our time period to 40 years, all of these become partial sequences. They are influenced by dummy data values for 2003-2010.
Plotting the Historical Data versus 100E10/P
In retrospect, it seems obvious that Historical Surviving Withdrawal Rates should follow the market's earnings yield closely. After all, the Dividend Discount Model, the Gordon Equation and John Bogle's preferred variation of them all point to a linear relationship between future stock market returns and dividend yields. Take note that dividends come out of earnings. Then, add Professor Shiller's contribution of P/E10, which he based on Ben Graham's recommendation to average several years of earnings when evaluating companies. Finally, add the observation that overall earnings have grown at a remarkably steady pace when smoothed by averaging ten years of data. It all seems simple now, looking backward. It was not simple looking forward.
The greatest difficulty was the anomalous behavior of Historical Surviving Withdrawal Rates with P/E10. There are numerous reasons as to why such an anomaly might exist. Gummy's recent research sheds additional light. He calculated correlation coefficients for linear curve fits (i.e., regression equations) versus start years of the historical sequences. There is a notch centered at 1881. The correlation recovers and it is strong once again after six years.
Gummy's GARCH thread dated Sat Jan 15, 2005.
http://nofeeboards.com/boards/viewtopic.php?t=3264
http://nofeeboards.com/boards/viewtopic ... 209#p26209
Gummy's plot involved Half Failure Withdrawal Rates, the highest withdrawal rate that you can use (in increments of 0.1%) while assuring that all portfolio balances within a historical sequence stay above one-half of the initial balance. Half Failure Withdrawal Rates and Historical Surviving Withdrawal Rates and several additional measures all behave in a similar manner.
I standardized on collecting data for the start years of 1921-1980 before Gummy's discovery. I standardized on using the 1923-1980 data for linear curve fits. The years 1921 and 1922 have exceptionally high earnings yields that take the plot into saturation. That is, their Historical Surviving Withdrawal Rates no longer increase as much with 100E10/P as at smaller levels. (They still increase, just not by as much.)
Confidence Limits
We can calculate confidence limits by making a series of approximations and taking advantage of an analog of a standard statistical problem. The key issue, however, is determining the appropriate number of degrees of freedom when applying Student's t-test. To what extent does the overlap of sequences distort our ability to determine the underlying relationship?
It turns out not to be nearly so bad as it might appear. Every sequence has at least one value of P/E10 that is unique when compared to its nearest neighbor. The randomness in stock prices, even from a single point, overwhelms the other factors. Comparing two sequences always includes at least two unique points with the full randomness of the year-to-year change in stock prices. Comparing every other sequence is more than sufficient to produce unique results. The effective number of degrees of freedom is between what we would use if everything were entirely random and one-half of that number.
The process of determining the number of degrees of freedom involves a couple of iterations. The first step is to make a curve fit and to determine the confidence limits that would apply if the year-to-year variations equaled the total range of the Historical Surviving Withdrawal Rates. The next step is to revise these confidence limits based upon how much year-to-year randomness is actually present. This establishes a revised set of confidence limits, which are accurate enough for us to use.
We have been able to reveal the effect of overlapping sequences in our investigations of A New Tool. By looking at the tightest curve fit (with R-squared above 90%), which occurs at the 14-year point for 30-year survival periods, we can see small variations relative to their closest neighbors.
Based on this detailed analysis, it is clear that eyeball estimates are reasonably close to accurately calculated confidence limits.
There are times when I limit confidence limits to data at earnings yields below 10% (i.e., P/E10 above 10). I do this most often when making eyeball estimates.
The spread of the data increases with earnings yield, which makes a statistical characterization difficult. Plots using P/E10 have well-behaved, constant spreads. Using earnings yield results in linear curves, but with increasing standard deviations. Using P/E10 produces curves that are distinctly non-linear, but with constant standard deviations.
The Calculated Rate, the Safe Withdrawal Rate and High Risk Rate
I use 90% confidence levels centered about the regression equation (which is the straight line curve fit and the Calculated Rate) based on the standard approximation that uses a Gaussian distribution. [They actually turn out to be between 85% to 90%.] This level is sufficiently coarse to make it clear that we do not claim exceedingly high levels of accuracy and precision. It is reasonable. The one-sided probabilities of error are 5% at the Safe Withdrawal Rate and 5% at the High Risk Rate.
Baselines
It is a good idea to include baselines in any investigation.
The most basic baseline related to Safe Withdrawal Rates is what an inflation-matched cash equivalent would do. It allows you to withdraw 1/N times your initial balance for exactly N years. This establishes a performance floor. For example, if you cannot depend upon a 3.33% withdrawal rate over 30 years or a 2.50% withdrawal rate over 40 years, what does your strategy have to offer? It may offer a reasonable probability of a much better result. Just be aware of the alternatives.
Most of our data used commercial paper as part of the baseline. Although highly realistic, this turns out to be a bad choice. Commercial paper has acted quite differently at three different time frames.
Back in the late 1800s, overall prices declined as a result of increased productivity. The result, which is technically different from deflation, was that commercial paper by itself produced 6% withdrawal rates safely (when adjusted to match inflation). During the Great Depression, commercial paper was a disaster. Those are the years that have made commercial paper look like a horrible choice. More recently, during the 1960s and 1970s, commercial paper has behaved similar to TIPS at a 1% interest rate.
Commercial paper is always of interest. There were a few instances in the 1960s in which a portfolio consisting entirely of commercial paper would have done better than a portfolio that included stocks. These were unusual occurrences, to be sure, but they are important. There have been times when owning stocks has decreased portfolio survivability. As you might expect, those were times when stock prices were very high.
I am now using TIPS with a 2% interest rate in my baseline. I am of the opinion, but without proof, that it will always be possible to construct an equivalent to 2% TIPS. In contrast to commercial paper, TIPS perform consistently. Surprisingly, a portfolio consisting entirely of 2% TIPS makes a formidable baseline, but one that can often be breached. For example, 2% TIPS have a 35-year Safe Withdrawal Rate of 4.00% that is truly safe (not just 95% safe). Portfolios of 50% and 80% stocks plus commercial paper have lasted only 30 years.
Have fun.
John R.
We have been applying these procedures ever since we discovered the tight relationship between Historical Surviving Withdrawal Rates and the percentage earnings yield of the S&P500, 100E10/P. We have had considerable success.
1) The first step is to collect historical data.
2) The next step is to plot the historical data versus 100E10/P. We use Excel calculations to determine the best linear curve fit (i.e., regression).
3) We determine confidence limits. Most of the time, we use eyeball estimates as a convenience. We have the appropriate formulas that we can use when we need better precision.
4) We refer to the linear curve fit itself as the Calculated Rate. We identify the lower confidence limit as the Safe Withdrawal Rate. We identify the upper confidence limit as the High Risk Rate.
5) We provide a baseline (or baselines) for comparisons. These days, we make sure to include TIPS at a 2% interest rate. We often include a baseline consisting only of 2% TIPS.
Collecting Historical Data
We collect historical sequence information with a variety of criteria and withdrawal algorithms. We use a procedure similar to that used with Historical Surviving Withdrawal Rates. We identify the highest withdrawal rate that satisfies the criteria with a precision of 0.1%. When we increase the withdrawal rate by 0.1%, the historical sequence fails to meet the criteria.
One of our criteria is the Half Failure Surviving Withdrawal Rate over a period of 30 years. The portfolio's balance is allowed to fall to one-half of its initial value within the 30-year period. It is not allowed to fall below one-half of its initial value.
Another example of our criteria is to maintain a Constant Terminal Value over a period of 30 years. The portfolio's balance at year 30 must be at least as high as the initial balance at this rate. But the portfolio's balance at year 30 must be less than its initial level when we increase the withdrawal rate by 0.1%.
Quite often, we have simply collected the final balances at specific withdrawal rates. This makes the analysis especially easy to perform. It can be a great time saver for making an initial survey.
With rare exceptions, we adjust withdrawals to match inflation in accordance with the CPI. Except when noted, we use an expense ratio of 0.20%.
We almost always look at a time frame of 30 years. The reason has to do with data analysis. It is not because 30 years is the most relevant period for retirees. It is a relevant for many retirees, but not all. It is relevant for very few early retirees, if any. Rather, it has to do with the stock market.
When we look at Historical Surviving Withdrawal Rates, we find that good times and bad times appear in intervals of 30 to 35+ years. Here are some key dates (rounded) when Historical Surviving Withdrawal Rates were low: 1930, 1965-1970 and 2000. If we extend our period to 40 years, the data show some bimodal statistical effects. That is, a historical sequence can have two bad times and one good time or it can have two good times and one bad time. Bimodal effects make analysis difficult.
Another reason for using 30 years has to do with using complete historical sequences. We have found that sequences that began in 1965-1970 are almost always worst-case sequences. If we extend our time period to 40 years, all of these become partial sequences. They are influenced by dummy data values for 2003-2010.
Plotting the Historical Data versus 100E10/P
In retrospect, it seems obvious that Historical Surviving Withdrawal Rates should follow the market's earnings yield closely. After all, the Dividend Discount Model, the Gordon Equation and John Bogle's preferred variation of them all point to a linear relationship between future stock market returns and dividend yields. Take note that dividends come out of earnings. Then, add Professor Shiller's contribution of P/E10, which he based on Ben Graham's recommendation to average several years of earnings when evaluating companies. Finally, add the observation that overall earnings have grown at a remarkably steady pace when smoothed by averaging ten years of data. It all seems simple now, looking backward. It was not simple looking forward.
The greatest difficulty was the anomalous behavior of Historical Surviving Withdrawal Rates with P/E10. There are numerous reasons as to why such an anomaly might exist. Gummy's recent research sheds additional light. He calculated correlation coefficients for linear curve fits (i.e., regression equations) versus start years of the historical sequences. There is a notch centered at 1881. The correlation recovers and it is strong once again after six years.
Gummy's GARCH thread dated Sat Jan 15, 2005.
http://nofeeboards.com/boards/viewtopic.php?t=3264
http://nofeeboards.com/boards/viewtopic ... 209#p26209
Gummy's plot involved Half Failure Withdrawal Rates, the highest withdrawal rate that you can use (in increments of 0.1%) while assuring that all portfolio balances within a historical sequence stay above one-half of the initial balance. Half Failure Withdrawal Rates and Historical Surviving Withdrawal Rates and several additional measures all behave in a similar manner.
I standardized on collecting data for the start years of 1921-1980 before Gummy's discovery. I standardized on using the 1923-1980 data for linear curve fits. The years 1921 and 1922 have exceptionally high earnings yields that take the plot into saturation. That is, their Historical Surviving Withdrawal Rates no longer increase as much with 100E10/P as at smaller levels. (They still increase, just not by as much.)
Confidence Limits
We can calculate confidence limits by making a series of approximations and taking advantage of an analog of a standard statistical problem. The key issue, however, is determining the appropriate number of degrees of freedom when applying Student's t-test. To what extent does the overlap of sequences distort our ability to determine the underlying relationship?
It turns out not to be nearly so bad as it might appear. Every sequence has at least one value of P/E10 that is unique when compared to its nearest neighbor. The randomness in stock prices, even from a single point, overwhelms the other factors. Comparing two sequences always includes at least two unique points with the full randomness of the year-to-year change in stock prices. Comparing every other sequence is more than sufficient to produce unique results. The effective number of degrees of freedom is between what we would use if everything were entirely random and one-half of that number.
The process of determining the number of degrees of freedom involves a couple of iterations. The first step is to make a curve fit and to determine the confidence limits that would apply if the year-to-year variations equaled the total range of the Historical Surviving Withdrawal Rates. The next step is to revise these confidence limits based upon how much year-to-year randomness is actually present. This establishes a revised set of confidence limits, which are accurate enough for us to use.
We have been able to reveal the effect of overlapping sequences in our investigations of A New Tool. By looking at the tightest curve fit (with R-squared above 90%), which occurs at the 14-year point for 30-year survival periods, we can see small variations relative to their closest neighbors.
Based on this detailed analysis, it is clear that eyeball estimates are reasonably close to accurately calculated confidence limits.
There are times when I limit confidence limits to data at earnings yields below 10% (i.e., P/E10 above 10). I do this most often when making eyeball estimates.
The spread of the data increases with earnings yield, which makes a statistical characterization difficult. Plots using P/E10 have well-behaved, constant spreads. Using earnings yield results in linear curves, but with increasing standard deviations. Using P/E10 produces curves that are distinctly non-linear, but with constant standard deviations.
The Calculated Rate, the Safe Withdrawal Rate and High Risk Rate
I use 90% confidence levels centered about the regression equation (which is the straight line curve fit and the Calculated Rate) based on the standard approximation that uses a Gaussian distribution. [They actually turn out to be between 85% to 90%.] This level is sufficiently coarse to make it clear that we do not claim exceedingly high levels of accuracy and precision. It is reasonable. The one-sided probabilities of error are 5% at the Safe Withdrawal Rate and 5% at the High Risk Rate.
Baselines
It is a good idea to include baselines in any investigation.
The most basic baseline related to Safe Withdrawal Rates is what an inflation-matched cash equivalent would do. It allows you to withdraw 1/N times your initial balance for exactly N years. This establishes a performance floor. For example, if you cannot depend upon a 3.33% withdrawal rate over 30 years or a 2.50% withdrawal rate over 40 years, what does your strategy have to offer? It may offer a reasonable probability of a much better result. Just be aware of the alternatives.
Most of our data used commercial paper as part of the baseline. Although highly realistic, this turns out to be a bad choice. Commercial paper has acted quite differently at three different time frames.
Back in the late 1800s, overall prices declined as a result of increased productivity. The result, which is technically different from deflation, was that commercial paper by itself produced 6% withdrawal rates safely (when adjusted to match inflation). During the Great Depression, commercial paper was a disaster. Those are the years that have made commercial paper look like a horrible choice. More recently, during the 1960s and 1970s, commercial paper has behaved similar to TIPS at a 1% interest rate.
Commercial paper is always of interest. There were a few instances in the 1960s in which a portfolio consisting entirely of commercial paper would have done better than a portfolio that included stocks. These were unusual occurrences, to be sure, but they are important. There have been times when owning stocks has decreased portfolio survivability. As you might expect, those were times when stock prices were very high.
I am now using TIPS with a 2% interest rate in my baseline. I am of the opinion, but without proof, that it will always be possible to construct an equivalent to 2% TIPS. In contrast to commercial paper, TIPS perform consistently. Surprisingly, a portfolio consisting entirely of 2% TIPS makes a formidable baseline, but one that can often be breached. For example, 2% TIPS have a 35-year Safe Withdrawal Rate of 4.00% that is truly safe (not just 95% safe). Portfolios of 50% and 80% stocks plus commercial paper have lasted only 30 years.
Have fun.
John R.