Evidence-based investing research
Value Investing Strategy (Strategy Overview)
Allocations for November 2026 (Final)
Cash TLT LQD SPY
Momentum Investing Strategy (Strategy Overview)
Allocations for November 2026 (Final)
1st ETF 2nd ETF 3rd ETF

Financial Experts Ignoring Better Statistical Methods?

Steve LeCompte | | Posted in: Big Ideas

Key Insight

Lopez de Prado argues standard econometric methods fail in finance due to linearity assumptions and p-value reliance, while machine learning better exploits path information and controls overfitting (theoretical comparison).

Why are expert economic and financial (econometric) forecasters so inaccurate? In his April 2019 presentation package for a graduate course at Cornell entitled “The 7 Reasons Most Econometric Investments Fail”, Marcos Lopez de Prado enumerates shortcomings of standard econometric statistical methods, which concentrate on multivariate linear regressions. In contrast, advanced computational methods that exploit machine learning are ascendant in many other scientific fields, because they avoid (likely unrealistic) assumptions regarding actual data generation (such as linearity). Based on reviews of econometric texts and the body of econometric research, he concludes that:

  1. Standard econometric methods achieve time series stationarity (consistency over time) by erasing time series memory (information from the path followed by data). Machine learning methods are more flexible in exploiting path information.
  2. Standard econometric methods do not address noise and bias in correlations (and betas) and hence have difficulty distinguishing between signal and noise. Cross-sectional studies are especially sensitive to disruption by outliers, activation thresholds and regime changes.
  3. Standard econometrics methods are adapted from biology, for which out-of-sample forecasting is not critical, leading to spurious claims of causation and false investment strategies.
  4. Standard econometric methods require researchers to specify both the predictive variables and the algorithm (function, or formula) that relate predictive and predicted variables. Given the complexity of financial systems, this joint requirement is unrealistic. In contrast, machine learning discovers the best algorithm for a given set of predictive variables.
  5. Standard econometric methods employ p-values at conventional levels to decide statistical significance of findings. In practice, this approach impounds considerable data snooping bias from multiple testing within and across studies, and markets adapt to new findings and depress p-values out-of-sample. Machine learning accommodates the superior Mean Decrease Accuracy method, which: a) discovers the best algorithm for a group of predictive variables in the training dataset, and estimates test dataset (out-of-sample) accuracy; b) shuffles values of one predictive variable at a time and re-estimates out-of-sample accuracy; and, c) assesses decays in out-of-sample accuracy from shuffling values of each variable.
  6. Standard econometric methods are mostly silent about repeating tests on a noisy training dataset to select among variations in an algorithm (such as parameter values). Such testing makes noise (luck) important in findings for the selected algorithm. Machine learning offers ways to suppress and quantify such overfitting.
  7. Standard econometric methods are also mostly silent about repeating tests on a noisy test dataset (out-of-sample). Again, machine learning offers ways to suppress and quantify such overfitting.

In summary, academics and investment professionals continue to use research methods ill-suited to the complexity of economies and markets, largely ignoring the superiority of new machine learning methods in these environments.

Cautions regarding conclusions include:

  • Machine learning methods are out-of-reach for many investors, who would bear fees for delegating to the (rare) fund managers who understand and use them as described.
  • Moreover, investors not taking advantage of such methods may be at material disadvantage in financial markets versus those who do.

For additional presentations related to the same graduate course, see “Investment Strategy Development Coursework”.

Frequently Asked Questions

What is econometrics and how is it used in investing?

Econometrics in investing is the application of standard statistical methods, mostly multivariate linear regressions, to economic and financial data in order to forecast markets and test investment strategies. Marcos Lopez de Prado argues these methods rely on assumptions such as linearity that are likely unrealistic for the complexity of actual financial data.

Is machine learning better than standard econometric methods for financial forecasting?

Machine learning is argued to be better than standard econometric methods for financial forecasting, according to Marcos Lopez de Prado's April 2019 Cornell course presentation. His conclusion rests on reviews of econometric texts and research, not on a direct empirical performance test. He contends machine learning exploits path information, discovers the best algorithm for a set of predictive variables, and suppresses and quantifies overfitting.

How does the Mean Decrease Accuracy method work in machine learning?

The Mean Decrease Accuracy method works in three steps. It first finds the best algorithm for a group of predictive variables in the training dataset and estimates out-of-sample accuracy on the test dataset. It then shuffles the values of one predictive variable at a time and re-estimates out-of-sample accuracy, and finally assesses how much accuracy decays from shuffling each variable. Lopez de Prado presents it as superior to relying on conventional p-values.

How do p-values compare to machine learning for judging whether an investment strategy is real?

P-values at conventional significance levels are criticized as a weaker test of an investment strategy than machine learning approaches such as Mean Decrease Accuracy. Lopez de Prado argues p-values embed considerable data snooping bias from multiple testing within and across studies, and that markets adapt to new findings and depress p-values out-of-sample. Mean Decrease Accuracy instead evaluates out-of-sample accuracy loss when each predictive variable is shuffled.

What are the drawbacks of using machine learning instead of econometrics in investing?

The main caution is that machine learning methods are out-of-reach for many investors, who would bear fees to delegate to the rare fund managers who understand and use them properly. Investors not using such methods may nonetheless be at a material disadvantage versus those who do. The article's case is also a theoretical comparison based on reviews of econometric texts and research, rather than a head-to-head performance test.

Guru Grades

1,206 predictions by 42 market gurus since 2022: 41% right. Always saying stocks will go higher: 62%.

As of the Nov 19, 2026 close

  1. 1 Ed Yardeni A 71%
  2. Always bullish B 62%
  3. 2 Jim Paulsen B 61%
  4. 3 Sam Stovall B 58%
  5. 4 Adam Turnquist B 58%
  6. 5 Ryan Detrick B 56%

Full leaderboard ›