Evidence-based investing research
Login Join
Value Investing Strategy (Strategy Overview)
Allocations for March 2026 (Final)
Cash TLT LQD SPY
Momentum Investing Strategy (Strategy Overview)
Allocations for March 2026 (Final)
1st ETF 2nd ETF 3rd ETF

Innumeracy and Look-ahead Bias in LLMs?

Steve LeCompte | | Posted in: Investing Expertise

Recent research in accounting and finance finds that large language models (LLM) beat humans on a variety of related tasks, but the black box nature of LLMs obscures why. Is LLM outperformance real? In his December 2024 paper entitled "Caution Ahead: Numerical Reasoning and Look-ahead Bias in AI Models", Bradford Levy conducts a series of experiments to open the LLM black box and determine why LLMs appear to perform so well on accounting and finance-related tasks. He focuses on numerical reasoning and look-ahead bias. Based on results of these experiments, he finds that:

Subscribe to Keep Reading

Get the research edge serious investors rely on.

  • 1,200+ research articles
  • Monthly strategy signals
  • 20+ years of backtested analysis
$17.99 /month

Cancel anytime

Subscribe Now

Further Reading

Animal Spirits, Investing Expertise AIs Only Human? Having been trained by humans on human information, do Large Language Models (LLM) behave like human investors? In... Investing Expertise Realistic Machine Learning Stock Portfolio Performance Prior research suggests that machine learning factor models of the cross section of stock returns greatly enhance portfolio... Investing Expertise LLMs Making Finance Articles Less Readable? How is the growing use of large language models (LLM) in production of academic papers in finance affecting... Investing Expertise Unforgettable Can large language models (LLM) be trusted for economic/financial forecasts during periods within their training data? In their... Investing Expertise, Miscellaneous Mitigating Look-ahead Bias in Forecasting with LLMs How can researchers ensure that large language models (LLM), when tasked with time series forecasting, do not inject... Investing Expertise AIs for Robust Investment Analysis? Can investors rely upon general-purpose Artificial Intelligence (AI) to tackle the complex data science problems of investment analysis?...