Evidence-based investing research
Value Investing Strategy (Strategy Overview)
Allocations for November 2026 (Final)
Cash TLT LQD SPY
Momentum Investing Strategy (Strategy Overview)
Allocations for November 2026 (Final)
1st ETF 2nd ETF 3rd ETF

Researcher Motives

Steve LeCompte | | Posted in: Animal Spirits, Investing Expertise

Key Insight

Harvey argues publication incentives create systematic bias toward false positive findings, linking academic promotion pressures and citation rewards to widespread data snooping (finance research; observational critique).

Do motives of financial market researchers justify strong skepticism of their findings? In his brief August 2021 paper entitled “Be Skeptical of Asset Management Research”, Campbell Harvey argues that economic incentives undermine belief in findings of both academic and practitioner financial market researchers. Based on his 35 years as an academic, advisor to asset management companies and editor of a top finance journal, he concludes that:

  • Given widespread experience that true risk-adjusted outperformance (alpha) is very rare, how can 90% of articles published in finance journals report evidence in support of such outperformance?
    • Academic researchers have powerful incentives (promotion and tenure) to produce papers that attract citations. Positive findings garner far more citations than null results.
    • Researchers often resort to exhaustive, undisciplined data snooping to obtain positive findings. For example, they may:
      • Consider many variables and cherry pick the best.
      • Consider different sample start dates and pick the one with the best result.
      • Exclude disruptive outliers such as the 2008 global financial crisis or the 2020 COVID-19 crash.
      • Transform variables (as when using logarithmic values or applying volatility scaling) to improve fit.
      • Consider different fitting methodologies (such as weighted least squares rather than simple regression) to boost significance.
    • Although statistical methods to correct for data mining exist, researchers rarely use them.
    • It is practically impossible for editors, peer reviewers and investors to detect/quantify data snooping in submitted papers.
  • The data snooping problem is somewhat less severe among practitioners because asset managers who overfit their backtests tend to: (1) underperform in live trading and thus generate no performance fees; and, (2) lose investors and incur reputational damage. Even so, there is a lot of low-quality practitioner research aimed at inattentive investors.
  • Investors should therefore:
    • Be very skeptical of both academic and practitioner research findings.
    • Take the research culture into account (ask about data snooping).
    • Try to quantify the costs of selecting bad research versus good research.
    • Question each strategy’s economic foundation, with extra skepticism for supporting stories concocted post-discovery.
    • Ask about what did not work, with extra suspicion for failures not previously reported (a newly seen cockroach probably means many unseen).

In summary, strong motives among financial market researchers to publish positive findings should make investors skeptical of all of it.

As noted in the paper, this conclusion applies to fields other than finance.

Frequently Asked Questions

What is data snooping in financial research?

Data snooping in financial research is the exhaustive, undisciplined searching of data to obtain positive findings. Examples include testing many variables and cherry-picking the best, choosing the sample start date with the best result, excluding disruptive outliers such as the 2008 financial crisis or 2020 COVID-19 crash, transforming variables to improve fit, and trying different fitting methods to boost significance.

Can investors trust published asset management research findings?

Investors should be very skeptical of published asset management research, both academic and practitioner, according to Campbell Harvey's August 2021 paper. Harvey notes that roughly 90% of articles in finance journals report evidence of risk-adjusted outperformance (alpha) even though true alpha is very rare. Strong incentives to publish positive findings drive this gap, and the conclusion applies to fields beyond finance.

Why do academic incentives lead finance researchers to report false positive results?

Academic incentives lead finance researchers to report false positives because promotion and tenure depend on producing papers that attract citations, and positive findings garner far more citations than null results. Researchers therefore often resort to data snooping to obtain positive results. Statistical corrections for data mining exist but are rarely used, and editors, peer reviewers and investors can hardly detect or quantify snooping in submitted papers.

Is practitioner investment research more reliable than academic research?

Practitioner research is somewhat less affected by data snooping than academic research, but it is not reliably trustworthy. Asset managers who overfit backtests tend to underperform in live trading, earning no performance fees, and to lose investors and suffer reputational damage. Even so, Harvey notes there is a lot of low-quality practitioner research aimed at inattentive investors.

How can investors screen out unreliable investment strategy research?

Investors can screen unreliable strategy research by asking about the research culture and data snooping, trying to quantify the costs of selecting bad versus good research, and questioning each strategy's economic foundation. They should be extra skeptical of supporting stories concocted after a discovery. They should also ask what did not work, with added suspicion of previously unreported failures, since a newly seen cockroach probably means many unseen.

Guru Grades

1,206 predictions by 42 market gurus since 2022: 41% right. Always saying stocks will go higher: 62%.

As of the Nov 19, 2026 close

  1. 1 Ed Yardeni A 71%
  2. Always bullish B 62%
  3. 2 Jim Paulsen B 61%
  4. 3 Sam Stovall B 58%
  5. 4 Adam Turnquist B 58%
  6. 5 Ryan Detrick B 56%

Full leaderboard ›