Big Ideas

Why are expert economic and financial (econometric) forecasters so inaccurate? In his April 2019 presentation package for a graduate course at Cornell entitled “The 7 Reasons Most Econometric Investments Fail”, Marcos Lopez de Prado enumerates shortcomings of standard econometric statistical methods, which concentrate on multivariate linear regressions. In contrast, advanced computational methods that exploit machine learning are ascendant in many other scientific fields, because they avoid (likely unrealistic) assumptions regarding actual data generation (such as linearity). Based on reviews of econometric texts and the body of econometric research, he concludes that: Keep Reading

Does crowding of factor investing strategies reliably predict returns for those strategies? In his March 2019 paper entitled “The Impact of Crowding in Alternative Risk Premia Investing”, Nick Baltas explores mechanics of alternative risk (factor) premium crowding and implications of crowding for future performance. He classifies factor premiums as: divergent (such as momentum), inherently destabilizing due to positive feedback loops and lack of fundamental anchors; or, convergent (such as value), having self-correcting negative feedback loops and fundamental anchors. To test crowding effects, he considers the following premiums: equity value (book-to-market), size (market capitalization), momentum (from regression of return from 12 months ago to one month ago versus volatility), quality (return on assets) and low beta (versus the MSCI World Index); commodities momentum (12-month return); and, currencies value (purchasing power parity) and momentum (12-month return). Each premium consists of returns from a hedge portfolio that is each week long (short) the equal-weighted assets with the highest (lowest) expected returns. For equities, he uses top and bottom tenths. For commodities and currencies, he uses top and bottom thirds. His crowding metric (CoMetric) is average pairwise correlation of factor-adjusted returns of assets within the long or short sides of premium portfolios over the last 52 weeks (except 260 weeks for value). He defines the 20% of weeks with the highest (lowest) CoMetrics as most (least) crowded. Using the specified factor and return data for liquid developed market stocks since September 2004, 24 constituents of the S&P GSCI Commodity Index since January 1999, and 26 developed and emerging markets currency pairs versus the U.S. dollar since January 2000, all through May 2018, he finds that:

Keep Reading

What are common cautions regarding exploitation of academic and practitioner papers on financial markets? To investigate, we collect, collate and summarize our cautions on findings from papers reviewed over the past year. These papers are survivors of screening for relevance to investors of a much larger number of papers, mostly from the Financial Economics Network (FEN) Subject Matter eJournals and Journal of Economic Literature (JEL) Code G1 sections of the Social Sciences Research Network (SSRN). Based on review of cautions in 109 summaries of papers relevant to investors posted during mid-March 2018 through mid-March 2019, we conclude that: Keep Reading

Should investors trust academic equity factor research? In their February 2019 paper entitled “A Census of the Factor Zoo”, Campbell Harvey and Yan Liu announce a comprehensive database of hundreds of equity factors from top academic journals and working papers through January 2019, including a link to citation and download information. They distinguish among six types of common factors and five types of firm characteristic-based factors. They also explore incentives for factor discovery and reasons why many factors are lucky findings that exaggerate expectations and disappoint in live trading. Finally, they announce a project that allows researchers to add published and working papers to the database. Based on their census of published factors and analysis of implications, they conclude that: Keep Reading

How does investor competitiveness (a goal of relative rather than absolute wealth) affect optimal allocations? In their February 2019 paper entitled “The Growth of Relative Wealth and the Kelly Criterion”, Andrew Lo, Allen Orr and Ruixun Zhang compare optimal portfolios for maximizing relative wealth versus absolute wealth at both short and long investment horizons. They define an individual’s relative wealth as fraction held of total wealth of all investors. Their model assumes that investors allocate to two assets, one risky and one riskless. They identify when an investor should allocate according to the Kelly criterion (series of allocations that maximize terminal wealth over the long run) and when the investor should deviate from it. Based on derivations and modeling, they conclude that:

Keep Reading

How should investors feel about factor/multi-factor investing? In their February 2019 paper entitled “Alice’s Adventures in Factorland: Three Blunders That Plague Factor Investing”, Robert Arnott, Campbell Harvey, Vitali Kalesnik and Juhani Linnainmaa explore three critical failures of U.S. equity factor investing:

1. Returns are far short of expectations due to overfitting and/or trade crowding.
2. Drawdowns far exceed expectations.
3. Diversification of factors occasionally disappears when correlations soar.

They focus on 15 factors most closely followed by investors: the market factor; a set of six factors from widely used academic multi-factor models (size, value, operating profitability, investment, momentum and low beta); and, a set of eight other popular factors (idiosyncratic volatility, short-term reversal, illiquidity, accruals, cash flow-to-price, earnings-to-price, long-term reversal and net share issuance). For some analyses they employ a broader set of 46 factors. They consider both long-term (July 1963-June 2018) and short-term (July 2003-June 2018) factor performances. Using returns for the specified factors during July 1963 through June 2018, they conclude that:

Keep Reading

Might purveyors of trading strategies be presenting performance results biased by stopping them when falsely successful? In other words, might they be choosing lucky closing conditions for reported positions? In the December 2018 revision of their paper entitled “p-Hacking and False Discovery in A/B Testing”, Ron Berman, Leonid Pekelis, Aisling Scott and Christophe Van den Bulte investigate whether online A/B experimenters bias results by stopping monitored commercial (marketing) experiments based on latest p-value. They hypothesize that such a practice may exist due to: (1) poor training in statistics; (2) self-deception motivated by desire for success; or, (3) deliberate deception for selling purposes. They employ regression discontinuity analysis to estimate whether reaching a particular p-value causes experimenters to end their tests. Using data from 2,101 online A/B experiments with daily tracking of results during 2014, they find that:

Keep Reading

Is it possible that all the 300+ published factors that predict stock returns (such as size, value, profitability, investment, momentum…) derive from data snooping? In his October 2018 paper entitled “The Limits of Data Mining: A Thought Experiment”, Andrew Chen estimates how much data snooping would be required to “discover” all these factors by pure luck. Specifically, he calibrates a pure luck model built on the assumption that the probability of publishing a factor discovery increases with the degree to which the discovery is convincing (t-statistic). Using this model, he estimates the number of unpublished factor studies required for the published set to be attributable to pure luck. He considers two sets of factor t-statistics: 156 from factor replications via equal-weighted long-short extreme fifths (quintiles) of factor stock sorts; and, a hand-collected set of 316 from published factor studies. Using the specified approach and these two sets of t-statistics, he finds that: Keep Reading

How should researchers applying machine learning to quantitative finance address the field’s data limitations, which exacerbate data snooping bias? In their October 2018 paper entitled “A Backtesting Protocol in the Era of Machine Learning”, Robert Arnott, Campbell Harvey and Harry Markowitz take a step back and re-examine financial markets research methods, with focus on suppressing backtest overfitting of investment strategies. They introduce a research protocol recognizing that self-deception is easy. Their goal is that the protocol offers the best way to match or beat expectations in live trading. Based on logic and their collective experience, they conclude that: Keep Reading

How have costs of U.S. stock trading data evolved in recent years? In his October 2018 paper entitled “Retail Investors Get a Sweet Deal: The Cost of a SIP of Stock Market Data”, James Angel examines costs of U.S. stock market data. He also describes the production of these data and their consolidation/distribution via Securities Information Processors (SIP). Using data for U.S. trading costs as far back as 1987, he finds that:

Keep Reading