Investing Expertise

What happens as more and more web-scraped training data for Large Language Models (LLM), such as ChatGPT, derives from outputs of predecessor LLMs? In their May 2023 paper entitled “The Curse of Recursion: Training on Generated Data Makes Models Forget”, Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, Yarin Gal, Nicolas Papernot and Ross Anderson investigate changes in LLM outputs as training data becomes increasingly LLM-generated. Based on simulations of this potential trend, they find that: Keep Reading

Are the latest forms of artificial intelligence (AI) better at forecasting stock market returns than humans? In his February 2023 preliminary paper entitled “Surveying Generative AI’s Economic Expectations”, Leland Bybee summarizes results of monthly and quarterly forecasts by a large language model (ChatGPT-3.5) of U.S. stock market returns and 13 economic variables based on samples of Wall Street Journal (WSJ) news articles. He uses the S&P 500 Index as a proxy for the U.S. stock market. He asks ChatGPT to provide reasons for responses. He compares accuracy of ChatGPT forecasts to those from: (1) surveys of humans, including the Survey of Professional Forecasters, the American Association of Individual Investors (AAII) and the Duke CFO Survey; and, (2) a wide range of fundamental and economic predictors tested in past research. Using monthly samples of 300 randomly selected WSJ news articles, results of human surveys and various fundamental/economic data during 1984 through 2021, he finds that:

Keep Reading

Should investors in low-cost mutual funds consider active ones? In his April 2023 paper entitled “Vanguard and Fidelity Domestic Active Stock Funds: Both Beat their Style Mimicking Vanguard Index Funds, & Vanguard Beats by More”, Edward Tower compares returns of active Vanguard and Fidelity stock mutual funds to those of style-mimicking portfolios of Vanguard index funds. He segments active funds into three groups: U.S. diversified, sector/specialty and global/international. For U.S. diversified funds, for which samples are relatively large, he regresses monthly net returns of each active fund versus monthly net returns of Vanguard index funds to construct an index fund portfolio that duplicates the active fund return pattern (style). For sector/specialty and global/international segments, for which samples are small, he instead compares active fund net returns to those for respective benchmarks. He uses Vanguard Admiral class funds when available, and Investor class funds otherwise. He applies monthly rebalancing for all fund portfolios. Using fund descriptions and monthly net returns during January 2013 through March 2023, he finds that:

Keep Reading

Are there clearly skilled and unskilled stock-picking influencers on social media platforms such as StockTwits? If so, do investor reactions to such influencers drive out the unskilled ones? In their March 2023 paper entitled “Finfluencers”, Ali Kakhbod, Seyed Kazempour. Dmitry Livdan and Norman Schuerhoff examine skillfulness, influence and survival of StockTwits tweeters who have followers. They apply four skill metrics to measure stock-picking skill levels of these influencers to identify those who are: (1) skilled (reliably good advice); (2) unskilled; and, (3) anti-skilled (reliably bad advice). They calculate future (1 to 20 days) abnormal returns for each influencer by comparing factor model-adjusted returns (alphas) of associated stock picks before and after recommendation dates. To assess skill persistence, they compare influencer skill levels in the first and second halves of the sample. Using tweet-level and follower data from StockTwits for 29,477 influencers, matched daily stock returns and daily equity factor returns during July 13, 2013 through January 1, 2017, they find that:

Keep Reading

A subscriber requested evaluation of Investment Advisory Service stock picking ability based on a sample newsletter obtained in mid-April 2023. The offerors state that they follow “a sound, buy-and-hold approach to identifying well-managed, high-quality companies” that “highlights emerging and oft-overlooked stocks with excellent growth potential and reasonable valuations.” The sample newsletter, dated January 2022, includes a December 14, 2021 list of 90 stocks apparently representing a recommended portfolio. Of these 90 stocks, 31 have buy recommendations as of that date. To assess the usefulness of the buy recommendations, we calculate total return for each from the close on December 15, 2021 to the close at the end of 2022 and compare the equal-weighted average of those returns to total returns for SPDR S&P 500 ETF Trust (SPY) and (based on the service description) Vanguard U.S. Quality Factor ETF (VFQY) over the same period. For most of the stocks, we use dividend-adjusted price data from Yahoo!Finance. Two of the stocks change name/symbol after the start of the sample period (FB–>META and INS–>CCRD). For one stock with price data no longer available at Yahoo!Finance due to a post-2022 merger (IAA), we use historical data from Barchart.com. Using the specified price data during December 15, 2021 through December 30, 2022, we find that: Keep Reading

Can advanced natural language processing models such as ChatGPT extract sentiment from firm news headlines that usefully predicts associated next-day stock returns? In their April 2023 paper entitled “Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models”, Alejandro Lopez-Lira and Yuehua Tang test the ability of ChatGPT to predict next-day returns of individual stocks via analysis of relevant article and press release headlines from RavenPack, a leading provider of news sentiment data. They pre-process the headlines to ensure unique content and high relevance to a specific firm. They next instruct ChatGPT to designate whether each headline is good, bad or irrelevant for firm stock price, as follows:

“Forget all your previous instructions. Pretend you are a financial expert. You are
a financial expert with stock recommendation experience. Answer “YES” if good
news [+1], “NO” if bad news [-1} , or “UNKNOWN” if uncertain in the first line [0]. Then
elaborate with one short and concise sentence on the next line. Is this headline
good or bad for the stock price of _company_name_ in the _term_ term?”

They then compute a ChatGPT score for each stock in the news (averaging if there is more than one headline for a firm) and relate all stock scores to stock returns lagged by one day. They further compare predictive powers of ChatGPT sentiment scores to those provided by RavenPack. Using daily returns for a broad sample of U.S. common stocks and daily news headlines from RavenPack during October 2021 (post-training period for ChatGPT) through December 2022, they find that: Keep Reading

Can expert financial advisors beat the market? ChatGPT responds: Keep Reading

Can surveys of various expert and inexpert groups usefully predict stock market returns? In their March 2023 paper entitled “How Accurate Are Survey Forecasts on the Market?”, Songrun He, Jiaen Li and Guofu Zhou assess abilities of the following three surveys to predict S&P 500 Index returns:

• The Livingston (LIV) survey of professional forecasters from industry and academia, conducted each June and December.
• The Chief Financial Officer (CFO) survey directed quarterly to about 4,500 U.S. firms.
• A combination (NX) survey that combines inputs from sources such as the UBS/Gallup survey, the Conference Board survey and the Michigan Survey of Consumers to represent the typical U.S. household.

For comparison, they also look at two other predictors, one based on a set of economic variables and the other based on aggregate short interest for U.S. stocks. Their benchmark forecast is a simple random walk tethered to the historical mean return. They test forecast accuracies statistically and gauge the economic value of each forecast based on out-of-sample certainty equivalence gain and Sharpe ratio for a portfolio that times the S&P 500 Index based on the forecast (versus buying and holding the index). Using data for the selected surveys, the set of economic variables, aggregate short interest for U.S. stocks and the S&P 500 Index as available (various start dates) through December 2020, they find that: Keep Reading

In late 2021, Kiplinger “used TipRanks data to unveil the crème de la crème, as viewed by Wall Street’s analyst community. Each stock currently earns a consensus Strong Buy rating based on opinions from analysts surveyed by TipRanks. Here are 22 of the pros’ highest-conviction stocks to invest in for 2022. As of today, these stocks are expected to produce upside of between 10% and 82% over the next 12 months – handily more than consensus S&P 500 projections.” In December 2021, Kiplinger published the list of these 22 stocks in “The Pros’ Picks: 22 Top Stocks to Invest In for 2022”:

The Charles Schwab Corporation (SCHW)
Applied Materials, Inc. (AMAT)
The Coca-Cola Company (KO)
Lowe’s Companies, Inc. (LOW)
Johnson & Johnson (JNJ)
Altria Group, Inc. (MO)
Chevron Corporation (CVX)
Alphabet Inc. (GOOG)
Laboratory Corporation of America Holdings (LH)
DuPont de Nemours, Inc. (DD)
Analog Devices, Inc. (ADI)
Suncor Energy Inc. (SU)
General Motors Company (GM)
Salesforce, Inc. (CRM)
The Beauty Health Company (SKIN)
RH (RH)
Twilio Inc. (TWLO)
JD.com, Inc. (JD)
Zynga Inc Cl A (ZNGA)
Fisker Inc. (FSR)
Sonos, Inc. (SONO)
Under Armour, Inc. (UA)

How did these picks perform? To check, we collect end-of-2021 and end-of-2022 dividend-adjusted prices for the 22 picks (except for Zynga, for which we use the price when the firm became private in May 2022) and calculate the annual total return for each. We then compare the average of these returns to the annual total return for SPDR S&P 500 ETF Trust (SPY). Using the specified annual data for 2021 and 2022, we find that:

Keep Reading

Is model complexity (large number of parameters) more an analytical benefit in predicting asset returns, or more an avenue to discover in-sample luck? In their March 2023 paper entitled “Complexity in Factor Pricing Models”, Antoine Didisheim, Shikun Ke, Bryan Kelly and Semyon Malamud examine the theoretical relationship between input complexity and output accuracy for machine learning asset pricing models. They focus on a complexity wedge, the combination of overfitting (data snooping) and limits to learning that causes in-sample performance of a trained model to exceed out-of-sample performance. They apply ridge shrinkage (controlled by a regularization parameter that sets the strength of an overfitting penalty) to suppress data snooping bias and improve the limits to learning. They assess model performance by out-of-sample Sharpe ratio and out-of-sample pricing errors of optimal portfolios. They test theoretical conclusions on a broad sample of publicly traded U.S. stocks and a set of 110 monthly stock return factors, the latter augmented by a random feature generator that expands the 110 raw factors to any desired number of derivative factors. Using monthly data for the 110 stock return predictors and monthly U.S. stock returns during February 1963 through December 2019, they find that: Keep Reading