Discussion about this post

User's avatar
ADIL SAYEED's avatar

Apologies if this is more than anyone wanted to digest about consumer sentiment.

Here’s what else I can offer about the 2024 switch in the Index of Consumer Sentiment (ICS) survey from phone-based to web-based. Based on data that I received about the differences between phone-based ICS and web-based ICS, my back-of-the-spreadsheet estimate is that based on answers from all partisan identifications overall web-based ICS is about 11% lower than phone-based ICS. This is consistent with literature on survey methods indicating that survey respondents tend to give more upbeat answers when talking to a live person on the phone vs. answering questions on a computer.

For the same reason that Dr. Sahm uses 3-month unemployment rate averages in her Sahm rule recession indicator, I like to use 3-month ICS averages to reduce the possibility of spurious volatility in monthly surveys. When I compare the 3-month ICS average over the last 3 months of the phone-based ICS survey (Jan. to March 2024) with the August-to-October 2024 3-month average when ICS was entirely web-based, there was a -11% drop in ICS. I attribute that drop in reported ICS from winter 2024 to autumn 2024 just before the election as almost entirely due to the change in survey method from phone- to web-based.

But, when I look at 3 sub-groups based on party identification, the changes over that same period are: Democrats -8%, Republicans -19%, independents -14%. Not much was going in the economic data over this period. If anything, the principal indicator of interest during the 2024 election year – annual CPI inflation – improved a bit from 3.3% average Jan.-March to 2.5% August-October.

I can think of no reason why Republican ICS would have fallen by so much during this period – no reason why Republicans should have been more disappointed than Democrats or independents that inflation was not falling fast enough and no reason why Republicans would have been more affected by the change in survey method and given more downbeat answers to the web survey than Democrats or independents.

I do recognize that looking at 2 moments in time – Jan.-March and August-October – is not enough to draw firm conclusions.

I certainly hope that UMichigan Surveys of Consumers will provide more information about the change in survey method and the possible effects.

As you can see, I am something of an ICS nerd – some might say crank.

William Coulter's avatar

Very thoughtful post. I once worked at the Center for Survey Research at Indiana University and very much appreciate this peak into the UM survey.

23 more comments...

No posts

Ready for more?