The Gap Between BookScan and Gut Feeling

7:07 a.m., the tea bag is still steeping, and I already have my phone in my hand. Reflex, not necessity. The LinkedIn feed fills with its usual noise: someone celebrating a work anniversary, someone quoting an executive, someone who has survived another conference. Then my thumb stops on a post by Edward Nawotka, Senior Editor at Publishers Weekly. He’s writing about David Walter. For seventeen years, the man worked for Nielsen, NPD Group, and most recently Circana, latterly as Executive Director of Client Development, serving more than two hundred publishers and working with the BookScan figures that map the American book market in near real time. In May he resigned and founded his own company, „bookinsights.ai.“ The first product is called „Consumer Compass“ — a survey of five thousand American book buyers, with initial results expected in early November. Walter himself calls it the first truly comprehensive study of the American book buyer in nearly a decade, meaning before Covid, before BookTok, before Colleen Hoover, before the dark romantasy wave. My first reaction: respect. My second, more questioning reaction comes a few moments later.

When was the last German study that didn’t just count book buyers but asked about their social milieu and motivations? „Book Buyers and Readers: Profiles, Motivations, Attitudes,“ produced by the SINUS Institute and GfK on behalf of the Börsenverein, built on a panel of twenty-five thousand people. Eleven years ago. Twenty-five thousand — that’s five times the size of Walter’s sample. On paper, then, the German book trade is the better-measured one, at least when it comes to this one comparable study of milieu and motivation. Except that it is now older than any child who today discovers a book through BookTok. It has no knowledge of TikTok, of romantasy, of a pandemic, of a single language model. It knows a world that no longer exists.

In the intervening years there have been supplements: the Börsenverein study „Book Buyers, Quo Vadis?“, qualitative in nature, using focus groups to examine twenty- to forty-nine-year-olds who have drifted away — why they read and buy less. A YouGov panel of twenty thousand people measuring the e-book market every six months. That is not nothing, but it is scattered, mostly locked behind membership access, and it answers precisely none of the questions that will matter in 2026: how a book gets discovered, and what readers expect from an AI when they go looking for one.

This is exactly the kind of data landscape Walter describes for the United States when he talks about the gaps that publishers flagged to him over seventeen years: what passes over the counter and can be squeezed into charts is well documented. Everything in between is poorly understood. Small and independent publishers selling ten thousand copies and appearing in no analysis. Digital audio. The library market. Closing precisely that gap is what „Consumer Compass“ aims to do, with questions no existing dataset can answer: how genre fans encounter a book through social media and every conceivable retail channel, how print, e-book and audio usage blend together, what teenagers are reading while their parents are surveyed alongside them, what book buyers ask an AI when searching for their next read, and how they feel about AI-generated texts. Questions that nobody could have asked in 2015, because the answers simply didn’t exist yet.

This is where it gets personally interesting for me, not just professionally. I am currently writing a book about health marketing on the German internet; I talk to publishers; I run workshops on how to analyse manuscripts with AI assistance — and in every second conversation I run into the same striking problem: nobody can give me solid numbers on who in Germany actually buys a book labelled „AI-free,“ or whether that is a selling point or the niche concern of a very vocal minority. We debate with complete seriousness about labelling, copyright and the reading habits of Generation Z, and the last comparable study of milieu and motivation is eleven years old and had never encountered the word „prompt.“ Everything more recent is scattered across panels that don’t even pose that question.

The truly interesting difference between the two markets, however, lies not only in currency. It lies in their nature. German research is institutional, thorough, methodologically clean — and for exactly those reasons slow, and usually locked behind a membership. Walter’s approach is the opposite: a single former insider, a lean product, a public interview in Publishers Weekly, results within a few months. Smaller sample, more speed, more visibility. That is not necessarily the better method. It is the more timely one.

Whether something similar could emerge for the German market — a lean, independent, AI-aware complement to the Börsenverein and GfK — I don’t know. What I do know is that the demand is already there: at every publisher that asks me how their readers actually find their way to the next book, and in myself, every time I write about the book market and notice how much of it rests on guesswork.

The tea is out of the bag by now.

This English version was created with the help of AI (translated from the German original) and may differ slightly from a professional human translation.