I think the idea is that someone buying a basic book on foraging mushrooms isn't going to know who the experts are.
They're going to google it, and they're going to find AI-generated reviews (with affiliate links!) of AI-generated foraging books.
Now, if said AI is generating foraging books more accurate than humans, that's fine by me. Until that's the case, we should be marking AI-generated books in some clear way.
From a dev point of view, there's a relevant XKCD to this. And we all know it.
But at the same time, I've been thinking a lot of what you're saying here for quite a while regarding Lemmy in particular, and the modern Fediverse as a whole. I don't think the federation mechanisms used, even the federation strategy used, is scaleable to the type of userbase needed to get what many of the users are looking for from Lemmy.
Flipside, we all know that it's going to be pulling teeth to get people onto that new platform. That's why I never pulled the trigger on writing my take on it.