First of all it doesn't matter whether you think that AI can replace human workers. It only matter whether company think that AI can replace human workers.

Secondly, you're assuming that humans typically understand the question at stake. You've clearly never met, or been, an under-paid, over-worked employee who doesn't give a flying fuck about the daily bullshit.

Yeah, they aren't trained to make "correct" responses, but reasonably looking responses; they aren't truth systems. However, I'm not sure what a truth system would even look like. At a certain point truth/fact become subjective, meaning that we probably have a fundamental problem with how we think about and evaluate these systems.

I mean, it's the whole reason programming languages were created, natural language is ambiguous.

If there are 800 sentences/whatever chunk of information it uses about what color a ball is, using the average can result in that sentence using red when it should be blue based on the current question or it could add information about balls that are a different type because it doesn't understand what kind of ball it is talking about. It might be randomness, it might be using an average, or a combination of both.

Like if asked about 'what color is a basketball' and the training set includes a it of custom color combinations by each team it might return a combination of colors that doesn't match a team like brown (default leather) and yellow. This could also be the answer if you asked for an example of a basketball that matched team colors, because it might keep the default color from a ball that just has a team logo.

If someone doesn't know the training set it would probably look like it made something ip. To someone who knows it is impossible to tell of it is random, due to a lack of knowing what it is talking about, or if it had some other less obvious connection that combines the two which lead to yellow and brown result.

Quantum computers are inherently unreliable, but you can perform the same calculation multiple times and average the result / discard the outliers and it will still be faster than a classical computer.

That works for pattern matching, but you don't want to do that for doing accurate calculations. There is no reason to average the AI run calculation of 12345 x 54321 because that can be done with a tiny calculator with a solar cell the size of a pencil eraser. Doing calculations like that multiple times adds up fast and will always be less reliable than just doing it right in the first place. Same with reporting historical facts.

There is a vslidation step that AI doesn't do. If you feed it 1000 posts from unreliable sources like reddit or don't add even more context about whether the 'fact' is a joke, baseless rumor, or from a reliable source you get the current AI.

Yes, doing multiple calculations efficently and taking averages has a lot of uses, mainly in complex systems where this provides opportunities to test chaotic systems with wildly different starting states. There are a ton of great uses for AI!

But the AI that is being forced down our throats is worse than wikipedia because it averages content from ALL of reddit, facebook, and other massive sites where crackpots are given the same weight as informed individuals and there are no guardrails.

In latter classes our teachers just told us to not blindly believe what we read on Wikipedia but cross-reference that with other sources like public newspaper or (as you said) books.