HedyL

joined 2 years ago
[–] HedyL@awful.systems 24 points 1 day ago (4 children)

Completely unrelated fact, but isn't the prevalence of cocaine use among U. S. adults considered to be more than 1% as well?

(Referring to this, of course - especially the last part: https://pivot-to-ai.com/2025/06/05/generative-ai-runs-on-gambling-addiction-just-one-more-prompt-bro/)

[–] HedyL@awful.systems 27 points 2 days ago

Stock markets generally love layoffs, and they appear to love AI at the moment. To be honest, I'm not sure they thought beyond that.

[–] HedyL@awful.systems 4 points 2 days ago

Yes, they will create security problems anyway, but maybe, just maybe, users won’t copy paste sensitive business documents into third party web pages?

I can see that. It becomes kind of a protection racket: Pay our subscription fees, or data breaches are going to befall you, and you will only have yourself (and your chatbot-addicted employees) to blame.

[–] HedyL@awful.systems 9 points 3 days ago

At this point it’s an even bet that they are doing this because copilot has groomed the executives into thinking it can’t do wrong.

This, or their investors (most likely both).

[–] HedyL@awful.systems 10 points 4 days ago (3 children)

reliably determining whether content (or an issue) is AI generated remains a challenge, as even human-written text can appear ‘AI-like.’

True (even if this answer sounds like something a chatbot would generate). I have come across a few human slop generators/bots in my life myself. However, making up entire titles of books or papers appears to be a specialty of AI. Humans would not normally go to this trouble, I believe. They would either steal text directly from their sources (without proper attribution) or "quote" existing works without having read them.

[–] HedyL@awful.systems 3 points 4 days ago (1 children)

So what kind of story can you tell? A movie that perhaps has a lot of dream sequences? Or a drug trip?

Maybe something like time travel, because then it might be okay if the protagonists kept changing their appearance to some degree. But even then, there wouldn't be enough consistency, I guess.

[–] HedyL@awful.systems 6 points 4 days ago* (last edited 4 days ago)

This has become a thought-terminating cliché all on its own: "They are only criticizing it because it is so much smarter than they are and they are afraid of getting replaced."

[–] HedyL@awful.systems 6 points 4 days ago (2 children)

I’ve noticed a trend where people assume other fields have problems LLMs can handle, but the actually competent experts in that field know why LLMs fail at key pieces.

I am fully aware of this. However, in my experience, it is sometimes the IT departments themselves that push these chatbots onto others in the most aggressive way. I don't know whether they found them to be useful for their own purposes (and therefore assume this must apply to everyone else as well) or whether they are just pushing LLMs because this is what management expects them to do.

[–] HedyL@awful.systems 10 points 4 days ago

First, we are providing legal advice to businesses, not individuals, which means that the questions we are dealing with tend to be even more complex and varied.

Additionally, I am a former professional writer myself (not in English, of course, but in my native language). Yet, even I find myself often using complicated language when dealing with legal issues, because matters tend to be very nuanced. "Dumbing down" something without understanding it very, very well creates a huge risk of getting it wrong.

There are, of course, people who are good at expressing legal information in a layperson's way, but these people have usually studied their topic very intensively before. If a chatbot explains something in “simple” language, their output usually contains serious errors that are very easy for experts to spot because the chatbot operates on the basis of stochastic rules and does not understand its subject at all.

[–] HedyL@awful.systems 7 points 4 days ago

Up until AI they were the people who were inept and late at adopting new technology, and now they get to feel that they’re ahead

Exactly. It is also a new technology that requires far fewer skills to use than previous new technologies. The skills are needed to critically scrutinize the output - which in this case leads to less lazy people being more reluctant to accept the technology.

On top of this, AI fans are being talked into believing that their prompting as such is a special “skill”.

[–] HedyL@awful.systems 7 points 5 days ago (2 children)

That's why I find the narrative that we should resist working with LLMs because we would then train them and enable them to replace us problematic. That would require LLMs to be capable of doing so. I don't believe in this (except in very limited domains such as professional spam). This type of AI is problematic because its abilities are completely oversold (and because it robs us of our time, wastes a lot of power and pollutes the entire internet with slop), not because it is "smart" in any meaningful way.

[–] HedyL@awful.systems 12 points 5 days ago

But if you’re not an expert, it’s more likely that everything will just sound legit.

Oh, absolutely! In my field, the answers made up by an LLM might sound even more legit than the accurate and well-researched ones written by humans. In legal matters, clumsy language is often the result of facts being complex and not wanting to make any mistakes. It is much easier to come up with elegant-sounding answers when they don't have to be true, and that is what LLMs are generally good at.

view more: next ›