The prompt is talking about give a design of a certain app, and the response seems to talk about some suggested pages. So it doesn't seem to reflect the text.

But this in general aligns with my experience coding with llm. I was trying to upgrade my eslint from 8 to 9, and ask chatgpt to convert my eslint file, and it proceed to spit out complete garbage.

I thought this would be a good task for llm because eslint config is very common and well-documented, and the transformation is very mechanical, but it just cannot do it. So I proceed to read the documents and finished the migration in a couple hour...

[–] 30p87@feddit.org 74 points 1 month ago (11 children)

I asked ChatGPT with help about bare metal 32-bit ARM (For the Pi Zero W) C/ASM, emulated in QEMU for testing, and after the third iteration of "use printf for output" -> "there's no printf with bare metal as target" -> "use solution X" -> "doesn't work" -> "ude printf for output" ... I had enough.

[–] scrubbles@poptalk.scrubbles.tech 5 points 1 month ago (1 children)

Yeah you can tell it just ratholes on trying to force one concept to work rather than realizing it's not the correct concept to begin with

[–] formulaBonk@lemm.ee 6 points 1 month ago

That’s exactly what most junior devs do when stuck. They rehash the same solution over and over and it almost seems like that llms trained on code bases infer that behavior from commit histories etc.

It almost feels like on of those “we taught him these tasks incorrectly as a joke” scenarios

load more comments (9 replies)

load more comments (30 replies)