this post was submitted on 25 Oct 2023
9 points (80.0% liked)
Hacker News
4123 readers
3 users here now
This community serves to share top posts on Hacker News with the wider fediverse.
Rules
0. Keep it legal
- Keep it civil and SFW
- Keep it safe for members of marginalised groups
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Systematic generalisation, in a nutshell, works like this:
It's an actual feature of language, and it operates on both the morphological and syntactical layers.
And IMO a good start, but not enough. As machine text generation moves away from LLMs and their "ooga booga, bash token on token" approach, eventually you'll need to deal with the fact that the morpheme (aka token) itself don't matter that much, it's just an interface for a semantic layer. And that you need that semantic layer if you want anything past "potatoes are active, oranges are passive".