this post was submitted on 01 Feb 2025
150 points (100.0% liked)
TechTakes
1590 readers
449 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
i read that that the chinese made alterations to the cards, as well-- they dismantled them to access the chips themselves and were able to do more precise micromanagement that cuda doesn't support, for instance.. basically they took the training wheels off and used a more fine-tuned and hands-on approach that gave them some serious advantages
got a source for that?
just something i read, this isn't the original source i read, but a quick search gave me: https://www.xatakaon.com/robotics-and-ai/the-secret-to-deepseeks-extreme-efficiency-is-out-it-bypasses-nvidias-cuda-standard
okay so that post’s core supposition (“using ptx instead of cuda”) is just ~~fucking wrong~~ fucking weird and I’m not going to spend time on it, but it links to this tweet which has this:
this still reads more like simply tuning allocation than outright scheduler and execution control (which your post alluded to)
[x] doubt
e: original wording because cuda still uses ptx anyway, whereas this post looks like it’s saying “they steered ptx directly”. at first I read the tweet more like “asm vs python” but it doesn’t appear to be what that part meant to convey. still doubting the core hypothesis tho
sidebar: I definitely wouldn’t be surprised if it comes to this overall being a case of “a shop optimised by tuning, and then it suddenly turns out the entire industry has never tried to tune a thing ever”
because why try hard when the money taps are open and flowing free? velocity over everything! this is the bayfucker way.
ah yes the ultimate american NOBUS - we can throw money at the problem until it disappears
it might disappear under the gigantic heap of money but gosh darn it we can KEEP HEAPING
I do sorta get the idea that this is (one of the reasons) exactly why 'ole felon is trying to get his hand on all the funding faucets
well you're always free to doubt and do your own research-- as i mentioned- it is something i read and between believing what the US tech bros are saying when all their money and hegemony is on the line vs what the chinese have given up for free-use, i am going to go out on a limb and trust the chinese. you're free to make your own decisions in this regard and kudos for having your own mind.
mine isn’t a “USA v China: Jelly Wrestling Deluxe” comment and you’re not really understanding the point
what is your point? i thought i was giving a "explain like i'm 5" answer to a guy asking for one... you came along asking me to show sources... now this?
the point is that your eli5 is unfounded rumour hearsay bullshit (and thus it’s entirely pointless to spread it), then when giving you a relatively gentle indication of that you decided to cosplay an ostrich
pro-tip: if it ain’t something you actually understand something about, probably best to avoid uncritically amplifying shit about it
so you're saying i'm wrong and i'm spreading misinfo... its somehow wrong that china got more juice out of the cards by bypassing cuda to better micromanage some aspect of the process?
according to some shit called xatakaon paraphrasing the parts of Nazi social media frequented by goofy as shit AI grifters
that was the first source i found and used it .. and anyway you found the corroborating details yourself which supported my claim..
I know you’ve already been made to fuck off but “corroborating details” looooooool
????? are goofy as shit AI grifters “corroborating details”?
thought i was talking to the other guy, didn't know i was getting tag teamed, you understand. (or you can choose not to i guess)
jesus christ you’re going to make this entire thread this exact type of tedious nonsense aren’t you? time for you to fuck off out of this thread. TechTakes isn’t the place for you and your friends to salivate over a supposedly less shitty LLM or repost horseshit from e/a Twitter
also, holy fuck their entire post history on their 5 day old account is just them doing this rapid fire tedious shit and then throwing themselves dramatically on the ground when they get called out for it. good fucking riddance
you are not tall enough for this ride, go try some candyfloss and walking the hall of mirrors instead
alpha alert
a klaxon going off for dumbasses would be a health-impacting constant noise, no thx