67
Jensen Huang says even free AI chips from his competitors can't beat Nvidia's GPUs
(www.tomshardware.com)
If he says so it must be true.
this post was submitted on 11 Mar 2024
67 points (84.5% liked)
Technology
59201 readers
2829 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
"CEO of successful company: My company is the greatest"
Successful or monopolistic?
To the owners of the companies it means the same thing.
Successful. It's not monopolistic to have a superior product. Nvidia has competition, but if they're the only one making a good AI GPU then other companies need to step up their game.
https://archive.is/QkWna might disagree with you
The early-stage investigation may never result in a formal probe or penalties, the report added.
I'm free to choose any laptop I want for work. This means, that for me, the GPU and other processors are free. It turns out that I still avoid Nvidia like the plague. I don't care if it is free, if the drivers are horrible.
You should try working with their CUDA tool chains. Good. Lord.
And AMD or Intel are better? Everyone complains about the drivers.
For Linux it is a huge difference. AMD and Intel have great open source drivers, while Nvidia have binary drivers with a lot of issues.
I find this strange, because I had nothing but trouble getting my R9 390 working with any Linux distro, but my RTX 3060 hasn't given me a single issue on like 6 different distros.
Are you talking about a laptop or a desktop? If desktop, using offload or something like that?
Desktop, both Intel and AMD builds. And no, I just had multiple SSDs that I played with distros on.
Nvidia works flawlessly most of the time on desktops. The suckyness of their drivers shows its ugly head mostly on laptops.
And it's bad, crash your computer bad some times.
I guess I've been lucky with my laptop, although it is fairly old at this point.
Three laptops ago it mostly worked with FOSS solutions around the driver. Nvidia mostly killed them, and intreduced their own unstable solution. As far as I care, if they won't fix it before my hardware dies, the next laptop will have a GPU by another manufacture.
And for AI at home? Since this is a story about AI DataCenters
I want to get an AMD but the integration of Nvidia GPUs for processing ML/AI stuff is much higher. So if I want to mess with running AI at home I only have 1 choice.
I hope AMD release something that competes on that front, and can still play games on the weekend, but currently, he is right there is no competition
I run AI stuff just fine on my AMD GPU using HIP. At least LLMs and Stable Diffusion work perfectly fine but that's the only things I've tested.
All the benchmarks put the equivalent Nvidia cards almost 2x more in Stable Diffusion https://www.tomshardware.com/pc-components/gpus/stable-diffusion-benchmarks
I hope that is an old benchmark and times have changed, but I can't find anything like it that is more recent.
For a bit of my soul I get a lot more ai power.
AI works on AMD but the speed doesn't seem to be anywhere near Nvidia.
I still won't consider an AMD GPU because all 3 I've had throughout my life have had horrible driver experiences. Even the FirePro I had at work at one point required a special driver build that AMD eventually gave me to work even half decent. Never had any major issues with NVidia drivers.
I've had the opposite experience here on GNU/Linux. The AMD drivers are phenomenal.
Free?
I'll take free GPUs, where can I get some?
Right over here...just wait on that couch there, Mr. Jensen will be here shortly with your free GPU.
Hmm this couch looks familiar... anyways, I wonder how many teraflops I'll be getting
Free*
*With purchase of 3 year suport license
Intel and AMD chasing Nvidia AI GPUs.
Jensen Huang begins his response by unpacking his tiny violin. "We have more competition than anyone on the planet," claimed the CEO. He told Shoven that even Nvidia's customers are its competitors, in some cases. Also, Huang pointed out that Nvidia actively helps customers who are designing alternative AI processors and goes as far as revealing to them what upcoming Nvidia chips are on the roadmap.