I am thinking of deploying a RAG system to ingest all of Linus's emails, commit messages and pull request comments, and we will have a Linus chatbot.
this post was submitted on 28 Oct 2024
1493 points (98.8% liked)
Technology
58999 readers
4212 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
Hold on there Satan... let's be reasonable here.
The only time I've seen AI work well are for things like game development, mainly the upscaling of textures and filling in missing frames of older games so they can run at higher frames without being choppy. Maybe even have applications for getting more voice acting done... If the SAG and Silicon Valley can find an arrangement for that that works out well for both parties..
If not for that I'd say 10% reality was being.... incredibly favorable to the tech bros
load more comments
(2 replies)
he isn't wrong
If anything he's being a bit generous.
I play around with the paid version of chatgpt and I still don't have any practical use for it. it's just a toy at this point.
I used chatGPT to help make looking up some syntax on a niche scripting language over the weekend to speed up the time I spent working so I could get back to the weekend.
Then, yesterday, I spent time talking to a colleague who was familiar with the language to find the real syntax because chatGPT just made shit up and doesn't seem to have been accurate about any of the details I asked about.
Though it did help me realize that this whole time when I thought I was frying things, I was often actually steaming them, so I guess it balances out a bit?
I use shell_gpt with OpenAI api key so that I don't have to pay a monthly fee for their web interface which is way too expensive. I topped up my account with 5$ back in March and I still haven't use it up. It is OK for getting info about very well established info where doing a web search would be more exhausting than asking chatgpt. But every time I try something more esoteric it will make up shit, like non existent options for CLI tools
ugh hallucinating commands is such a pain
load more comments
(1 replies)
As a fervent AI enthusiast, I disagree.
...I'd say it's 97% hype and marketing.
It's crazy how much fud is flying around, and legitimately buries good open research. It's also crazy what these giant corporations are explicitly saying what they're going to do, and that anyone buys it. TSMC's allegedly calling Sam Altman a 'podcast bro' is spot on, and I'd add "manipulative vampire" to that.
Talk to any long-time resident of localllama and similar "local" AI communities who actually dig into this stuff, and you'll find immense skepticism, not the crypto-like AI bros like you find on linkedin, twitter and such and blot everything out.
For real. Being a software engineer with basic knowledge in ML, I'm just sick of companies from every industry being so desperate to cling onto the hype train they're willing to label anything with AI, even if it has little or nothing to do with it, just to boost their stock value. I would be so uncomfortable being an employee having to do this.
For sure, it seems like 90% of ai startups are nothing more than front end wrappers for a gpt instance.
load more comments
(1 replies)
load more comments
(2 replies)
load more comments
(48 replies)
Like with any new technology. Remember the blockchain hype a few years back? Give it a few years and we will have a handful of areas where it makes sense and the rest of the hype will die off.
Everyone sane probably realizes this. No one knows for sure exactly where it will succeed so a lot of money and time is being spent on a 10% chance for a huge payout in case they guessed right.
There's an area where blockchain makes sense!?!
Cryptocurrencies can be useful as currencies. Not very useful as investment though.
Git is a sort of proto-blockchain -- well, it's a ledger anyway. It is fairly useful. (Fucking opaque compared to subversion or other centralized systems that didn't have the ledger, but I digress...)
It has some application in technical writing, data transformation and querying/summarization but it is definitely being oversold.
load more comments
(1 replies)
Linus is known for his generosity.
True. 10% is very generous.
I think when the hype dies down in a few years, we'll settle into a couple of useful applications for ML/AI, and a lot will be just thrown out.
I have no idea what will be kept and what will be tossed but I'm betting there will be more tossed than kept.
AI is very useful in medical sectors, if coupled with human intervention. The very tedious works of radiologists to rule out normal imaging and its variants (which accounts for over 80% cases) can be automated with AI. Many of the common presenting symptoms can be well guided to diagnosis with some meticulous use of AI tools. Some BCI such as bioprosthosis can also be immensely benefitted with AI.
The key is its work must be monitored with clinicians. As much valuable the private information of patients is, blindly feeding everything to an AI can have disastrous consequences.
load more comments
(6 replies)
Copilot by Microsoft is completely and utterly shit but they're already putting it into new PCs. Why?
Investors are saying they'll back out if no AI in products. So tech leaders will talk talk and all deal with ai.
load more comments
(1 replies)
That's about right. I've been using LLMs to automate a lot of cruft work from my dev job daily, it's like having a knowledgeable intern who sometimes impresses you with their knowledge but need a lot of guidance.
watch out; i learned the hard way in an interview that i do this so much that i can no longer create terraform & ansible playbooks from scratch.
even a basic api call from scratch was difficult to remember and i'm sure i looked like a hack to them since they treated me as such.
In addition, there have been these studies released (not so sure how well established, so take this with a grain of salt) lately, indicating a correlation with increased perceived efficiency/productivity, but also a strongly linked decrease in actual efficiency/productivity, when using LLMs for dev work.
After some initial excitement, I’ve dialed back using them to zero, and my contributions have been on the increase. I think it just feels good to spitball, which translates to heightened sense of excitement while working. But it’s really just much faster and convenient to do the boring stuff with snippets and templates etc, if not as exciting. We’ve been doing pair programming lately with humans, and while that’s slower and less efficient too, seems to contribute towards rise in quality and less problems in code review later, while also providing the spitballing side. In a much better format, I think, too, though I guess that’s subjective.
I mean, interviews have always been hell for me (often with multiple rounds of leetcode) so there's nothing new there for me lol
load more comments
(4 replies)
I make DNNs (deep neural networks), the current trend in artificial intelligence modeling, for a living.
Much of my ancillary work consists of deflating/tempering the C-suite's hype and expectations of what "AI" solutions can solve or completely automate.
DNN algorithms can be powerful tools and muses in scientific endeavors, engineering, creativity and innovation. They aren't full replacements for the power of the human mind.
I can safely say that many, if not most, of my peers in DNN programming and data science are humble in our approach to developing these systems for deployment.
If anything, studying this field has given me an even more profound respect for the billions of years of evolution required to display the power and subtleties of intelligence as we narrowly understand it in an anthropological, neuro-scientific, and/or historical framework(s).
I had a professor in college that said when an AI problem is solved, it is no longer AI.
Computers do all sorts of things today that 30 years ago were the stuff of science fiction. Back then many of those things were considered to be in the realm of AI. Now they're just tools we use without thinking about them.
I'm sitting here using gesture typing on my phone to enter these words. The computer is analyzing my motions and predicting what words I want to type based on a statistical likelihood of what comes next from the group of possible words that my gesture could be. This would have been the realm of AI once, but now it's just the keyboard app on my phone.
load more comments
(4 replies)
Yup.
I don't know why. The people marketing it have absolutely no understanding of what they're selling.
Best part is that I get paid if it works as they expect it to and I get paid if I have to decommission or replace it. I'm not the one developing the AI that they're wasting money on, they just demanded I use it.
That's true software engineering folks. Decoupling doesn't just make it easier to program and reuse, it saves your job when you need to retire something later too.
Their goal isn't to make AI.
The goal of both the VCs and the startups is to make money. That's why.
load more comments
(2 replies)
The people marketing it have absolutely no understanding of what they're selling.
Has it ever been any different? Like, I'm not in tech, I build signs for a living, and the people selling our signs have no idea what they're selling.
load more comments
(1 replies)
Sounds about right. There are some valid and good use cases for "AI", but the majority is just buzzword marketing.
I have lots of uses for Attack Insects….
im down for arm improvements
load more comments
(1 replies)
AI as we know it does have its uses, but I would definitely agree that 90% of it is just marketing hype
load more comments
(4 replies)
view more: next ›