the hallucinations will continue until morale improves
In addition to pushing something before it’s ready and where it’s not welcome, Apple’s own stinginess completely screwed them over.
What do LLMs need to be smart? RAM, both for their weights and holding real data to reference. What has apple relentlessly price gouged and skimped on for years? Yeah, I’ll give you one guess…
For 15 years, Apple has always lagged behind Android on implementing new features, preferring to wait until they felt their implementations were ready for mainstream consumption and it’s always worked out for them. They should have stuck to that instead of jumping on the AI bandwagon with a half baked technology that most people don’t want or need.
Unfortunately, AI is moving at such a pace that this IS the usual Apple delayed-follow. They had to feed the public hype for something like 9 months. And it doesn’t seem like a true fix for hallucination is coming, so they made their choice to move ahead. Frankly I blame Wall Street because at this point they will eviscerate anyone who doesn’t have a demonstrated AI plan and shipped products around it. If anyone is at the core of this craze, it’s investors, because they are still in the “we don’t know how big this thing is going to get” phase with AI. We’re all dealing with the consequences.
Interestingly though, I’m reminded of the early days of the Internet. People did raise the flag that the Internet wouldn’t have the same reliability as traditional media, because anyone could post anything. And that’s remained true. We have mass disinformation campaigns galore, and also specific incidents of false viral stories like “the Pope has died” which are much like this case, just driven by malicious humans instead of hallucinating software.
It makes me wonder if the problems with AI will never be truly solved but we will just digest AI and learn to live with it as we have with the internet in general. There is also a comparison in my mind between AI and self-driving cars, because every time one of those has a big fuck up we all shout and point and cry that the tech will never be trustable, meanwhile human drivers are out there killing by the hundreds of thousands annually and we don’t even blink at that anymore.
the problems with (the current forms of generative) AI will not be solved, because they cannot be solved. They are intrinsic to the whole framework.
LLMs
Emphasis on the first L in LLM. Apple’s model is specifically designed to be small to work on phones with 8 gigs of ram (the requirement to run this)
The price gouging for RAM was only ever on computers. With phones you got what got, and you couldn’t pay for more.
Yeah… and it kinda sucks because it’s small.
If Apple shipped with 16GB/24GB like some Android phones did well before the iPhone 16, it would be far more useful. 16-24GB (aka 14B-32B class models) are the current threshold where quantized LLMs really start to feel ‘smart,’ and they could’ve continue trained a great Apache 2.0 model instead of a tiny, meager one from scratch.
I don’t know how much RAM is in my iPhone 14 Pro, but I’ve never thought ooh this is slow I need more RAM.
Perhaps, it’ll be an issue with this stupid Apple Intelligence, but I don’t care about using that on my next upgrade cycle.
What do you mean couldn’t pay for more? There are plenty of sub-$200 android phones with 8GB of RAM, and 12-16GB are fairly standard on flagships these days. Asus ROG Phone 6 is rather old and already came with 16GB what, three years ago?
It is definitely doable, there only needs to be willingness. Apple is definitely skimping here.
The iPhone has one ram option. If you buy an iPhone 16 your only option is 8 gigs.
What I find surprising in the debate about AI and hallucinations is that everyone points the fact that’s it’s very dangerous and it will spread misinformation… But the problem is the inability or unwillingness to fact check our information.
Nobody wants to fact check something they saw on meta or tik tok. Nobody will. There is no difference between someone trusting some random influencer and someone trusting an AI. They are both set to fail the same way. Both lack critical thinking.
Instead of being afraid of AI and hallucinations we should be investing massively in teaching the newer generations on fact checking and critical thinking.
IA is a great assistant but only if you can fact check it. If you can’t or won’t then it’s a terrible assistant that will set you up to fail.
To be clear, I also struggle to fact check stuff and I definitely was misinformed many times in the past. Nobody is really immune to that problem. IMO IA doesn’t change much about that problem.
If you have to fact check everything it says, we’re better off as a species boiling the developers in dog shit.
“we’ve added a profoundly energy intensive feature that is wrong most of the time” okay, get in the vat.
get in the vat.
But you shouldn’t have to actively fact check every headline from the BBC because their headline doesn’t actually say what you read.
And there’s very little value to “summarizing messages” if you aren’t actually summarizing messages and the content doesn’t match the summary.
Yes, you should do more critical thinking, but lowering the quality of information of every interaction with the internet very clearly makes things worse.
What I find surprising is that so many people (i.e. you) still claim to fact check everything. You don’t. I guarantee it.
Most people don’t read news for a living. You can’t fact check everything you read online. That’s physically impossible. And if you’d be honest to yourself, 95% of headlines you read are just noise and you don’t read any further. Not because you’re too stupid, but because you’re not that interested in Trump’s latest shenanigans or Italy’s economic outlook.
You didn’t even read my entire comment…
Read it entirely and you will see that this aggressive tone wasn’t necessary or justified.
AI-generated products can be a bad fit for news
No shit. The fact they only discovered that once they’ve got burned proves they never even questioned what generative AI does.
Though I’m sure half of the blame is from them asking it to tack the most clickbaity headlines on every article they can. Even human editors all but outright lie in those, of course an AI is going to hallucinate you the best title it can.
The article doesn’t explicitly state it, but the wording implies that this headline was not created by BBC. This appears to be a service running on Apple products producing its own summary of the news article. So the BBC didn’t get burned by something they did and that’s what they’re complaining about.
Oh, well that’s different. There is no reason Apple should be editorializing their content like that.
Apple wasn’t directly creating these summaries, it was their on device AI summaries of the articles bastardizing it.
That’s the BBC criticising Apple for indiscriminately mangling all notifications with AI, like news headlines. The BBC could boycott the Apple platform, but that’s basically their only lever to stop Apple doing this besides asking nicely.
I didn’t get that from the article but then, yeah, if it’s Apple rewriting BBC headlines like that, what the hell are they thinking.
