Comment by the_mitsuhiko

Comment by the_mitsuhiko 2 days ago

41 replies

From the outside looking in it really feels like Apple focused so much on privacy and now has no strategy of how to make that work with AI right now.

People increasingly seem to forgo the idea of retaining the data for themselves because they find AI products so fascinating / useful that they're just not caring, at least for the moment. I think this might swing back in the favor of Apple at one point, but right now it is kind of fascinating how liberally people throw everything at hosted AI models.

npunt 2 days ago

Was the failure really driven by privacy policy? Long term a privacy play is the right move. But right now, Siri's capabilities even underwhelm vis-a-vis a model with no understanding of user context that is just interpreting commands.

  • drob518 2 days ago

    Agreed. I often have to verbally battle with Siri to do the most basic interaction. Siri recognizes all my words but misinterprets my intent and does something I didn’t want.

    • atonse 2 days ago

      Yeah and the fact that this basically hasn’t improved in a decade tells me that it’s likely that nobody actually works on Siri.

      Not to mention the iOS keyboard has gotten so bad in the last year that it took me 3x longer to type this comment (I use the swipe keyboard). I had to fix at least a dozen typos.

      Every now and then when they screw up, they’ll have a mea culpa with the press. They haven’t done that with Siri or the keyboard yet.

    • tempoponet 2 days ago

      The new Alexa uses Claude under the hood, and it also misinterprets my intent, only with a 2 second longer delay and slightly more approachable tone.

  • eitland a day ago

    My understanding is they are just stubborn. They once did it this way and now it is "the Apple way".

    Recent example: Apple used to hide "search in page" in the share menu in mobile safari. Far from obvious, but at some point one discovers it because there is no other place to look for it.

    Now they have finally decided to make a standard fly dropping overflow menu and hide the share button there. But interestingly you still need to open the share menu from there to find the search button.

    Meanwhile other buttons that weren't as obviously misplaced in "share" like "Add to Bookmarks" are now on the top level together with the share button.

    Same goes for the arguments against things like cut and paste in finder: they didn't create it back in the day and now there is a complete mythology about why cut and paste in Finder would actually be stupid and almost evil.

    • swores a day ago

      FYI, an easier way to search in pages in Safari is to just type what you want to search for in the address bar, and then at the bottom of the list of suggestions (you may need to scroll it down) you can tap "On this page".

      • eitland 6 hours ago

        After 7 years I learned. Thank you!

        How did you learn this hack?

        • swores 2 hours ago

          Glad to have helped!

          I just noticed it randomly many years ago, I don't remember the occasion but I guess I was scrolling trying to find a page in history lazily and noticed it at the bottom.

          It's an example that sums up feature discoverability (well, lack of) on iPhones - there are so many things like this, that are really useful to know if you find out about them but the only way to find out is luck or having a friend tell you. Occasionally the official Apple "Tips" app has useful stuff, but not much.

          I actually have a thing in my family Signal chat of every few weeks sharing a new random iPhone tip, as I'm by far the nerdiest in the group. Maybe I should collate them all into a "hard to discover Tips" blog and share on HN...

  • shagie 2 days ago

    It was driven by privacy and on device compute.

    Anything you ask an Android device to do, or an Alexa device goes to their clouds to be 100% processed there.

    Apple tried to make a small and focused interface that could do a limited set of things on device without going to the cloud to do it.

    This was built around the idea of "Intents" and it only did the standard intents... and app developers were supposed to register and link into them.

    https://developer.apple.com/documentation/intents

    Some of the things didn't really get fleshed out, some are "oh, that's something in there?" (Restaurant reservations? Ride Booking?) and feels more like the half baked mysql interfaces in php.

    However, as part of privacy - you can create a note (and dictate it) without a data connection with Siri. Your "start workout" command doesn't leave your device.

    Part of that is privacy. Part of that is that Apple was trying to minimize its cloud spend (on GCP or AWS) by keeping as much of that activity on device. It wasn't entirely on device, but a lot more of it is than what Android is... and Alexa is a speaker and microphone hooked up to AWS.

    This was ok, kind of meh, but ok pre-ChatGPT. With ChatGPT the expectations changed and the architecture that Apple had was not something that could pivot to meeting those expectations.

    https://en.wikipedia.org/wiki/Apple_Intelligence

    > Apple first implemented artificial intelligence features in its products with the release of Siri in the iPhone 4S in 2011.

    > ...

    > The rapid development of generative artificial intelligence and the release of ChatGPT in late 2022 reportedly blindsided Apple executives and forced the company to refocus its efforts on AI.

    ChatGPT was as much a blindside to Apple as the iPhone was to Blackberry.

    • npunt 2 days ago

      I think all of these are true:

      1. Apple is big enough that it needs to take care of edge cases like offline & limited cell reception, which affect millions in any given moment.

      2. Launching a major UI feature (Siri) that people will come to rely on requires offline operation for common operations like basic device operations and dictation. Major UI features shouldn't cease to function when they enter bad reception zones.

      3. Apple builds devices with great CPUs, which allows them to pursue a strategy of using edge compute to reduce spend.

      4. A consequence of building products with good offline support is they are more private.

      5. Apple didn't even build a full set of intents for most of their apps, hence 'remind me at this location' doesn't even work. App developers haven't either, because ...

      6. Siri (both the local version and remote service) isn't very good, and regularly misunderstands or fails at basic comprehension tasks that do not even require user data to be understood or relayed back to devices to execute.

      I don't buy that privacy is somehow an impediment to #5 or #6. It's only an issue when user data is involved, and Apple has been investing in techs like differential privacy to get around these limitations to some extent. But that is further downstream from #5 and #6 though.

      • bombcar a day ago

        Dragon Naturally Speaking was way more accurate than Siri is now, and it was on-device on ancient computers.

        I don't care if I have to carefully say "bibbidy bobbity boo, set an alarm for two" - I just need it to be reliable.

  • eurekin 2 days ago

    Yeah, I'm not buying that either/or framing too

  • threatofrain a day ago

    Siri could've done better but Apple is definitely taking big risks with their privacy play. They might just corner themselves.

consumer451 2 days ago

> From the outside looking in it really feels like Apple focused so much on privacy and now has no strategy of how to make that work with AI right now.

Are you referring to https://security.apple.com/com/blog/private-cloud-compute/?

The only way that AI will ever be able to replace each of us, is if it gathers our entire audio, text, etc history. PCC seemed like the only viable option for a pro-AI, yet pro-privacy person such as myself. I thought PCC was one of the most thoughtful things I had every seen a FAANG create. Seriously, whoever pushed that should get some kind of medal.

Are you saying that there is no technical solution for privacy and AI to coexist? Not only that, but that was the blocker?

I am genuinely interested if anyone can provide a technical answer.

  • xvector 2 days ago

    They are solving for privacy before solving for the UX.

    They should actually make something useful first, and then work backwards to making it private before releasing it.

    • npunt 2 days ago

      With 1B+ users Apple isn't in the position to do the typical startup fast & loose order of operations. Apple has (rightly) given themselves the responsibility to protect people's privacy, and a lot of people rely on that. It'd be a really bad look if it turned out they made Siri really really useful but then hostile govt's all got access to the data and cracked down on a bunch of vulnerable people.

    • astafrig 2 days ago

      Making privacy some end-goal that PMs cut to meet targets is how you end up with Google redefining privacy to mean "only we have access to every aspect of your life, now and in the future".

      If Apple takes the position that the UX has to fit in around the privacy requirements, so what? Privacy is a core pillar of their product identity—a built-in hallucinating compliments machine isn't.

      • disgruntledphd2 20 hours ago

        To be fair, Google have always treated privacy that way, long before they used any of that data.

sethops1 2 days ago

If total invasion of privacy is the only way to make AI useful, then maybe it isn't useful?

  • satvikpendem 2 days ago

    Don't invert the argument, something can be enormously useful while also having an equally big effect on one's privacy.

  • djohnston 2 days ago

    You'd have to expand on that because I don't see why one is related to the other. People get value out of giving their data to OpenAI. They don't care. So what?

snowwrestler a day ago

Focusing on privacy was obviously the right strategic move for Apple. People complain about Siri, but they still buy iPhones in huge volumes. And a huge part of that is the belief that it’s safe to use iPhones for private things.

In terms of actually building a profitable business, no one seems to know how to make that work with AI right now. Leaks suggest OpenAI may turn to ads to monetize ChatGPT… which will raise all sorts of data questions. Privacy concerns might yet be an issue with AI chatbots.

syntaxing 2 days ago

I find it hard to believe privacy is the issue. Chinese companies have no issue releasing great self hostable models (and some admittedly nearly impossible to self host due to the sheer size)

  • barkerja 2 days ago

    China does not care about personal privacy, they only care about privacy beyond their political boundaries.

    If you've never been to China, you need to look no further than the streets to understand this (cameras everywhere, social credit system, etc.)

kace91 2 days ago

If there's a company who could ever afford to be late to the party is apple though.

Not the first to bring mp3 players to the market, nor phones, nor tablets. Market leader every time.

They could have just stayed in a corner talking about privacy, offer a solid experience while everything else drowns in slop, researched UX for llms and come 5 years later with a killer product.

I don't get why they went for the rush. It's not like AI is killing their hardware sales either.

  • jacobgkau 2 days ago

    That's a great point and an easy way to visualize it as an outsider, but it's not necessarily that simple.

    For one thing, the iPad (market-leading tablet) and the iPhone (market-leading pocket touchscreen device) were not their first attempt at doing that. That would be the Newton, which was an actual launched product and a commercial failure.

    For another thing, even Apple can't just become the market leader by doing nothing. They need to enter late with a good product, and having a good product takes R&D, which takes time. With MP3 players, smartphones, and tablets, they didn't exactly wait until the industry was burnt through before they came in with their offering; they were just later (with the successful product) than some other people who did it worse. They were still doing R&D during those years when they were "waiting."

    Apple could still "show up late" to AI in a few more years or a decade, using their current toe-dipping to inform something better, and it would still fit into the picture you have of how they "should've done it." Not to mention, Apple's also lost its way before with things like convoluted product lines (a dozen models of everything) and experimental products (the Newton then, Apple Vision now); messing up for a while also isn't exactly bucking history.

    • kace91 2 days ago

      I see your point, but I see nothing to indicate they’re doing the “polish and wait”. No reason to believe they’re cooking behind the scenes or that this product was a learning exercise for them.

      Most of their current products seem to be decaying in the dead march towards the next yearly release. ux and ui are becoming more and more poorly thought (see their last design language). They half pursue ideas and don’t manage to deliver (vr, apple car, etc).

      I see cargo culting and fad chasing like any average leadership, only with a fatter stack of cash supporting the endeavour.

      • raw_anon_1111 a day ago

        We basically know what they are cooking behind the scenes - to write a $1 Billion check to Google for a custom Gemini model

  • benoau 2 days ago

    Because today they're racing against regulators for the privilege of setting their own service as the preinstalled, exclusive, default with APIs only they are allowed to use.

    They already lost this superpower in the EU and I think Japan, India, Brazil too. Early next year they've got their US antitrust trial, and later in the year are some class actions challenging their control over app distribution, and at least two pieces of draft legislation are circulating that would require allowing competing apps to be defaults.

    If they need another two years they might face an entrenched and perhaps even better competitor, while their own app needs to be downloaded from the App Store.

JumpCrisscross 2 days ago

> it really feels like Apple focused so much on privacy and now has no strategy of how to make that work with AI right now

I see Apple dusting off its OG playbook.

We're in the minicomputing era of AI. If scaling continues to bear fruit, we'll stay there for some time. Potentially indefinitely. If, however, scaling plateaus, miniaturisation retakes precedence. At that point, Apple's hardware (and Google's mindshare) incumbency gains precedence.

In the meantime, Apple builds devices and writes the OS that commands how the richest consumers on Earth store and transmit their data. That gives them a default seat at every AI table, whether they bother to show up or not.

fidotron 2 days ago

Yes, I think the question here is not so much why the old is leaving, but if anyone seriously expects the new guy to succeed any more? ex-Microsoft too, not exactly a great start.

What does seem slightly odd is Apple have probably saved billions by failing to be dragged into the current model war.

  • drob518 2 days ago

    I agree that not falling for the hype and rushing in may have just saved them. Apple is typically not a first mover. They often hang back, rethink the problem, and deliver something really nice. But not in this case. They had Siri first and then squandered their lead, but may have avoided a huge write-down as a result.

    • bibimsz 2 days ago

      it's still early days. plenty of time to win with AI.

andrewmutz 2 days ago

People only want privacy if it doesn’t come at the cost of a good product. It’s not enough on its own.

LtWorf 2 days ago

I think the only department involved in privacy at apple is the marketing department. Nobody else has worked in anything related.

racl101 2 days ago

It could benefit them if they remained an AI free or a NOT AI first alternative once enshitification has really taken hold with AI.

ares623 2 days ago

I personally hope Apple doesn’t get too involved in the madness. If the sentiment changes they’ll be in a great position messaging wise. Microsoft and Google have thrown their reputations away.

isodev 2 days ago

> Apple focused so much on privacy

Apple also doesn't have actual privacy since their focus was using the word strategically against their competitors, not actually protecting user data.

> Subramanya, who Apple describes as a "renowned AI researcher," spent 16 years at Google, where he was head of engineering for Gemini. He left Google earlier this year for Microsoft. In a press release, Apple said that Subramanya will report to Craig Federighi and will "be leading critical areas, including Apple Foundation Models, ML research, and AI Safety and Evaluation."

I don't see how Google + Copilot mindset even touches on privacy. I wouldn't be surprised if we users will be forced to pay even more personal data in the near future.