I hope it will be optional. This is too much to ask for on Apple platform. I recently had to install a 3rd party script to get rid of Apple's laregely useless AI stuff from my 5 year old mac and save more than a few GBs which I badly needed.
Running local models is already extremely easy.
I have a suspicion this app will be a way to add a too many gigabytes to the mac and of course like the Chess.app there will be no way to get rid of it. There are excellent cli apps/GUI apps like this https://github.com/ddalcu/mlx-serve - they are both cli and gui – and even its gui surprisingly nimble (I use this, but I am not related to the project). I am yet to try this https://github.com/ggml-org/Llama-macOS but I've seen only good reviews of it.
I also do not think Apple is doing it for the users who won't explore around. I can't wait to get off this operating system. Next time a friend travels to the continent I will explore getting a Framework laptop via them.
Their customer base includes many non-tech people who don’t want open a terminal window or even know of what a “GitHub” is. And they probably would not trust it as much as an app build by Apple.
I agree it’s easy to run locally (although I do so on Linux), but what’s easy for the HN bubble and easy for the rest of population is not the same.
I thought running harnesses (agents) tightened by sandbox-exec was the way to go but I don’t think anything short of a vm or container is an acceptable method, if not a separate login.
I received this authoritatively from a famous divorce lawyer of my city/country that “feeling” bad usually happens only when young children are involved — or marriage is young and love was involved in the marriage (this is an arranged marriage country, so that part is different from USA). Other than that if a huge parting sum of money is involved that sense of liberation outweighs everything else. In fact if anything else, it’s an overwhelming sense of relief.
And by dictionary definition once someone has been established as a smuggler, there’s technically no way they can also be labelled as spies, or engaging in espionage. Also, spies never smuggle, never. Spy’s honour! Yeah, that makes total sense.
Smugglers can be spies actually, it’s not an uncommon trope. Just not all smugglers are spies. Or were you just trying to setup some sort of straw man to knock down?
I am usually not the believer of Hanlon's razor. I stick to malice when there's a doubt. It has served me well. But I have some doubts in this case. I mean this OS has never been able to help me spell my own first name. It matches no sensitive word in any language, let alone in my own. And this is by typing, let alone swiping. Anyone who even tries their swipe-typing, let's just say, is very adventurous.
To be honest, this is a mild minor issue when it comes to iOS stock keyboard.
In short: I'd have not even touched iOS's stock keyboard app (from the day Apple allowed such apps) had Apple added a simple feature of letting users disallow internet access to specific apps.
Running local models is already extremely easy.
I have a suspicion this app will be a way to add a too many gigabytes to the mac and of course like the Chess.app there will be no way to get rid of it. There are excellent cli apps/GUI apps like this https://github.com/ddalcu/mlx-serve - they are both cli and gui – and even its gui surprisingly nimble (I use this, but I am not related to the project). I am yet to try this https://github.com/ggml-org/Llama-macOS but I've seen only good reviews of it.
I also do not think Apple is doing it for the users who won't explore around. I can't wait to get off this operating system. Next time a friend travels to the continent I will explore getting a Framework laptop via them.
reply