1885 points•744 comments•5d ago•by cylo•unix.foo ↗

Local AI needs to be the norm

The article argues that software should rely on on-device AI rather than cloud-hosted models to improve privacy, reliability, and cost. It cites a native iOS client for The Brutalist Report where summaries are produced on-device using Apple’s local model APIs, avoiding server involvement and data storage. It notes tooling in Apple’s ecosystem that supports structured outputs and suggests using cloud models only when genuinely necessary.

Discussion (744)

No comments yet

Top
Trending
New
For You
Bookmarks
Dossier