Show HN: Off Grid – Run AI text, image gen, vision offline on your phone

Source: Hacker News

Overview

Your phone’s GPU is often more powerful than the GPUs in many 2018 laptops, yet it typically sits idle while you pay monthly subscriptions to run AI on remote servers. Those services send your conversations, photos, and voice recordings to companies whose privacy policies you may never have read. Off Grid is an open‑source app that puts that hardware to work locally: text generation, image generation, vision AI, and voice transcription—all running entirely on your phone with no data ever leaving the device.

Use Cases

• Use AI on a flight with no Wi‑Fi.
• Operate in countries with internet censorship.
• Deploy in hospitals where cloud services pose compliance challenges.
• Keep personal journal entries out of anyone’s training data.

Technical Details

• Text generation: llama.cpp (15–30 tokens/s, any GGUF model)
• Image generation: Stable Diffusion (5–10 s on Snapdragon NPU)
• Voice transcription: Whisper
• Vision: SmolVLM / Qwen3‑VL

All components are hardware‑accelerated on:

• Android: QNN, OpenCL
• iOS: Core ML, ANE, Metal

Availability

• MIT licensed.
• Android APK available on GitHub Releases.
• Source code can be built for iOS.

---

Comments: https://news.ycombinator.com/item?id=47019133 (24 points, 6 comments)