1 month ago · ai

Reverse-engineering the RK3588 NPU: Hacking limits to run vision transformers

Article URL: https://amohan.dev/blog/2025/shard-optimizing-vision-transformers-edge-npu/ Comments URL: https://news.ycombinator.com/item?id=46294626 Points: 19...

1 month ago · ai

Unlocking Peak Performance on Qualcomm NPU with LiteRT

Modern smartphones feature sophisticated SoCs system on a chip, composed of CPU, GPU, and NPU, which can enable compelling, on‑device GenAI experiences that are...

1 month ago · ai

MediaTek NPU and LiteRT: Powering the next generation of on-device AI

The Neural Processing Unit NPU has become the critical enabler for the next generation of on‑device AI. By delivering tens of TOPS tera operations per second wi...