Blog

Insights, updates, and engineering deep dives from the Mirai team.

Product•Jan 5, 2026

Introducing Mirai 2.0: The Universal Inference Runtime

Today we're announcing the biggest update to Mirai yet. Support for Llama 3, 50% faster inference on Apple Silicon, and a new plugin system.

By Alex Chen
Engineering•Dec 12, 2025

Optimizing Transformer Models for Mobile Devices

A deep dive into quantization, pruning, and knowledge distillation techniques to fit 7B parameter models on an iPhone 15 Pro.

By Sarah Miller
Analysis•Nov 28, 2025

The Economics of Edge vs. Cloud Inference

We analyzed the cost per token for 1M daily active users. Moving 80% of inference to the edge can save enterprises up to $500k annually.

By David Park
Tutorial•Nov 15, 2025

Building a Local RAG Pipeline with Mirai and LangChain

Step-by-step tutorial on creating a privacy-preserving document chat application that runs entirely offline.

By Engineering Team