UC Berkeley Open-Sources FreeToken: Frontier-Scale MoE on Consumer Hardware

Posted on Sat 05 September 2026 in AI Infrastructure • Tagged with MoE, Inference, Edge AI, Open Source, LLM

UC Berkeley has open-sourced FreeToken, an edge-native inference engine that runs frontier-scale Mixture-of-Experts (MoE) models on consumer hardware. It treats GPU, CPU, host memory, and PCIe interconnects as a single unified inference platform.

The approach works because of how MoE models are structured. A model like DeepSeek-V4-Flash carries 284B total …


Continue reading

Let's end Casteism on Teachers' day

Posted on Sat 05 September 2026 in Society • Tagged with Radhakrishnan, Casteism, Teachers Day, Social Reform, Hinduism

1789004378381

September 5th is Teachers' Day, marking the birthday of Dr. Sarvepalli Radhakrishnan — philosopher, statesman, and India's second President. He once described casteism as a cancer afflicting India. In that spirit, this piece revisits his views on the subject and asks that we treat Teachers' Day as an occasion to confront …


Continue reading

Deploying a Local FastAPI App to Azure App Service

Posted on Tue 01 September 2026 in Cloud Deployment • Tagged with azure, fastapi, app-service, python, devops

1789004104021

Deploying a FastAPI application from your local machine to Azure App Service is a straightforward process once you know the sequence. This guide walks through authenticating, provisioning the infrastructure, configuring the runtime, and shipping your code. Replace the placeholder names below with your own resource group and app names.

Authenticate …


Continue reading

Requirements or Technical Design? Choosing Where a Kiro Spec Begins

Posted on Sat 29 August 2026 in Agentic Engineering • Tagged with kiro, spec-driven-development, requirements, technical-design, ai-ides

Every Kiro spec opens with a small but consequential fork: what do you author first? The IDE offers two starting points — Requirements or Technical Design — and treats Requirements as the recommended default. The choice isn't cosmetic. It decides which artifact is the source of truth and which is derived, and …


Continue reading