UC Berkeley has open-sourced FreeToken, an edge-native inference engine that runs frontier-scale Mixture-of-Experts (MoE) models on consumer hardware. It treats GPU, CPU, host memory, and PCIe interconnects as a single unified inference platform.

The approach works because of how MoE models are structured. A model like DeepSeek-V4-Flash carries 284B total …