FlashML-org/FreeToken

FreeToken is an inference-serving engine, meaning software that runs machine-learning models and responds to requests, for running large open-weight mixture-of-experts models on personal hardware. It coordinates GPUs, CPUs, system memory, and their connections so developers can use these models locally through APIs compatible with Anthropic and OpenAI clients.