Meta's Muse Glimmer: a 30B Agent That Runs on One Consumer GPU
Summary
Meta open sourced Muse Glimmer on August 10, 2026: a 30 billion parameter agentic model under Apache 2.0. The figure that changes things is memory. At full precision the model wants over 55 GB; quantized it fits under 20 GB, which is one consumer GPU. Agentic here means the model closes the loop itself: it calls a function, reads what came back, and retries when the result is wrong. That retry loop is exactly what has been expensive, because every attempt was a metered round trip to a hosted endpoint, and a local model meters nothing. Meta reports speculative decoding speedups of 3.1x on an RTX 5090, 1.8x on an M5 Max and 1.5x on an M4 Max. The model reads multimodal input and speaks more than 100 languages. Weights are on Hugging Face at launch, with Ollama, LM Studio and vLLM support on day one and llama.cpp, MLX and ExecuTorch integrations coming. One thing the release does not change: a local agent still has to retrieve over something, and the corpus it grounds on has to live somewhere it can search. Meta's announcement: research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model
About this video
Meta open sourced Muse Glimmer on August 10, 2026: a 30 billion parameter agentic model under Apache 2.0. The figure that changes things is memory. At full precision the model wants over 55 GB; quantized it fits under 20 GB, which is one consumer GPU. Agentic here means the model closes the loop itself: it calls a function, reads what came back, and retries when the result is wrong. That retry loop is exactly what has been expensive, because every attempt was a metered round trip to a hosted endpoint, and a local model meters nothing. Meta reports speculative decoding speedups of 3.1x on an RTX 5090, 1.8x on an M5 Max and 1.5x on an M4 Max. The model reads multimodal input and speaks more than 100 languages. Weights are on Hugging Face at launch, with Ollama, LM Studio and vLLM support on day one and llama.cpp, MLX and ExecuTorch integrations coming. One thing the release does not change: a local agent still has to retrieve over something, and the corpus it grounds on has to live somewhere it can search. Meta's announcement: research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model