topic
Local Inference
3 posts tagged Local Inference.
AI Models & Hardware3 min read
Meta's Muse Spark Open Targets Two Mac Studios and MLX
Meta calls Muse Spark Open the most capable US open-weight model to date, and says it runs on a two-machine Apple desktop setup. For builders, the hardware pitch matters as much as the benchmark claim.
- open-weight
- mlx
- local-inference
- apple-silicon
- meta
Open-Weight Models4 min read
Qwen 3.8 27B Is Strong — Until Its Default Reasoning Mode Burns Your Budget
Alibaba's new 27B open-weight model looks like a genuine step up on paper, but its out-of-the-box 'xhigh' reasoning default can turn trivial tasks into token-burning marathons.
- qwen
- open-weight-llm
- vibecoding
- agentic-dev
- local-inference
AI Models & Dev Tooling4 min read
Meta's Muse Glimmer: A 30B Open-Weights Model Built for Agentic Coding
Meta just shipped a 30B parameter model under a clean Apache 2.0 license, purpose-built for local agentic workflows — tool use, multi-turn coding, and SWE-Bench-style tasks. Here's what it actually changes for builders.
- open-weights-ai
- vibecoding
- agentic-ai
- llm-tooling
- local-inference