Scale Agentic Coding Workflows with Meta’s Muse Spark Open on NVIDIA GB300 NVL72

來源原標題

Scale Agentic Coding Workflows with Meta’s Muse Spark Open on NVIDIA GB300 NVL72

作者

Tanya Lenz

原始標籤

Agentic AI / Generative AI · Top Stories · featured · GB300 NVL72 · Megatron · Mixture of Experts (MoE) · NVFP4 · Open Source · PyTorch · Training AI Models

原始連結

https://developer.nvidia.com/blog/scale-agentic-coding-workflows-with-metas-muse-spark-open-on-nvidia-gb300-nvl72/

摘要原文

Meta launches Muse Spark Open, a coding-optimized 816B mixture-of-experts (MoE) model with 42B active parameters and a 1M token context window. Trained on NVIDIA GB300 NVL72 Blackwell Ultra specifically for agentic coding workflows, it delivers higher first attempt accuracy, reliable tool calling, and deep codebase understanding across repositories. The 1M token context window holds an entire project, including complex dependencies, legacy code, and thousands of files without breaking a task into pieces. As a reasoning model, Muse Spark Open adds audio and video perception alongside image and document understanding, working natively and reliably across what it sees, hears, and reads. NVFP4 checkpoints generated by Meta and optimized for NVIDIA Blackwell Ultra shrink the memory footprint of all 816B parameters with native FP4 Tensor Core acceleration. Fewer bytes moved per token to increase tokens per second per user, and the freed-up memory supports larger KV cache for concurrent long context sessions, delivering higher throughput, a lower cost per token. Custom-built for agentic coding multimodal understanding across text, image, video, and audio General coding models are optimized for single-shot completions such as generating a function, writing a unit test, or suggesting an inline fix. They excel at discrete, well-scoped tasks where the context is small, and the answer is immediate. Agentic coding demands something fundamentally different. Planning a multifile refactor, navigating thousands of files, recovering from failing tests, and coordinating subagents over long horizons requires a model built for sustained, multistep work. Muse Spark Open is built for exactly these workloads, delivering higher first-attempt accuracy, reliable tool calling, and deep codebase understanding across repositories. It plans, acts, observes, and self corrects. It supports multistep task execution with tool use, output evaluation, and iterative refinement. The model uses goal conditioning to hold direction and context compaction to retain the knowledge needed to sustain progress across long-running sessions. With a 1M token context window, it holds an entire project, including complex dependencies, legacy code, and thousands of files without breaking tasks into pieces. Beyond coding, it searches the web (including multimodal browsing), spawns and coordinates subagents for decomposable tasks, and leverages computer use capabilities unified across desktop, mobile, and browser. It generates separate commentary before each action, so developers know what the agent is doing and why. The model’s 1.8B perception encoder natively processes interleaved text, images, video frames, and audio without separate pipelines per modality. This means that the model reasons over what it sees, hears, and reads in a single unified pass. This suits developer workflows spanning screenshots, diagrams, error logs, and video walkthroughs within the same agent session. Sparse MoE routing activates only 42B of 816B total parameters per token, delivering frontier agentic capability at a fraction of the serving cost of dense models at equivalent scale. Figure 1 . Muse Spark Open sparse MoE architecture activates 42B of 816B parameters per token through top 8 routing across 256 experts Video 1. Muse Spark Open diagnoses a bug from a screen recording with narrated audio, reading the codebase to identify the root cause Muse Spark Open optimized performance on GB300 NVL72 The NVIDIA GB300 NVL72 features a rack scale architecture that integrates 72 NVIDIA Blackwell Ultra GPUs into a single platform. Its large, 72-GPU NVIDIA NVLink domain enables efficient communication at 130 TB/s, eliminating bottlenecks that appear when expert traffic must cross traditional off-the-shelf networks. For a sparse MoE model like Muse Spark Open, which routes each token to eight of 256 experts, that bandwidth directly determines how much of the theoretical throughput a deployment realizes. Agentic workloads turn static single-turn interactions into multistep workflows that reason, invoke tools, coordinate subagents, and carry growing context from one turn to the next. Out of the box, Muse Spark Open running agentic workloads on NVIDIA GB300 NVL72 delivers up to 50K per second per GPU and up to 600 tokens per second per user, enabling AI factories to run large parameter models in production at high throughput and low latency. F igure 2. Running agentic workloads, Muse Spark Open on four NVIDIA Blackwell GPUs with speculative decode achieved over 50K tokens per second per GPU and over 600 tokens per user Flexible deployment options for Muse Spark Open NVIDIA supports multiple inference stacks to meet a variety of developer needs. SGLang, vLLM , and TensorRT LLM give developers direct control over serving configuration, parallelism, and batching on the NVIDIA accelerated computing platform. TensorRT LLM adds compiled engines tuned for NVIDIA GPUs. NVIDIA Dynamo publishes deployment recipes for all three, and separates prefill from decode across dedicated GPU pools, so compute bound prompt processing doesn’t slow token generation. Its KV cache-aware routing sends each request to the worker already holding the relevant prefix, avoiding precomputation as context accumulates across long agentic sessions. Post-train Muse Spark Open with NeMo AutoModel and Megatron Bridge Developers can post-train Muse Spark Open on domain specific datasets using NVIDIA NeMo AutoModel , a PyTorch native training library with native Hugging Face checkpoint support and no model conversion required. It enables full SFT and LoRA fine tuning out of the box, optimized for rapid experimentation over a wide variety of industry specific cases. Developers can also leverage NVIDIA Megatron Bridge to convert Hugging Face checkpoints to Megatron format when they are ready for large production-scale training to take advantage of the optimizations. Get started with GPU-accelerated Muse Spark Open To get started, download Muse Spark Open NVFP4 weights from Hugging Face. For production deployments, try the downloadable NVIDIA NIM . The NIM reduces setup to a single command, replacing benchmarking and tuning cycles with a container that automatically selects the best serving backend and precision for the detected hardware.