Reflection AI’s Beam: A 501B Open-Weight Model for Coding

—

제공

안

Reflection AI has introduced Beam, its first open-weight language model, aimed squarely at coding, reasoning, and agentic workloads. The model stands out not just for its size, but for the scale of reinforcement learning (RL) behind it, which Reflection claims is among the largest RL runs ever conducted by an open AI lab. For developers who rely on open-weight models to build coding assistants and autonomous agents, Beam represents a notable step toward matching proprietary-model performance without sacrificing openness or inference efficiency.

What Beam is and how it was built

Beam is a sparse Mixture-of-Experts (MoE) model with 501 billion total parameters, but only 23 billion active at any given time. This sparse architecture is key to its design philosophy: rather than activating the entire network for every token, Beam routes computation through a subset of specialized “expert” sub-networks, which keeps inference costs far lower than a dense model of comparable total size would require.

The model’s capabilities come from two major investments. First, pretraining: Beam was trained on 23.8 trillion tokens drawn from curated web data and proprietary licensed datasets, which Reflection says matches or outperforms similarly sized open base models. Second, and more distinctively, Reflection poured resources into large-scale reinforcement learning, treating RL compute as a primary scaling lever rather than a fine-tuning afterthought.

A reinforcement learning run at unusual scale

The headline detail of Beam’s training is the RL infrastructure behind it. Reflection deployed 10,500 NVIDIA GB300 GPUs for four weeks, generating more than 100 million rollouts with context lengths up to 256,000 tokens. Training and grading relied on roughly 1.3 billion sandboxes, drawing on a pool of one million curated coding, agentic, and STEM environments.

Scaling RL to this degree is intended to let the model explore more problem-solving strategies and sustain longer, multi-step reasoning chains that involve tool use and adaptation to feedback from an environment. Reflection reports that capability gains continued as RL compute increased, with no sign of a plateau in their evaluation suite, suggesting there was still headroom left on the table when training concluded.

One of the harder engineering problems the team tackled was training stability under asynchronous policy gradients. When rollouts run for extended periods, different tokens in a single rollout can be generated by different, progressively outdated versions of the model, a problem Reflection calls “policy staleness.” This is compounded by numerical differences between the training and inference engines. Reflection says it developed new algorithms to keep learning stable even when the model is learning from interactions generated more than a day earlier, which is what allows the fully asynchronous RL pipeline to function at this scale without collapsing.

Beam was also trained with a controllable length penalty, rewarding correct solutions while discouraging unnecessarily long outputs. Notably, Reflection reports that early in RL training, performance improved even as response length decreased, indicating the model was learning to solve tasks more efficiently rather than simply padding its reasoning.

How Beam compares to other open models

Reflection positions Beam as advancing what it calls the “Western open-weight frontier,” and says it is competitive with larger open models such as GLM-5.2 and approaching Qwen 3.8-Max on coding and agentic benchmarks. It acknowledges that frontier open models like Kimi K3 still lead on raw capability. Beam’s pitch is not that it is the single most capable open model available, but that it delivers comparable reasoning performance while using significantly less inference compute.

Specifically, Reflection claims Beam matches GLM-5.2 on advanced reasoning benchmarks while using 3 to 4 times less inference compute, and that the efficiency gap widens further against 2-trillion-plus parameter models like Qwen 3.8-Max. The company frames this as “more intelligence per token,” which translates into lower serving costs for enterprises running coding and agentic workloads at scale, since inference cost generally scales with active parameters rather than total parameter count.

This efficiency-first positioning differentiates Beam from a pure capability race. Rather than competing purely on top benchmark scores, Reflection is betting that enterprises care about the cost of running a model at production scale, especially for agentic tasks that require many sequential inference calls.

What this means for developers

For teams building coding assistants, autonomous agents, or STEM-focused applications, Beam’s sparse MoE design and RL-driven training suggest it could serve as a workhorse model where cost-efficiency matters as much as raw capability. Because only 23 billion of its 501 billion parameters are active per token, it should be meaningfully cheaper to serve than dense models of similar total scale, assuming the published efficiency comparisons hold up in independent testing.

That said, the model is not yet broadly available. Reflection states that Beam is still undergoing final red-teaming and evaluations, and that it will release the model weights, a technical report, a model card, and developer artifacts later this month. In the meantime, interested developers can sign up for early access. Until the weights and technical report are public, claims about benchmark performance and efficiency come solely from Reflection’s own blog post and have not been independently verified.

Frequently asked questions

Is Beam available to use right now? Not yet in full. Reflection says it is finishing red-teaming and evaluations, with weights and developer tools planned for release later this month; early access sign-up is open now.

What makes Beam different from a typical large language model? Beam uses a sparse Mixture-of-Experts architecture, activating only 23 billion of its 501 billion parameters per token, and was trained with an unusually large-scale reinforcement learning run focused on coding and agentic tasks.

How does Beam compare to models like GLM-5.2 or Kimi K3? Reflection says Beam approaches or matches these models on several coding and reasoning benchmarks while using substantially less inference compute, though it trails Kimi K3 on raw capability according to the company’s own comparisons.

Source: Beam: Reflection’s 501B open-weight model


코멘트

답글 남기기

이메일 주소는 공개되지 않습니다. 필수 필드는 *로 표시됩니다