Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

From the official release
](#introducing-olmo-core-3-open-scalable-training-infrastructure-for-large-moes)
Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
[ Community Article ](/blog/community) Published
October 1, 2026
[ Upvote 23
](/login?next=%2Fblog%2Fallenai%2Folmocore3) - [
- ](/Chroma111)
- [
- ](/stefan-it)
- [
- ](/tbetton)
- [
- ](/firatyavas)
- [
- ](/Agenten)
- [
- ](/KlondikeDev)
- +17
[
](/Ai2Comms) [Kyle Wiggers Ai2Comms Follow
](/Ai2Comms) [
](/allenai) [allenai](/allenai)
:last-child]:mb-0">
📄 Tech Report | 💻 Code | 🧩 Interactive demo
Today we’re releasing Olmo-core 3, a significant upgrade to our framework for developing large language models featuring a redesigned open mixture-of-experts (MoE) training system.
This is a short excerpt. Read the full announcement on the official source.
Continue on huggingface.co → (opens in a new window)Related stories

AWS Security Hub now exports findings to S3 in CSV or JSON format
AWS What’s New
Today, AWS Security Hub announces support for exporting findings to Amazon S3 in CSV or JSON (OCSF) format. Security teams that need findings outside the console for use cases such as compliance reporting and audit evidence can now export findings from every findings page in the

DigitalOcean MicroVMs: Fast, isolated compute for your AI agent infrastructure
DigitalOcean Blog
Coding-agent platforms, sandbox products, and code-execution services all need the same thing: isolated machines that start up fast, retain their state between bursts of work, and don’t consume compute when idle. If you build it yourself, you’ll have to lease compute capacity and

Amazon EC2 R8gd instances are now available in additional regions
AWS What’s New
Amazon Elastic Compute Cloud (Amazon EC2) R8gd instances are available in AWS European Sovereign Cloud (Germany) region. These instances feature up to 11.4 TB of local NVMe-based SSD block-level storage and are powered by AWS Graviton4 processors, delivering up to 30% better perf

Amazon EC2 R8g instances now available in additional regions
AWS What’s New
Starting today, Amazon Elastic Compute Cloud (Amazon EC2) R8g instances are available in the AWS European Sovereign Cloud (Germany) region. These instances are powered by AWS Graviton4 processors and deliver up to 30% better performance compared to AWS Graviton3-based instances.

DMZ — 5 Features to Get Excited for in Call of Duty: Modern Warfare 4’s New Mode
Xbox WireMike Nelson, XBOX Wire Editor
Call of Duty’s upcoming DMZ mode sounds like it’s shaping up to be something special. Set on the new Hajin map and inspired by the events and locations from Modern Warfare 4 ’s Campaign, this open-world combat environment will challenge you to loot, complete objectives, fight bot

Hack the World: Why hackathons are still the best place to learn to build
GitHub BlogEd Summers
Someone bursts through the door and announces, “There’s pizza!” Nearby, a team has duct tape and cardboard holding its prototype together. Another is debugging a model that won’t detect their movements. This is a common scene during hackathons, and for a lot of people they’re the
