The Model Factory. The system behind the models.
Traditional foundation model training is manual, linear, and slow. We built something different.
The Model Factory is Poolside's internal platform for training, scaling, and experimenting with foundation models. It handles automated evaluation during training, reinforcement learning from code execution, architecture ablations, synthetic data generation, and data mixing—all orchestrated across our GPU clusters.
Experiments that used to take weeks to schedule now run in under an hour. We describe a configuration, and the Factory handles the rest.
Inside the Model Factory
We share work as we go. See our latest thinking on model training, infrastructure, and the path toward AGI.
Poolside's journey to AGI
When we founded Poolside in San Francisco in April 2023, the narrative in the industry was that all we needed to reach AGI was to scale up language modelling.Tools of the Trade: C2C Activation Offloading on Grace Blackwell
We demonstrate the potential of NVIDIA's NVLink C2C on Grace-based superchips as a high-performance alternative to selective activation checkpointing. By offloading MLP activations to host memory during training, we achieve a 6–13% throughput improvement over selective AC with negligible memory overhead.Enabling the Agentic Enterprise with Redpanda
Our strategic partnership with Redpanda's Agentic Data Plane