Gimlet Labs raises $300 million for inference disaggregation platform
Gimlet Labs raised $300 million in a Series B led by Andreessen Horowitz at a $3 billion valuation, bringing total outside funding to $392 million. Investors include Arm, Samsung Ventures and Microsoft's M12, among others. Gimlet's platform automatically breaks large language models into modules and places each on the chip architecture best suited to its hardware needs, using AI agents and a custom compiler to optimize code. The company offers serverless and managed deployments, reports billions of customer orders, and will use the funds to add several hundred megawatts of serverless capacity and develop an inference-optimized server without a motherboard.
Gimlet secured $300 million to scale inference infrastructure and hardware.
Context
Large language models have parts with different hardware needs. Gimlet built software to split models and deploy each part to the right chip. Now the company raised funding to scale serverless capacity and build custom inference servers.
The full analysis
19 dimensions on this story — world impact, market read, and what happens next.
- Full ContextLocked
- Affected SectorsLocked
- Stock ImpactLocked
- Economic IndicatorLocked
- Investor RelevanceLocked
- Professional RelevanceLocked
- Watch PointsLocked
- Probability of ChangeLocked
- Debate PointsLocked
- Prerequisite KnowledgeLocked
- Follow-up QuestionsLocked
- Pros & ConsLocked