Ong Jun Xiong — Notes

Working notes on software, AI and building a career around both.

· 7 min read

Who builds the AI stack, and who is buying it

158 AI companies placed on the stack and sorted by size, and why 2026's buyers were companies already on the same request path.

AI systems#ai-stack#landscape#inference#evals#agents#hardware

In 2026 the AI stack started consolidating along its request paths. Companies that already owned one step of a customer's request, such as the chip, the cloud, the database, the monitor or the payment, bought the AI specialist sitting next to them on that path. Stripe agreed to buy OpenRouter, the model router (Stripe). Dynatrace agreed to buy Arize, the eval and tracing company (Dynatrace). Nvidia agreed to buy Hugging Face, where developers pick the models its chips run (Semafor). Cloudflare, whose network already sits in front of websites, bought Replicate, a hosted inference service (Cloudflare). And SpaceX, which merged with xAI in February (TechRepublic), closed its purchase of Cursor in August (Cursor).

I wanted to see that on one page, so I placed 158 companies on the ten layers from the roadmap. Evals and gateways, which run beside those layers, get columns of their own because whole companies live there. The chart opens with 39 of them: the companies that span the most layers and the ones this post discusses. Expand it to see all 158, choose a layer or a size to see everyone in it, or find a company by name. Choose Deals to see only the 19 companies in a deal. Eight of those 19 went to buyers that are not in the chart at all: an infrastructure fund, a data-security company, a database, a documentation platform, two network-security companies, a payments company and a monitoring company.

  • BarsMainAlso in
  • Deals→ acquired→ pending↝ licensedshut down
  • Size$5.5Tmarket cap or valuation
  • Tagvideothe model type, when not text
Filters and keyAll layersPowerChipsRacksCloudDataPretrainPost-trainInferenceGatewayEvalsHarnessAppsAll sizesLargeMidSmallNot sizedDeals
  • BarsMainAlso in
  • Deals→ acquired→ pending↝ licensedshut down
  • Size$5.5Tmarket cap or valuation
  • Tagvideothe model type, when not text

MainAlso in

Showing

39 of 158 shown158 of 158 shown

Power and sites1 of 66

  • Constellation Energy. Main layer: Power and sites. Size: $106B, Large.

    Largest US nuclear operator; supplies firm power to data centers and closed its Calpine purchase in 2026.

    Main layer: Power and sitesSize: $106B, LargeWebsiteSource

  • Aligned Data Centers. Main layer: Power and sites. Size: $40B, Mid. Acquired by AIP, 2026.

    Hyperscale and AI campus developer with 51 campuses and over 6 GW of capacity.

    Main layer: Power and sitesSize: $40B, MidAcquired by AIP, 2026WebsiteSource

  • Crusoe. Main layer: Power and sites. Also in: Cloud and capital. Size: $30.9B, Mid.

    Builds AI datacenters, including the Abilene Stargate site, and runs its own AI cloud.

    Main layer: Power and sitesAlso in: Cloud and capitalSize: $30.9B, MidWebsiteSource

  • TeraWulf. Main layer: Power and sites. Size: $7B, Mid.

    Data center and power developer; signed a 20-year Anthropic lease at its Kentucky campus in 2026.

    Main layer: Power and sitesSize: $7B, MidWebsiteSource

  • Core Scientific. Main layer: Power and sites. Also in: Cloud and capital. Size: $5B, Mid.

    Former bitcoin miner that hosts AI and HPC capacity; CoreWeave is its main tenant.

    Main layer: Power and sitesAlso in: Cloud and capitalSize: $5B, MidWebsiteSource

  • Kairos Power. Main layer: Power and sites. Size: —, Not sized.

    Develops fluoride-salt-cooled small modular reactors, with power contracts for data centers.

    Main layer: Power and sitesSize: —, Not sizedWebsiteSource

Chips and memory3 of 1717

  • Nvidia. Main layer: Chips and memory. Also in: Racks and networks, Cloud and capital, Data, Pretraining, Post-training, Inference. Size: $5.5T, Large.

    GPUs and networking, DGX Cloud, Nemotron open models and data, NeMo training and Dynamo serving.

    Main layer: Chips and memoryAlso in: Racks and networks, Cloud and capital, Data, Pretraining, Post-training, InferenceSize: $5.5T, LargeWebsiteSource

  • TSMC. Main layer: Chips and memory. Size: $2.4T, Large.

    Foundry and CoWoS packaging for Nvidia, AMD and most custom AI accelerators.

    Main layer: Chips and memorySize: $2.4T, LargeWebsiteSource

  • Broadcom. Main layer: Chips and memory. Also in: Racks and networks. Size: $1.7T, Large.

    Co-designs custom AI chips, including OpenAI's, and sells Ethernet switch silicon.

    Main layer: Chips and memoryAlso in: Racks and networksSize: $1.7T, LargeWebsiteSource

  • Samsung Electronics. Main layer: Chips and memory. Size: $1.3T, Large.

    Memory and foundry maker; supplies HBM and led Mistral's 2026 funding round.

    Main layer: Chips and memorySize: $1.3T, LargeWebsiteSource

  • Micron. Main layer: Chips and memory. Size: $1.2T, Large.

    US memory maker supplying HBM; exited the Crucial consumer brand in 2026 to focus on AI.

    Main layer: Chips and memorySize: $1.2T, LargeWebsiteSource

  • AMD. Main layer: Chips and memory. Also in: Racks and networks. Size: $993B, Large.

    Instinct GPUs and the Helios rack; has multi-gigawatt supply deals with OpenAI and Anthropic.

    Main layer: Chips and memoryAlso in: Racks and networksSize: $993B, LargeWebsiteSource

  • SK hynix. Main layer: Chips and memory. Size: $891B, Large.

    Leading supplier of HBM memory for AI accelerators.

    Main layer: Chips and memorySize: $891B, LargeWebsiteSource

  • Intel. Main layer: Chips and memory. Size: $553B, Large.

    Gaudi and Crescent Island accelerators, Xeon host CPUs and a chip foundry.

    Main layer: Chips and memorySize: $553B, LargeWebsiteSource

  • Marvell. Main layer: Chips and memory. Also in: Racks and networks. Size: $241B, Large.

    Custom AI silicon and optical interconnect; bought Celestial AI in December 2025.

    Main layer: Chips and memoryAlso in: Racks and networksSize: $241B, LargeWebsiteSource

  • Qualcomm. Main layer: Chips and memory. Also in: Inference. Size: $187B, Large.

    AI200 and AI250 datacenter inference cards; owns the Modular inference software since 2026.

    Main layer: Chips and memoryAlso in: InferenceSize: $187B, LargeWebsiteSource

  • Cerebras. Main layer: Chips and memory. Also in: Cloud and capital, Inference. Size: $39B, Mid.

    Wafer-scale AI chips, sold directly and as a hosted inference service; listed on Nasdaq in May 2026.

    Main layer: Chips and memoryAlso in: Cloud and capital, InferenceSize: $39B, MidWebsiteSource

  • Etched. Main layer: Chips and memory. Size: $21B, Mid.

    Builds Sohu, an ASIC designed only for transformer inference.

    Main layer: Chips and memorySize: $21B, MidWebsiteSource

  • SambaNova. Main layer: Chips and memory. Also in: Inference. Size: $11B, Mid.

    Dataflow AI chips and a hosted inference service.

    Main layer: Chips and memoryAlso in: InferenceSize: $11B, MidWebsiteSource

  • Tenstorrent. Main layer: Chips and memory. Size: $2.6B, Small.

    RISC-V AI accelerators and Galaxy servers, led by Jim Keller.

    Main layer: Chips and memorySize: $2.6B, SmallWebsiteSource

  • Rebellions. Main layer: Chips and memory. Size: $2.3B, Small.

    Korean AI inference chip maker; merged with SK Telecom's Sapeon in 2024.

    Main layer: Chips and memorySize: $2.3B, SmallWebsiteSource

  • Huawei. Main layer: Chips and memory. Also in: Cloud and capital. Size: —, Not sized.

    Ascend AI accelerators and Huawei Cloud; DeepSeek V4 was adopted on Ascend.

    Main layer: Chips and memoryAlso in: Cloud and capitalSize: —, Not sizedWebsiteSource

  • Taalas. Main layer: Chips and memory. Size: —, Not sized. Sale agreed to AMD, 2026.

    Toronto startup that hard-wires a specific model into custom inference silicon.

    Main layer: Chips and memorySize: —, Not sizedSale agreed to AMD, 2026WebsiteSource

Racks and networks1 of 66

  • Dell Technologies. Main layer: Racks and networks. Size: $373B, Large.

    Sells AI servers and racks, including Nvidia-based systems.

    Main layer: Racks and networksSize: $373B, LargeWebsiteSource

  • Arista Networks. Main layer: Racks and networks. Size: $273B, Large.

    Ethernet switches for AI back-end networks in large GPU clusters.

    Main layer: Racks and networksSize: $273B, LargeWebsiteSource

  • Hewlett Packard Enterprise. Main layer: Racks and networks. Size: $98B, Large.

    AI servers and supercomputers; owns Cray and Juniper networking.

    Main layer: Racks and networksSize: $98B, LargeWebsiteSource

  • Vertiv. Main layer: Racks and networks. Size: $93B, Large.

    Power distribution and liquid cooling equipment for AI datacenters.

    Main layer: Racks and networksSize: $93B, LargeWebsiteSource

  • Astera Labs. Main layer: Racks and networks. Size: $59B, Large.

    Connectivity chips and retimers linking GPUs, memory and switches inside AI racks.

    Main layer: Racks and networksSize: $59B, LargeWebsiteSource

  • Supermicro. Main layer: Racks and networks. Size: $27B, Mid.

    Builds GPU servers and liquid-cooled racks for AI datacenters.

    Main layer: Racks and networksSize: $27B, MidWebsiteSource

Cloud and capital3 of 1010

  • Microsoft. Main layer: Cloud and capital. Also in: Chips and memory, Harness, Apps. Size: $4T, Large.

    Azure cloud, Maia 200 inference chip, Agent Framework SDK and GitHub Copilot.

    Main layer: Cloud and capitalAlso in: Chips and memory, Harness, AppsSize: $4T, LargeWebsiteSource

  • Amazon (AWS). Main layer: Cloud and capital. Also in: Chips and memory, Inference, Harness. Size: $2.8T, Large.

    Largest cloud; designs Trainium chips, serves models via Bedrock and ships the Strands agent SDK.

    Main layer: Cloud and capitalAlso in: Chips and memory, Inference, HarnessSize: $2.8T, LargeWebsiteSource

  • Oracle (OCI). Main layer: Cloud and capital. Also in: Power and sites. Size: $429B, Large.

    Cloud provider with a reported $300B five-year OpenAI compute contract and a Stargate partner.

    Main layer: Cloud and capitalAlso in: Power and sitesSize: $429B, LargeWebsiteSource

  • Nebius. Main layer: Cloud and capital. Also in: Inference. Size: $56B, Large.

    GPU neocloud with an inference service (Token Factory); has Microsoft and Meta contracts.

    Main layer: Cloud and capitalAlso in: InferenceSize: $56B, LargeWebsiteSource

  • CoreWeave. Main layer: Cloud and capital. Also in: Post-training, Evals. Size: $45B, Mid.

    GPU neocloud; owns Weights & Biases and OpenPipe, so it also sells tracing and RL tuning.

    Main layer: Cloud and capitalAlso in: Post-training, EvalsSize: $45B, MidWebsiteSource

  • Nscale. Main layer: Cloud and capital. Also in: Power and sites. Size: $14.6B, Mid.

    UK-based AI cloud and datacenter builder with a large Anthropic capacity lease.

    Main layer: Cloud and capitalAlso in: Power and sitesSize: $14.6B, MidWebsiteSource

  • Fluidstack. Main layer: Cloud and capital. Also in: Power and sites. Size: $7.5B, Mid.

    GPU cloud that builds and operates dedicated clusters for AI labs.

    Main layer: Cloud and capitalAlso in: Power and sitesSize: $7.5B, MidWebsiteSource

  • RunPod. Main layer: Cloud and capital. Also in: Inference. Size: $1B, Small.

    GPU cloud with serverless endpoints for AI workloads.

    Main layer: Cloud and capitalAlso in: InferenceSize: $1B, SmallWebsiteSource

  • Lambda. Main layer: Cloud and capital. Size: —, Not sized.

    GPU cloud and on-demand clusters for AI training.

    Main layer: Cloud and capitalSize: —, Not sizedWebsiteSource

  • Vast.ai. Main layer: Cloud and capital. Size: —, Not sized.

    Marketplace that rents GPUs from third-party hosts.

    Main layer: Cloud and capitalSize: —, Not sizedWebsiteSource

Data2 of 88

  • Scale AI. Main layer: Data. Also in: Post-training, Evals. Size: $29B, Mid.

    Human and expert labelling for RLHF and RL environments, plus the SEAL evaluation leaderboards.

    Main layer: DataAlso in: Post-training, EvalsSize: $29B, MidWebsiteSource

  • Mercor. Main layer: Data. Size: $10B, Mid.

    Marketplace of domain experts who produce training data and evaluations for labs.

    Main layer: DataSize: $10B, MidWebsiteSource

  • Handshake AI. Main layer: Data. Size: $3.5B, Small.

    Supplies expert-written training data to AI labs through its network of graduate students.

    Main layer: DataSize: $3.5B, SmallWebsiteSource

  • Snorkel AI. Main layer: Data. Also in: Post-training. Size: $1.3B, Small.

    Programmatic data labelling and expert datasets, extended to RL environments.

    Main layer: DataAlso in: Post-trainingSize: $1.3B, SmallWebsiteSource

  • Labelbox. Main layer: Data. Also in: Post-training. Size: $1B, Small.

    Data labelling platform that launched an enterprise agent-RL product, Recursion.

    Main layer: DataAlso in: Post-trainingSize: $1B, SmallWebsiteSource

  • Common Crawl. Main layer: Data. Size: —, Not sized.

    Nonprofit that publishes the open web crawl used to train most language models.

    Main layer: DataSize: —, Not sizedWebsiteSource

  • DatologyAI. Main layer: Data. Size: —, Not sized.

    Curates training data for pretraining, selecting and rephrasing web text.

    Main layer: DataSize: —, Not sizedWebsiteSource

  • Surge AI. Main layer: Data. Also in: Post-training. Size: —, Not sized.

    Expert human data and RL environments for frontier labs.

    Main layer: DataAlso in: Post-trainingSize: —, Not sizedWebsiteSource

Pretraining8 of 3131

  • Google. Main layer: Pretraining. Also in: Chips and memory, Cloud and capital, Harness, Apps. Size: $4.3T, Large.

    Gemini models from DeepMind, TPU chips, Google Cloud, the ADK agent SDK and the Gemini app.

    Main layer: PretrainingAlso in: Chips and memory, Cloud and capital, Harness, AppsSize: $4.3T, LargeWebsiteSource

  • SpaceX (xAI). Main layer: Pretraining. Also in: Power and sites, Cloud and capital, Apps. Size: $2.1T, Large.

    Grok models trained on Colossus, which runs on its own turbines and is rented out; owns Cursor.

    Main layer: PretrainingAlso in: Power and sites, Cloud and capital, AppsSize: $2.1T, LargeWebsiteSource

  • Meta. Main layer: Pretraining. Also in: Chips and memory, Apps. Size: $1.8T, Large.

    Trains the Llama and Muse models; designs MTIA chips and ships Meta AI in its apps.

    Main layer: PretrainingAlso in: Chips and memory, AppsSize: $1.8T, LargeWebsiteSource

  • Anthropic. Main layer: Pretraining. Also in: Inference, Harness, Apps. Size: $965B, Large.

    Trains the Claude models; sells them by API and in Claude, Claude Code and the Agent SDK.

    Main layer: PretrainingAlso in: Inference, Harness, AppsSize: $965B, LargeWebsiteSource

  • OpenAI. Main layer: Pretraining. Also in: Power and sites, Chips and memory, Inference, Harness, Apps. Size: $852B, Large.

    Trains the GPT models, leads the Stargate sites, co-designs a chip with Broadcom, and ships ChatGPT and Codex.

    Main layer: PretrainingAlso in: Power and sites, Chips and memory, Inference, Harness, AppsSize: $852B, LargeWebsiteSource

  • Databricks. Main layer: Pretraining. Also in: Data, Inference. Size: $190B, Large.

    Data platform with MosaicML model training and model serving.

    Main layer: PretrainingAlso in: Data, InferenceSize: $190B, LargeWebsiteSource

  • DeepSeek. Main layer: Pretraining. Size: $52B, Large.

    Chinese lab behind the open-weight DeepSeek-V4 and R1 reasoning models.

    Main layer: PretrainingSize: $52B, LargeWebsiteSource

  • Figure. Main layer: Pretraining. Size: $39B, Mid. robotics.

    Humanoid robots driven by its in-house Helix vision-language-action model.

    Main layer: PretrainingSize: $39B, MidWebsiteSource

  • Z.ai (Zhipu). Main layer: Pretraining. Size: $38B, Mid.

    Chinese lab behind the GLM open-weight models; listed in Hong Kong in January 2026.

    Main layer: PretrainingSize: $38B, MidWebsiteSource

  • Mistral AI. Main layer: Pretraining. Also in: Cloud and capital. Size: $24B, Mid.

    French lab with open-weight and commercial models, and its own compute offering.

    Main layer: PretrainingAlso in: Cloud and capitalSize: $24B, MidWebsiteSource

  • Moonshot AI. Main layer: Pretraining. Size: $20B, Mid.

    Chinese lab behind the open-weight Kimi models; Kimi K3 has 2.8T parameters.

    Main layer: PretrainingSize: $20B, MidWebsiteSource

  • Kling AI (Kuaishou). Main layer: Pretraining. Also in: Apps. Size: $15B, Mid. video.

    Kuaishou's Kling video models, sold through a consumer app and API.

    Main layer: PretrainingAlso in: AppsSize: $15B, MidWebsiteSource

  • Skild AI. Main layer: Pretraining. Size: $14B, Mid. robotics.

    Builds a cross-embodiment robot foundation model.

    Main layer: PretrainingSize: $14B, MidWebsiteSource

  • ElevenLabs. Main layer: Pretraining. Also in: Harness, Apps. Size: $11B, Mid. voice.

    Trains speech, transcription and music models and sells a voice-agent platform.

    Main layer: PretrainingAlso in: Harness, AppsSize: $11B, MidWebsiteSource

  • MiniMax. Main layer: Pretraining. Size: $9.5B, Mid. video, voice.

    Chinese lab with text models plus Hailuo video and speech models; listed in Hong Kong in 2026.

    Main layer: PretrainingSize: $9.5B, MidWebsiteSource

  • World Labs. Main layer: Pretraining. Also in: Apps. Size: $8.2B, Mid. Sale agreed to AMD, 2026. world.

    Fei-Fei Li's lab; builds 3D world models and sells them through the Marble product.

    Main layer: PretrainingAlso in: AppsSize: $8.2B, MidSale agreed to AMD, 2026WebsiteSource

  • Reflection AI. Main layer: Pretraining. Size: $8B, Mid.

    US lab building open-weight frontier models, backed by Nvidia.

    Main layer: PretrainingSize: $8B, MidWebsiteSource

  • Physical Intelligence. Main layer: Pretraining. Size: $5.6B, Mid. robotics.

    Trains the pi family of vision-language-action models for general robot control.

    Main layer: PretrainingSize: $5.6B, MidWebsiteSource

  • Runway. Main layer: Pretraining. Also in: Apps. Size: $5.3B, Mid. video, world.

    Video generation models and apps; training world models under the GWM-1 line.

    Main layer: PretrainingAlso in: AppsSize: $5.3B, MidWebsiteSource

  • Decart. Main layer: Pretraining. Also in: Inference. Size: $4B, Small. world, video.

    Real-time interactive video and world models, with its own inference stack.

    Main layer: PretrainingAlso in: InferenceSize: $4B, SmallWebsiteSource

  • Luma AI. Main layer: Pretraining. Also in: Apps. Size: $4B, Small. video.

    Trains the Ray video models and sells them through an app and API.

    Main layer: PretrainingAlso in: AppsSize: $4B, SmallWebsiteSource

  • Black Forest Labs. Main layer: Pretraining. Also in: Inference. Size: $3.3B, Small. image.

    Trains the FLUX image models and sells them by API.

    Main layer: PretrainingAlso in: InferenceSize: $3.3B, SmallWebsiteSource

  • Deepgram. Main layer: Pretraining. Also in: Inference. Size: $1.3B, Small. voice.

    Speech-to-text and voice-agent models sold by API.

    Main layer: PretrainingAlso in: InferenceSize: $1.3B, SmallWebsiteSource

  • Ai2. Main layer: Pretraining. Also in: Post-training. Size: —, Not sized.

    Nonprofit lab releasing fully open models (Olmo) and the Tulu post-training recipes.

    Main layer: PretrainingAlso in: Post-trainingSize: —, Not sizedWebsiteSource

  • Alibaba (Qwen). Main layer: Pretraining. Also in: Cloud and capital. Size: —, Not sized.

    Qwen open-weight model family, served on Alibaba Cloud.

    Main layer: PretrainingAlso in: Cloud and capitalSize: —, Not sizedWebsiteSource

  • ByteDance Seed. Main layer: Pretraining. Also in: Apps. Size: —, Not sized. video, image.

    Trains the Seedance video and Seedream image models, used in CapCut; part of ByteDance.

    Main layer: PretrainingAlso in: AppsSize: —, Not sizedWebsiteSource

  • Hume AI. Main layer: Pretraining. Size: —, Not sized. Technology licensed to Google, 2026. voice.

    Emotionally expressive speech models; Google DeepMind licensed its tech and hired its CEO.

    Main layer: PretrainingSize: —, Not sizedTechnology licensed to Google, 2026WebsiteSource

  • Midjourney. Main layer: Pretraining. Also in: Apps. Size: —, Not sized. image, video.

    Image and video generation product with its own models; licenses its technology to Meta.

    Main layer: PretrainingAlso in: AppsSize: —, Not sizedWebsiteSource

  • Poolside. Main layer: Pretraining. Also in: Power and sites. Size: —, Not sized.

    Trains coding models (Laguna) and is building a 2 GW datacenter campus.

    Main layer: PretrainingAlso in: Power and sitesSize: —, Not sizedWebsiteSource

  • PyTorch. Main layer: Pretraining. Also in: Inference. Size: —, Not sized.

    Open-source training framework hosted by the PyTorch Foundation; the default for most labs.

    Main layer: PretrainingAlso in: InferenceSize: —, Not sizedWebsiteSource

  • Stability AI. Main layer: Pretraining. Also in: Inference. Size: —, Not sized. image, video.

    Open image models (Stable Diffusion) plus video, audio and 3D models sold by API.

    Main layer: PretrainingAlso in: InferenceSize: —, Not sizedWebsiteSource

Post-training2 of 88

  • Thinking Machines Lab. Main layer: Post-training. Also in: Pretraining, Inference. Size: $12B, Mid.

    Tinker fine-tuning and RL API, plus the open-weight Inkling models.

    Main layer: Post-trainingAlso in: Pretraining, InferenceSize: $12B, MidWebsiteSource

  • Hugging Face. Main layer: Post-training. Also in: Data, Pretraining, Inference. Size: $11.9B, Mid. Sale agreed to Nvidia, 2026.

    Model and dataset hub; maintains Transformers and TRL and sells inference providers access.

    Main layer: Post-trainingAlso in: Data, Pretraining, InferenceSize: $11.9B, MidSale agreed to Nvidia, 2026WebsiteSource

  • Applied Compute. Main layer: Post-training. Size: $1.3B, Small.

    Builds custom RL-trained agents for enterprises.

    Main layer: Post-trainingSize: $1.3B, SmallWebsiteSource

  • Prime Intellect. Main layer: Post-training. Also in: Cloud and capital, Data, Pretraining. Size: $1B, Small.

    RL training platform with a GPU marketplace, an Environments Hub and INTELLECT models.

    Main layer: Post-trainingAlso in: Cloud and capital, Data, PretrainingSize: $1B, SmallWebsiteSource

  • Axolotl. Main layer: Post-training. Size: —, Not sized.

    Open-source framework for fine-tuning language models.

    Main layer: Post-trainingSize: —, Not sizedWebsiteSource

  • OpenPipe. Main layer: Post-training. Size: —, Not sized. Acquired by CoreWeave, 2025.

    RL fine-tuning for agents (ART); now CoreWeave's serverless RL product.

    Main layer: Post-trainingSize: —, Not sizedAcquired by CoreWeave, 2025WebsiteSource

  • Predibase. Main layer: Post-training. Also in: Inference. Size: —, Not sized. Acquired by Rubrik, 2025.

    Fine-tuning and multi-LoRA serving platform.

    Main layer: Post-trainingAlso in: InferenceSize: —, Not sizedAcquired by Rubrik, 2025WebsiteSource

  • Unsloth. Main layer: Post-training. Size: —, Not sized.

    Open-source library that speeds up fine-tuning and RL on a single GPU.

    Main layer: Post-trainingSize: —, Not sizedWebsiteSource

Inference7 of 1414

  • Cloudflare. Main layer: Inference. Also in: Data, Gateways and observability, Harness. Size: $129B, Large.

    Workers AI edge inference, AI Gateway, sandboxes and the Human Native data marketplace.

    Main layer: InferenceAlso in: Data, Gateways and observability, HarnessSize: $129B, LargeWebsiteSource

  • Fireworks AI. Main layer: Inference. Also in: Pretraining, Post-training. Size: $17.5B, Mid.

    Serverless inference and fine-tuning for open models; ships its own Ember-1 model.

    Main layer: InferenceAlso in: Pretraining, Post-trainingSize: $17.5B, MidWebsiteSource

  • Baseten. Main layer: Inference. Size: $13B, Mid.

    Inference platform for deploying open and custom models in production.

    Main layer: InferenceSize: $13B, MidWebsiteSource

  • Together AI. Main layer: Inference. Also in: Cloud and capital, Post-training. Size: $8.3B, Mid.

    Inference API for open models, GPU clusters and fine-tuning.

    Main layer: InferenceAlso in: Cloud and capital, Post-trainingSize: $8.3B, MidWebsiteSource

  • Groq. Main layer: Inference. Also in: Chips and memory, Cloud and capital. Size: $6.9B, Mid. Technology licensed to Nvidia, 2025.

    LPU inference cloud; Nvidia licensed its technology and hired its founder.

    Main layer: InferenceAlso in: Chips and memory, Cloud and capitalSize: $6.9B, MidTechnology licensed to Nvidia, 2025WebsiteSource

  • Modal. Main layer: Inference. Also in: Cloud and capital, Post-training, Harness. Size: $4.7B, Small.

    Serverless GPU compute for inference, fine-tuning and agent sandboxes.

    Main layer: InferenceAlso in: Cloud and capital, Post-training, HarnessSize: $4.7B, SmallWebsiteSource

  • fal. Main layer: Inference. Size: $4.5B, Small.

    Inference platform for image, video and audio generation models.

    Main layer: InferenceSize: $4.5B, SmallWebsiteSource

  • Modular. Main layer: Inference. Also in: Chips and memory. Size: $3.9B, Small. Acquired by Qualcomm, 2026.

    MAX hardware-agnostic inference engine and the Mojo language.

    Main layer: InferenceAlso in: Chips and memorySize: $3.9B, SmallAcquired by Qualcomm, 2026WebsiteSource

  • vLLM (Inferact). Main layer: Inference. Size: $800M, Small.

    Open-source inference engine; the team formed Inferact in 2026 to commercialise it.

    Main layer: InferenceSize: $800M, SmallWebsiteSource

  • SGLang (RadixArk). Main layer: Inference. Also in: Post-training. Size: $400M, Small.

    Open-source inference engine and Miles RL framework, commercialised as RadixArk.

    Main layer: InferenceAlso in: Post-trainingSize: $400M, SmallWebsiteSource

  • DeepInfra. Main layer: Inference. Size: —, Not sized.

    Low-cost API hosting for open-weight models.

    Main layer: InferenceSize: —, Not sizedWebsiteSource

  • llm-d. Main layer: Inference. Size: —, Not sized.

    Kubernetes-native distributed inference project from Red Hat, IBM, Google and CoreWeave, in the CNCF.

    Main layer: InferenceSize: —, Not sizedWebsiteSource

  • Ollama. Main layer: Inference. Size: —, Not sized.

    Tool for running open models locally, with a hosted cloud option.

    Main layer: InferenceSize: —, Not sizedWebsiteSource

  • Replicate. Main layer: Inference. Also in: Post-training. Size: —, Not sized. Acquired by Cloudflare, 2025.

    Run and fine-tune community models through one API; now part of Cloudflare Workers AI.

    Main layer: InferenceAlso in: Post-trainingSize: —, Not sizedAcquired by Cloudflare, 2025WebsiteSource

Gateways and observability4 of 88

  • Datadog. Main layer: Gateways and observability. Also in: Evals. Size: $105B, Large.

    Monitoring vendor with an LLM Observability product for tracing agents.

    Main layer: Gateways and observabilityAlso in: EvalsSize: $105B, LargeWebsiteSource

  • OpenRouter. Main layer: Gateways and observability. Also in: Inference. Size: $7.5B, Mid. Sale agreed to Stripe, 2026.

    One API and bill across hundreds of models and providers.

    Main layer: Gateways and observabilityAlso in: InferenceSize: $7.5B, MidSale agreed to Stripe, 2026WebsiteSource

  • Portkey. Main layer: Gateways and observability. Size: $117M, Small. Acquired by Palo Alto, 2026.

    AI gateway with routing, fallbacks, guardrails and spend controls.

    Main layer: Gateways and observabilitySize: $117M, SmallAcquired by Palo Alto, 2026WebsiteSource

  • Helicone. Main layer: Gateways and observability. Size: —, Not sized. Acquired by Mintlify, 2026.

    Open-source LLM observability proxy and gateway; in maintenance mode after the sale.

    Main layer: Gateways and observabilitySize: —, Not sizedAcquired by Mintlify, 2026WebsiteSource

  • Langfuse. Main layer: Gateways and observability. Also in: Evals. Size: —, Not sized. Acquired by ClickHouse, 2026.

    Open-source LLM tracing, evals and prompt management.

    Main layer: Gateways and observabilityAlso in: EvalsSize: —, Not sizedAcquired by ClickHouse, 2026WebsiteSource

  • LiteLLM. Main layer: Gateways and observability. Size: —, Not sized.

    Open-source proxy and SDK that calls many model providers through one interface.

    Main layer: Gateways and observabilitySize: —, Not sizedWebsiteSource

  • Martian. Main layer: Gateways and observability. Size: —, Not sized.

    Model router that picks the model for each request.

    Main layer: Gateways and observabilitySize: —, Not sizedWebsiteSource

  • Not Diamond. Main layer: Gateways and observability. Size: —, Not sized.

    Model router that selects the best model per prompt.

    Main layer: Gateways and observabilitySize: —, Not sizedWebsiteSource

Evals4 of 1010

  • Arena (LMArena). Main layer: Evals. Size: $1.7B, Small.

    Crowd-voted leaderboards that rank models by human preference.

    Main layer: EvalsSize: $1.7B, SmallWebsiteSource

  • Arize AI. Main layer: Evals. Also in: Gateways and observability. Size: $915M, Small. Sale agreed to Dynatrace, 2026.

    Enterprise eval and observability platform, plus the open-source Phoenix tracer.

    Main layer: EvalsAlso in: Gateways and observabilitySize: $915M, SmallSale agreed to Dynatrace, 2026WebsiteSource

  • Braintrust. Main layer: Evals. Also in: Gateways and observability. Size: $800M, Small.

    Evaluation and observability platform for LLM applications.

    Main layer: EvalsAlso in: Gateways and observabilitySize: $800M, SmallWebsiteSource

  • Promptfoo. Main layer: Evals. Size: $86M, Small. Sale agreed to OpenAI, 2026.

    Open-source eval and red-team command-line tool.

    Main layer: EvalsSize: $86M, SmallSale agreed to OpenAI, 2026WebsiteSource

  • Artificial Analysis. Main layer: Evals. Size: —, Not sized.

    Independent benchmarks of model quality, speed and price.

    Main layer: EvalsSize: —, Not sizedWebsiteSource

  • Epoch AI. Main layer: Evals. Also in: Power and sites. Size: —, Not sized.

    Research group that tracks AI compute, datacenters and benchmark results.

    Main layer: EvalsAlso in: Power and sitesSize: —, Not sizedWebsiteSource

  • Galileo. Main layer: Evals. Also in: Gateways and observability. Size: —, Not sized. Sale agreed to Cisco, 2026.

    Agent evals and guardrails built on small evaluator models.

    Main layer: EvalsAlso in: Gateways and observabilitySize: —, Not sizedSale agreed to Cisco, 2026WebsiteSource

  • Humanloop. Main layer: Evals. Size: —, Not sized. Shut down, closed Sep 2025.

    Early LLM eval and prompt-management platform; its team joined Anthropic in 2025.

    Main layer: EvalsSize: —, Not sizedShut down, closed Sep 2025WebsiteSource

  • METR. Main layer: Evals. Size: —, Not sized.

    Nonprofit that measures how long a task frontier agents can complete (time horizons).

    Main layer: EvalsSize: —, Not sizedWebsiteSource

  • Weights & Biases. Main layer: Evals. Also in: Post-training. Size: —, Not sized. Acquired by CoreWeave, 2025.

    Experiment tracking plus the Weave toolkit for LLM tracing and evals.

    Main layer: EvalsAlso in: Post-trainingSize: —, Not sizedAcquired by CoreWeave, 2025WebsiteSource

Harness3 of 1919

  • Temporal. Main layer: Harness. Size: $12.6B, Mid.

    Durable execution platform for long-running workflows and agents.

    Main layer: HarnessSize: $12.6B, MidWebsiteSource

  • Vercel. Main layer: Harness. Also in: Gateways and observability, Apps. Size: $9.3B, Mid.

    AI SDK, AI Gateway, Sandbox and Workflow for building agent apps.

    Main layer: HarnessAlso in: Gateways and observability, AppsSize: $9.3B, MidWebsiteSource

  • LangChain. Main layer: Harness. Also in: Gateways and observability, Evals. Size: $1.3B, Small.

    LangChain and LangGraph agent frameworks, with LangSmith for tracing and evals.

    Main layer: HarnessAlso in: Gateways and observability, EvalsSize: $1.3B, SmallWebsiteSource

  • Pinecone. Main layer: Harness. Size: $750M, Small.

    Managed vector database for retrieval.

    Main layer: HarnessSize: $750M, SmallWebsiteSource

  • Browserbase. Main layer: Harness. Size: $300M, Small.

    Hosted headless browsers and the Stagehand framework for web agents.

    Main layer: HarnessSize: $300M, SmallWebsiteSource

  • Arcade.dev. Main layer: Harness. Size: —, Not sized.

    Tool-calling and authorization platform for agents.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Browser Use. Main layer: Harness. Size: —, Not sized.

    Open-source library that lets agents control a web browser.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Chroma. Main layer: Harness. Size: —, Not sized.

    Open-source vector database; authors of the context-rot study.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Composio. Main layer: Harness. Size: —, Not sized.

    Managed tool integrations and authentication for agents.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • CrewAI. Main layer: Harness. Size: —, Not sized.

    Multi-agent orchestration framework.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Daytona. Main layer: Harness. Size: —, Not sized.

    Secure sandboxes for running AI-generated code.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • E2B. Main layer: Harness. Size: —, Not sized.

    Cloud sandboxes for running agent-generated code.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Letta. Main layer: Harness. Also in: Apps. Size: —, Not sized.

    Stateful agent platform with long-term memory; ships Letta Code.

    Main layer: HarnessAlso in: AppsSize: —, Not sizedWebsiteSource

  • LlamaIndex. Main layer: Harness. Size: —, Not sized.

    Framework and document-parsing tools for retrieval and agents.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Mastra. Main layer: Harness. Size: —, Not sized.

    TypeScript agent framework with memory, evals and a studio.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Mem0. Main layer: Harness. Size: —, Not sized.

    Memory layer that stores and recalls user context for agents.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Pydantic AI. Main layer: Harness. Also in: Gateways and observability. Size: —, Not sized.

    Typed Python agent framework from the Pydantic team, paired with Logfire tracing.

    Main layer: HarnessAlso in: Gateways and observabilitySize: —, Not sizedWebsiteSource

  • turbopuffer. Main layer: Harness. Size: —, Not sized.

    Serverless vector and full-text search built on object storage.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

  • Weaviate. Main layer: Harness. Size: —, Not sized.

    Open-source vector database.

    Main layer: HarnessSize: —, Not sizedWebsiteSource

Apps1 of 2121

  • Cursor. Main layer: Apps. Also in: Harness. Size: $60B, Large. Acquired by SpaceX, 2026.

    AI coding editor and agents; SpaceX closed its roughly $60B purchase in August 2026.

    Main layer: AppsAlso in: HarnessSize: $60B, LargeAcquired by SpaceX, 2026WebsiteSource

  • Cognition. Main layer: Apps. Size: $48B, Mid.

    Maker of the Devin coding agent; bought Windsurf in 2025.

    Main layer: AppsSize: $48B, MidWebsiteSource

  • Perplexity. Main layer: Apps. Size: $20B, Mid.

    Answer engine with the Comet browser and agents.

    Main layer: AppsSize: $20B, MidWebsiteSource

  • Sierra. Main layer: Apps. Size: $15.8B, Mid.

    Customer-service agents for large companies.

    Main layer: AppsSize: $15.8B, MidWebsiteSource

  • Harvey. Main layer: Apps. Size: $15.5B, Mid.

    AI assistant for law firms and legal teams.

    Main layer: AppsSize: $15.5B, MidWebsiteSource

  • Lovable. Main layer: Apps. Size: $13.3B, Mid.

    Prompt-to-app builder for non-developers.

    Main layer: AppsSize: $13.3B, MidWebsiteSource

  • Replit. Main layer: Apps. Also in: Cloud and capital. Size: $9B, Mid.

    Browser IDE and agent that builds and hosts apps.

    Main layer: AppsAlso in: Cloud and capitalSize: $9B, MidWebsiteSource

  • Glean. Main layer: Apps. Also in: Harness. Size: $7.2B, Mid.

    Enterprise search and an agent platform over company data.

    Main layer: AppsAlso in: HarnessSize: $7.2B, MidWebsiteSource

  • Abnormal AI. Main layer: Apps. Size: $5.1B, Mid.

    AI email-security platform that detects phishing and account takeover from behavior.

    Main layer: AppsSize: $5.1B, MidWebsiteSource

  • Decagon. Main layer: Apps. Size: $4.5B, Small.

    Customer-support agents for enterprises.

    Main layer: AppsSize: $4.5B, SmallWebsiteSource

  • Manus. Main layer: Apps. Size: ~$4B, Small.

    General-purpose AI agent product; China blocked Meta's 2025 purchase and it runs independently.

    Main layer: AppsSize: ~$4B, SmallWebsiteSource

  • Character.ai. Main layer: Apps. Size: $1B, Small.

    Consumer companion chat app; barred under-18s from open-ended chat in 2025.

    Main layer: AppsSize: $1B, SmallWebsiteSource

  • LiveKit. Main layer: Apps. Also in: Harness. Size: $1B, Small.

    Realtime voice and video infrastructure and the Agents framework for voice agents.

    Main layer: AppsAlso in: HarnessSize: $1B, SmallWebsiteSource

  • Plaud. Main layer: Apps. Size: >$1B, Small. voice.

    AI voice recorder hardware with an app that transcribes and summarizes recordings.

    Main layer: AppsSize: >$1B, SmallWebsiteSource

  • Bolt.new. Main layer: Apps. Size: $700M, Small.

    Browser-based app builder from StackBlitz.

    Main layer: AppsSize: $700M, SmallWebsiteSource

  • Vapi. Main layer: Apps. Also in: Harness. Size: $500M, Small.

    Developer platform for building phone and voice agents.

    Main layer: AppsAlso in: HarnessSize: $500M, SmallWebsiteSource

  • CopilotKit. Main layer: Apps. Also in: Harness. Size: —, Not sized.

    Generative-UI framework and maker of the AG-UI agent-to-frontend protocol.

    Main layer: AppsAlso in: HarnessSize: —, Not sizedWebsiteSource

  • GitHub. Main layer: Apps. Size: —, Not sized.

    Home of GitHub Copilot, the IDE assistant and cloud coding agent; part of Microsoft.

    Main layer: AppsSize: —, Not sizedWebsiteSource

  • Retell AI. Main layer: Apps. Also in: Harness. Size: —, Not sized. voice.

    Platform for building, testing and deploying AI voice agents that handle phone calls.

    Main layer: AppsAlso in: HarnessSize: —, Not sizedWebsiteSource

  • Telnyx. Main layer: Apps. Also in: Inference. Size: —, Not sized. voice.

    Phone and messaging platform with voice-AI agents and inference on its own GPUs.

    Main layer: AppsAlso in: InferenceSize: —, Not sizedWebsiteSource

  • Thesys. Main layer: Apps. Also in: Harness. Size: —, Not sized.

    Generative-UI API (OpenUI Cloud) that returns interface components from models.

    Main layer: AppsAlso in: HarnessSize: —, Not sizedWebsiteSource

Nothing matches these filters.

As of 2026-10-12

Each bar is the run of layers a company sells into, and the solid cell is its main layer. Long bars are companies that span the stack.Source: company sites and deal announcements, linked from each row.

How to read it

The main layer is where I judge a company to be strongest, by what it is known for and what it mostly sells. The tinted cells are other layers it sells into. A badge marks a deal: → and the buyer for an acquisition, drawn dashed while the sale is agreed but not closed, ↝ and the licensee for a licence-and-hire deal, and shut for a company that closed. Open any row for a one-line note and the source behind the placement.

Rows inside each layer are sorted by size. I use market cap for public companies, the last reported valuation for private ones, the deal price for acquired ones, and the parent's market cap for divisions such as AWS. Large is $50B and up, mid is $5–50B, and small is under $5B. 54 rows are not sized: 45 private companies that have not published a valuation, six non-profits or open projects, and three units of larger companies, whose notes name the parent. They show a dash instead of an estimate.

The selection is for relevance, not completeness. Every layer has at least six companies, and pretraining has the most (31) because each model type has its own labs. I picked several companies because of their deals, so the 19 rows carrying a deal badge are a list, not a rate. The data is a YAML file in the site's repository, and corrections are welcome as issues or pull requests.

Size and span go together. Eleven companies sell into four or more layers, and eight of them are worth more than $50B. The exceptions are Hugging Face, which Nvidia agreed to buy, Modal and Prime Intellect.

Chipmakers are moving up

Nvidia has the longest bar. Its main layer is chips, but it also sells networking, a GPU cloud, open models in the Nemotron family, the NeMo training stack and the Dynamo serving stack. It went further up in the last ten months. It licensed Groq's inference-chip design and hired its founders in December 2025 (Groq). It bought SchedMD, the company behind the Slurm scheduler, the same month (Nvidia). And it agreed to buy Hugging Face, where developers pick open models.

AMD is following the same path from a smaller base. It agreed to buy Taalas, an inference-chip startup, in August (AMD) and World Labs in September. Qualcomm bought Modular, which makes a hardware-neutral inference engine (NAND Research).

My read is that the chipmakers' largest customers are now also their competitors. Google has TPUs, AWS has Trainium, Microsoft has Maia, and OpenAI is co-designing accelerators with Broadcom (OpenAI). A chip vendor stays the default by owning the software and the places where developers choose models, so a customer who switches chips loses more than the chip.

Inference clouds are moving into training

The serving layer's bars stretch left, into post-training. Together AI, Fireworks AI and Modal all sell fine-tuning beside inference. Fireworks released its own model, Ember-1, post-trained from Kimi K3 to use fewer reasoning tokens (Vercel). CoreWeave, a GPU cloud, bought Weights & Biases (CoreWeave) and OpenPipe, whose RL fine-tuning now runs as a CoreWeave product (CoreWeave). Thinking Machines came from the other side: it is a lab whose fine-tuning API, Tinker, now also serves its own Inkling model (Thinking Machines).

The price of a token at fixed capability falls 9–900× a year (Epoch), so serving someone else's open model is the part of this layer that gets cheaper fastest. My read is that a model tuned on a customer's data keeps the customer where it was trained, and that matters more now OpenAI is leaving the market. It stopped admitting new organisations to self-serve fine-tuning in May and stops new jobs in January 2027 (OpenAI).

Tooling is being absorbed by the platforms it plugs into

Gateways, tracing and evals changed hands faster than any other part of the chart:

Company What it did Buyer What the buyer already sells
Weights & Biases Experiment tracking and evals CoreWeave, 2025 GPU cloud
Langfuse Open-source tracing ClickHouse, 2026 (ClickHouse) Analytics database
Helicone Gateway and observability Mintlify, 2026 (Mintlify) Documentation platform
Promptfoo Evals and red-teaming OpenAI, agreed 2026 (OpenAI) Models and an agent platform
Portkey AI gateway Palo Alto Networks, 2026 (Palo Alto) Security
Galileo Agent evals and guardrails Cisco, agreed 2026 (Cisco) Networking and security
Arize Evals and tracing Dynatrace, agreed 2026, $915M Application monitoring
OpenRouter Model router Stripe, agreed 2026 Payments

Seven of the eight buyers already sold something that sits on the same request path: a database the traces land in, a monitor that watches the app, a firewall in front of it, or the payment behind it. The exception is Mintlify, a documentation platform, which put Helicone into maintenance mode after the sale (Mintlify). In the roadmap I called this layer a side rail rather than a layer, because nothing above it consumes what it produces. That is also why it is hard to sell alone. A trace or a gateway is valuable to whoever already owns the path, and that is who bought them.

Labs are stretching both ways

The frontier labs started at pretraining and now reach in both directions. OpenAI leads the Stargate sites, is co-designing a chip with Broadcom, and ships ChatGPT and Codex on top. SpaceX now covers power (Colossus 2 runs on its own turbines (Cleanview)), a cluster it rents to other labs, the Grok models, and Cursor. Google's bar covers chips, cloud, models, an agent SDK and the Gemini app, and it was already that long before 2025.

The labs also buy what their own products depend on. Anthropic bought Bun, the JavaScript runtime that Claude Code runs on (Bun), and Meta paid more than $14B for 49% of Scale AI (Wikipedia).

What is still independent

Three groups have stayed mostly on their own so far:

  • Data vendors. Surge, Mercor and Handshake sell expert data and RL tasks to every lab at once, and owning one would cost a lab the others' business.
  • Model labs for one modality. ElevenLabs in voice, Black Forest Labs in images and Runway in video are still independent. The exceptions are World Labs, which AMD agreed to buy, and Hume, whose team and technology Google DeepMind took in a licence-and-hire deal (TechCrunch).
  • Harness infrastructure. Sandboxes (E2B, Daytona), browser infrastructure (Browserbase) and vector databases (Pinecone, turbopuffer) are still standalone.

My prediction is that harness infrastructure goes the way tracing did. A sandbox or a hosted browser is a feature of whoever runs the agent, the same way a trace is a feature of whoever runs the request. Modal already sells sandboxes beside inference, and the labs already ship hosted agents with their own computers. That is a guess, and the chart's next revision will show whether it held.

What I would do with this

If you are choosing a vendor in any of these layers, assume it may belong to its neighbour within a year. Before I signed, I would check three things. First, whether the data export works today, not on the roadmap. Second, whether the product is open source or self-hostable: Langfuse and Arize's Phoenix are, which made their sales much less risky for the people using them. Third, what the likely buyer already sells, because after a sale the product gets pushed toward whatever that company sells.

Published 12 October 2026. Revised in place rather than reposted — the date above is the one that matters.

Related

Markdown source for this article: /raw/who-builds-the-ai-stack.md