AMD
AMD: The Really Good Racecar That Keeps Losing Because the Track Was Built for Someone Else
Based on 135 related nodes across 10 research explorations in the semiconductors sector.
AMD makes some of the best chips in the world. Their latest AI processors are objectively better than their main competitor’s on several key measures. And yet AMD keeps losing. Understanding why tells you almost everything important about how the AI chip industry actually works — and why being technically superior is not the same as winning.
The Sport AMD Is Playing In
Imagine the AI chip industry as a professional racing league. NVIDIA built the track, wrote the rules, and trained all the mechanics. Their cars are good — not always the fastest on paper — but every pit crew in the world knows how to work on them. AMD shows up with a faster car. Wider. More fuel capacity. Better on long straight stretches. But here’s the problem: the pit crews only know NVIDIA’s car. The trackside software only talks to NVIDIA’s telemetry system. The training schools only teach NVIDIA mechanics. AMD’s car sits in the paddock looking impressive while NVIDIA’s cars keep winning races.
That is the AMD situation in AI chips, in 2026, more or less exactly.
What AMD Actually Does Well
Their Memory Advantage Is Real
The most concrete thing AMD has going for it is memory — specifically, how much memory their AI chips carry and how fast they can move data in and out of it.
Here is why this matters. Modern AI models, especially when they are generating text or answering questions (rather than being trained from scratch), spend most of their time shuffling enormous tables of numbers called a “KV cache” back and forth through memory. The bigger the context window — meaning the more of a conversation the AI can “remember” at once — the bigger this table gets, and the more memory bandwidth you need to handle it.
AMD’s MI300X chip carries 192 gigabytes of high-bandwidth memory, moving data at 5.3 terabytes per second. NVIDIA’s H100, which was the gold standard until recently, carries 80 gigabytes at 3.35 terabytes per second. AMD has more than twice the memory at a meaningfully faster speed. For the specific job of running AI inference — serving answers to users — this is a genuine, measurable advantage.
The non-obvious part: this advantage is not static. It is growing in importance because context windows keep getting longer. The longer the context window, the more AMD’s memory lead matters. AMD’s roadmap also shows this advantage continuing into future generations (the MI350X and MI400), so it is not a one-time lucky spec win.
The Inference Market Is AMD’s Territory
AI work splits into two phases: training (teaching the model from scratch, which takes months and enormous compute) and inference (actually using the trained model to answer questions, which happens billions of times a day). These two phases have very different hardware requirements.
Training is locked up. NVIDIA built a software ecosystem called CUDA over 19 years that makes their chips by far the easiest to use for training. All the best training software, all the optimized algorithms, all the researcher habits — they are written for NVIDIA. This is not changing anytime soon.
But inference is different. Inference workloads do not need CUDA’s specialized training toolkit nearly as much. They need memory bandwidth and memory capacity — which is exactly where AMD excels. The inference market is genuinely more open to alternatives. This is the only realistic competitive space AMD has against NVIDIA, and it is a large and growing one as AI gets deployed at scale.
Why AMD Keeps Not Winning Despite Good Hardware
The Software Gap Is the Real Problem
AMD’s hardware advantage has a very clear enemy: software friction. Developers who want to use AMD chips instead of NVIDIA chips have to rewrite or port significant amounts of their code. NVIDIA’s CUDA ecosystem — their programming tools, their libraries, their optimizations — took nearly two decades to build. AMD’s equivalent (called ROCm) is improving but is not there yet.
The result is a paradox that the research data captures directly: AMD’s MI300X is objectively superior on inference hardware specs, and yet it is not taking over the inference market. The reason is that moving from NVIDIA to AMD requires engineering effort that most teams cannot justify unless the cost savings are overwhelming. Software friction is invisible on a spec sheet but very visible when your engineering team has to spend six months porting code.
Intel’s Gaudi3 chip is a cautionary example. It also had competitive hardware specs for AI inference. It also lacked software ecosystem depth. It is now effectively dead in the market. The research data explicitly flags this as a warning for AMD — hardware is necessary but not sufficient.
The Supply Chain AMD Does Not Control
Here is something that does not show up in chip spec comparisons: AMD does not make its own chips. Neither does NVIDIA. Both companies design chips and then pay TSMC in Taiwan to manufacture them.
This creates a structural vulnerability that affects AMD regardless of how good its engineers are. There is essentially one company in the world that can manufacture leading-edge AI chips at scale: TSMC. And there is essentially one place in the world where the most critical step in that process — advanced chip packaging, called CoWoS — is done: Taiwan. AMD has no backup plan for this. Neither does NVIDIA. But it means AMD’s fate is partially in the hands of a geopolitical situation it cannot influence.
Additionally, the high-bandwidth memory that makes AMD’s chips good comes primarily from one company in South Korea (SK Hynix, which controls about 62% of this specialized memory market). AMD’s memory advantage depends on a supply chain that is geographically concentrated and subject to government restrictions. Export controls on this type of memory have already been imposed and could tighten further.
The China Question
Export controls — government restrictions on selling advanced chips to China — have created an unusual commercial opportunity for AMD. Under current US policy, AMD can sell a slightly downgraded version of its AI chip (called the MI308) to Chinese customers, paying 15% of that revenue to the US Treasury as a kind of trade tax. NVIDIA’s China-market chip was under tighter restrictions for longer.
This gives AMD a revenue stream in a market that is hungry for AI compute and short on alternatives. Huawei makes competing chips inside China, but AMD’s MI308 still appears to be a viable option for Chinese AI companies. Whether this revenue is material or modest depends on factors not fully captured in the available research, but the access itself is a comparative advantage over the period when NVIDIA’s equivalent was restricted.
The Clock Is Ticking
AMD has a time window that matters. NVIDIA’s next-generation architecture, called Vera Rubin, is expected in the second half of 2026. It will carry 288 gigabytes of next-generation memory at 22 terabytes per second — directly targeting the memory bandwidth gap that AMD has been exploiting.
Once Vera Rubin ships at volume, AMD’s current memory advantage narrows or closes at the top of the market. This gives AMD roughly 12 to 18 months to do something with its current lead: sign up customers, build reference deployments, develop software integrations, create switching costs. If AMD can get enough inference workloads running on its hardware during this window, those customers will face their own switching costs to move away — just as NVIDIA’s customers face switching costs moving away from CUDA. Installed base creates inertia in both directions.
The window is real but the clock is running.
The Longer-Term Pressure AMD Did Not Create
There is a force in the background that could eventually shrink AMD’s market opportunity regardless of what AMD does: the big cloud companies building their own chips.
Google, Amazon, Meta, and Microsoft are all investing heavily in custom-designed silicon — chips built specifically for their own AI workloads. These are not general-purpose AI chips you can buy. They are internal tools, designed to squeeze maximum efficiency from the specific models and workloads these companies run. As this trend accelerates, the pool of hyperscaler customers buying chips from AMD (or NVIDIA) instead of making their own shrinks.
This is a slow-moving structural pressure, not an immediate crisis. The custom chip programs are expensive, take years to mature, and are most effective for stable, high-volume workloads. But it means AMD’s long-term ceiling in the hyperscaler inference market is lower than it might appear today.
One Non-Obvious Finding Worth Noting
The rise of efficient AI architectures — models designed to do more with less compute, like the DeepSeek family — turns out to be structurally good for AMD in a specific way. These models are particularly sensitive to memory bandwidth and memory capacity, not raw compute power. They amplify AMD’s hardware advantages rather than neutralizing them.
This is counterintuitive. You might expect that “better, cheaper AI” helps NVIDIA because NVIDIA has more market share to benefit from a rising tide. But the specific shape of efficient-architecture workloads happens to favor AMD’s hardware profile. The research data captures this directly, calling it the “DeepSeek-AMD Memory Resonance Effect.” Whether AMD converts this structural alignment into actual customer wins is a separate question — but the underlying alignment is real.
Bottom Line
AMD is a company with genuine hardware advantages trapped in a market that was built by and for its main competitor. The chips are good. On the specific task of running AI inference workloads — serving AI answers to users at scale — AMD’s memory specifications are competitive or superior. The company has a real product, a real roadmap, and a real commercial opening.
The central problem is that technical merit has never been sufficient in this market. NVIDIA’s competitive advantage is not just good hardware; it is nearly two decades of software infrastructure that makes switching expensive. AMD’s highest-leverage action is investing in closing the software gap (ROCm, their programming toolkit), because that is the only path to converting hardware quality into market share. Everything else — better chips, lower prices, memory bandwidth leads — has been tried and found insufficient without the software layer.
The next 18 months matter more than usual. AMD has a window of hardware advantage before NVIDIA’s next generation closes it. The question is whether AMD can use that window to build the kind of installed base and software depth that creates its own switching costs. If it does, it becomes a durable #2 in AI inference. If it does not, it remains a very capable company perpetually described in terms of what it almost achieved.