Lesson 5 of 6

Licensing & Economics

Patent pools, royalty stacking, and the billion-dollar war over video

In 2019, Apple paid approximately $2.7 billion in royalties for a single video codec β€” H.264. Not for development, not for engineering β€” just for the right to use the compression technology in iPhones, iPads, and Macs. This wasn't unique to Apple. Every smartphone manufacturer, TV maker, streaming service, and browser vendor navigates a labyrinth of thousands of essential patents held by hundreds of companies, organized into competing patent pools, each demanding their slice. The result is a hidden tax on video that reshapes entire technology markets.
TL;DR

Video codecs are governed by a complex web of patents. MPEG LA's H.264 pool was a well-oiled machine (~$0.20/device), but H.265/HEVC fractured into three competing pools with uncertain royalty stacking. Google's VP9 and the Alliance for Open Media's AV1 broke the mold with royalty-free models, while the next generation (VVC/H.266) threatens to repeat the H.265 disaster. These licensing decisions affect everything from browser support to hardware design to streaming CDN costs.

The Problem: A Thicket of Patents

Modern video codecs are complex β€” so complex that no single company holds all the essential patents. A single video standard may implicate thousands of essential patents from hundreds of patent holders spread across dozens of countries.

10,000+ Patents essential to H.265/HEVC
50+ Companies claiming essential patents for HEVC
3 Competing patent pools for HEVC alone
$1B+ Annual video codec patent royalty payments

The core problem is royalty stacking: if twenty different companies each demand $0.10 per device, the total royalty exceeds the profit margin on the device itself. Without coordinated licensing, the transaction costs alone β€” negotiating individual licenses with hundreds of patent holders β€” would be crippling.

Royalty stacking in action: For early H.265/HEVC devices, the cumulative royalty from all three pools could reach $1.60–$2.00 per device β€” roughly 10Γ— the cost of H.264 licensing. This uncertainty caused many hardware vendors to delay HEVC support and accelerated interest in royalty-free alternatives.

MPEG LA & the Patent Pool Model

The patent pool was the solution. Instead of negotiating with hundreds of patent holders individually, a neutral administrator bundles patents into a single license. The most famous administrator is MPEG LA (now Via Licensing Alliance), which pioneered the modern video codec patent pool.

How it works: Patent holders contribute their essential patents to the pool. In exchange, they receive a share of royalty revenue. Licensees pay one fee and receive rights to all patents in the pool. The pool administrator handles enforcement against unlicensed users and distributes royalties proportionally.

The model is brilliant in theory: one-stop shopping, transparent pricing, reduced litigation. In practice, it works well when there's a single dominant pool. When multiple pools compete for the same standard, the model breaks down β€” a lesson H.265 would teach the industry the hard way.

πŸ—ΊοΈ The Patent Pool Landscape (Timeline)
2003 MPEG LA β†’ H.264 pool launched
2010 VP8 β†’ Google goes royalty-free
2011 Nokia vs Apple patent war
2013 HEVC β†’ MPEG LA pool established
2015 HEVC Advance pool formed
2017 Velos Media β€” 3rd HEVC pool
2018 AV1 released β€” royalty-free
2023 AV2 project begins (royalty-free)
2024+ VVC pools forming

The patent landscape has fractured over time, with royalty-free options gaining momentum as pool fragmentation creates uncertainty.

H.264 / AVC β€” The Gold Standard

The H.264 patent pool managed by MPEG LA is arguably the most successful technology licensing program in history. It established a predictable, affordable model that enabled the entire streaming video industry.

H.264 license terms (as of the pool's peak):

The annual cap was crucial. It meant that after a certain volume, the marginal cost of adding H.264 support became zero. This gave large manufacturers like Apple, Samsung, and Sony the confidence to build H.264 into billions of devices. The caps also made H.264 essentially free for content distributors β€” Netflix, YouTube, and Amazon could stream H.264 without per-stream royalty obligations.

Why it worked: H.264's licensing succeeded because there was one pool with clear terms and sane caps. Patent holders understood that reasonable licensing was better than no licensing. This consensus collapsed with the next generation.

H.265 / HEVC β€” The Licensing Disaster

If H.264 licensing was a well-designed highway, H.265 licensing was a demolition derby. The standard promised 50% better compression than H.264, but the licensing uncertainty nearly killed its adoption.

Three Competing Pools

πŸ”΅ MPEG LA (HEVC)

~$0.20/device, capped at ~$25M/year. The "traditional" pool with ~30+ patent holders including Samsung, Philips, and GE.

🟠 HEVC Advance

Started at $1.20/device (later reduced). Included Dolby, GE, Mitsubishi. Initially had no cap, later added a $40M cap.

πŸ”΄ Velos Media

Launched 2017 by Ericsson, Panasonic, Qualcomm, Sharp. Added another layer of royalty obligations.

A device manufacturer implementing HEVC potentially had to pay all three pools β€” and it was unclear whether the pools covered all essential patents. Some patent holders (like Nokia and Siemens) held out entirely, demanding separate licenses.

Royalty stacking uncertainty: Combined HEVC licensing could theoretically cost $1.60–$2.00+ per device β€” with no guarantee that additional claims wouldn't surface later. For low-margin devices like a $30 streaming stick, this royalty alone could represent 5–7% of the device cost.

The result: adoption paralysis. Apple added HEVC decode in 2017 (iOS 11, macOS High Sierra) but only for their own ecosystem. Android device makers delayed HEVC hardware for years. Netflix and YouTube used HEVC selectively. The licensing mess was arguably the single biggest factor driving the industry toward royalty-free alternatives.

Compare compression efficiency vs. licensing cost: the RD curve below visualizes why a 50% bitrate savings matters, but only if you can actually deploy the codec at scale.

VP8 & VP9 β€” Google's Royalty-Free Gambit

In 2010, Google acquired On2 Technologies and with it the VP8 codec. They released VP8 as royalty-free β€” an explicit challenge to the MPEG LA licensing model. VP8's compression wasn't competitive with H.264, but the principle was established.

VP9 followed in 2013, and this was the game-changer. VP9 offered compression approaching HEVC's efficiency β€” completely free of patent royalty obligations. Google's strategy had three components:

VP9's market impact: By 2020, VP9 accounted for ~40% of all video streaming traffic (mostly YouTube and some Netflix streams). It proved that a royalty-free codec could achieve widespread adoption if backed by a sufficiently large ecosystem player.

The catch: VP9 had no hardware decode support in most devices for years. Apple never added VP9 hardware decoding to their chips (they bet on HEVC). This meant VP9 playback on iPhones/iPads required software decoding β€” draining battery and limiting adoption on those platforms.

AV1 β€” The Alliance for Open Media

The Alliance for Open Media (AOMedia) was founded in 2015 by Amazon, Cisco, Google, Intel, Microsoft, Mozilla, and Netflix. Their mission: build a next-generation, royalty-free video codec that would match or exceed HEVC's compression without the licensing nightmare.

AV1 was released in 2018. Its patent model is unique:

This is why AV1 is different: It's not just "free for now." It's structurally designed to remain royalty-free through defensive patent aggregation and cross-licensing among the largest tech companies in the world. A third party trying to charge AV1 royalties would face patent countersuits from Google, Microsoft, Amazon, Apple, and Netflix simultaneously.

AV1's compression efficiency is impressive β€” about 30% better than HEVC and 50% better than H.264. But it came at a cost: AV1 encoding is computationally expensive, requiring 10–100Γ— more CPU time than HEVC encoding. Hardware decoding support is growing but still trails HEVC.

AV2 β€” Continuing the Royalty-Free Tradition

The AOMedia is already developing AV2, the successor to AV1, with a target of 30% additional compression gains over AV1. AV2 continues the same royalty-free licensing model established by AV1.

The AV2 project incorporates ideas from both traditional block-based coding and emerging neural network-based approaches. It's expected to be finalized around 2026–2027, with hardware decode becoming mainstream in the late 2020s.

The AOMedia ecosystem: Apple joined AOMedia in 2018 and contributed patents. Apple's H.264/HEVC bet is still dominant on their platforms, but they've also added AV1 hardware decode in the M3 and A17 Pro chips. This signals that even the most proprietary platform is preparing for a royalty-free future.

Cisco's OpenH264 β€” A Clever Licensing Workaround

In 2013, Cisco did something remarkable: they published the H.264 encoder/decoder source code as open source (BSD-licensed) and agreed to pay the MPEG LA royalties on behalf of anyone who used their binary module. Mozilla adopted Cisco's OpenH264 binary for Firefox, solving the H.264 support problem without Firefox having to license the patents.

How it works: Cisco builds the binaries, pays MPEG LA the ~$0.20/device royalty (for desktop software) from their own end, and distributes the binary. Firefox downloads the Cisco-signed binary plugin and uses it for H.264 playback. Firefox never has to license H.264 patents β€” Cisco's license covers all users of the binary.

This was a clever legal hack that solved a real problem: Mozilla couldn't afford H.264 licensing, but Firefox needed H.264 support to play web video. Cisco's solution β€” pay the pool on behalf of the entire open-source ecosystem β€” was a stopgap that demonstrated both the problem with the licensing model and a potential path forward.

OpenH264 only covers the baseline profile of H.264, with limited compression options. It's not a full codec β€” it's a legal bridge that allowed open-source browsers to keep up while the industry transitioned to royalty-free alternatives.

Impact on Browsers β€” The Codec Wars

Browser support for video codecs has been heavily influenced by licensing economics:

Browser H.264 H.265/HEVC VP9 AV1
Chrome βœ… (since 2011) ⚠️ (platform-dependent) βœ… (native) βœ… (native)
Firefox βœ… (via OpenH264) ❌ (no support) βœ… (native) βœ… (native)
Safari βœ… (native) βœ… (native, macOS/iOS) ❌ (no support) ⚠️ (M3+, A17 Pro+)
Edge βœ… (native) βœ… (Win, platform) βœ… (native) βœ… (native)

The pattern is clear: browsers aligned with companies that had favorable licensing positions. Google (Chrome) pushed VP9 and AV1 aggressively. Mozilla (Firefox) used the OpenH264 hack and embraced VP9/AV1. Apple (Safari) stuck with the licensed MPEG codecs their hardware supported and was slow to adopt royalty-free options. Microsoft (Edge) eventually followed Google after switching to Chromium.

The Roku effect: Streaming devices like Roku and Apple TV make browser-level codec decisions. Roku supports H.264, HEVC, and VP9 (selectively). Apple TV supports H.264 and HEVC but not VP9 or AV1. These choices are driven by hardware decode availability and licensing costs, not technical merit.

CDN Cost Implications β€” The Billion-Dollar Savings

Every bit of compression improvement directly reduces Content Delivery Network (CDN) costs. For the largest streaming platforms, even a 1% bitrate reduction saves millions of dollars annually.

πŸ“ˆ Rate-Distortion: The ROI of Better Compression

Each curve shows the quality (PSNR) achievable at a given bitrate. A "higher" curve means better compression efficiency β€” directly translating to lower streaming costs for the same quality. The gap between H.264 and AV1 can represent a 40–50% reduction in CDN bills.

~$15B Netflix's estimated cumulative CDN savings from codec improvements (2015–2030)
35% Bitrate reduction from H.264 to HEVC at equivalent quality
50% Bitrate reduction from H.264 to AV1 at equivalent quality
~$1B YouTube's estimated annual CDN cost (codec choice matters enormously)

For Netflix, moving from H.264 to HEVC saved roughly 35% on bandwidth. Moving to AV1 saves an additional ~15–20% over HEVC. With Netflix spending an estimated $1–2 billion annually on CDN bandwidth, these percentage improvements translate to hundreds of millions in savings. This is why Netflix was a founding member of AOMedia and aggressively pushed AV1 adoption β€” despite AV1's encoding cost, the CDN savings dwarf the compute cost.

The math: If AV1 saves Netflix $200M/year in CDN costs, and encoding costs increase by $30M/year (more compute for AV1 encoding), the net benefit is $170M/year. Over a decade, that's $1.7B β€” more than enough incentive to fund the entire codec development effort many times over.

Content Creation Licensing

Licensing isn't just for playback devices β€” it also affects content production. Professional video production tools that encode video must license the codecs they use:

The open-source pain point: Open-source video tools like FFmpeg cannot include patented codecs by default in many jurisdictions. Users must build from source with patent-encumbered codecs enabled, or rely on third-party binary distributions (like VLC's codec packages). This creates friction for open-source video workflows.

Codec Licensing Cost Comparison

Codec Royalty per Device Annual Cap License Pools Free for Content
H.264 / AVC ~$0.20 ~$6.5M MPEG LA Yes (after 100K subs)
H.265 / HEVC ~$1.20+ Varies MPEG LA, HEVC Advance, Velos Yes (after 500K subs)
VP8 / VP9 $0 N/A None Yes
AV1 $0 N/A None Yes
VVC / H.266 TBD (likely $1+) TBD MPEG LA + others TBD
EVC (MPEG-5) Lower than H.265 TBD Simplified TBD

The gap in this table tells the whole story. Royalty-free codecs (VP9, AV1) eliminate licensing friction entirely. The traditional licensed codecs (H.264, H.265) impose per-device taxes that shape hardware and software decisions. The next generation (VVC, EVC) remains uncertain β€” and the industry is voting with its feet.

Patent Litigation Landscape

Video codecs have generated some of the most expensive patent litigation in technology history. Here are the landmark cases:

βš”οΈ Nokia vs Apple (2011)

Nokia sued Apple over H.264 essential patents. Apple countersued. Settlement: Apple paid a lump sum + ongoing royalties, widely reported as ~$600M.

βš”οΈ Broadcom vs Qualcomm (2009)

Broadcom alleged Qualcomm's H.264 licensing violated antitrust commitments. Qualcomm paid $891M to settle β€” one of the largest patent settlements ever.

βš”οΈ Nokia vs HTC (2012–2014)

Nokia won injunctions against HTC in multiple countries over video encoding patents. HTC ultimately exited the smartphone market β€” licensing costs were one factor among many.

βš”οΈ Sisvel vs Xiaomi (2020+)

Patent assertion entity Sisvel pursued Xiaomi over H.265/HEVC patents in multiple jurisdictions. Ongoing β€” typical of the post-HEVC litigation wave.

Patent assertion entities (PAEs): Also called "patent trolls," these companies don't make products β€” they buy patents and sue implementers. Video codec patents are a favorite target because codecs are essential to billions of devices. A single PAE with one obscure essential patent can demand licensing fees from the entire smartphone industry.

The litigation landscape is a major reason why the defensive patent aggregation model of AOMedia is so attractive. By pooling patent commitments from the largest tech companies, AOMedia creates a mutual assured destruction scenario: anyone who sues an AV1 implementer faces counterclaims from the combined patent arsenal of Google, Microsoft, Amazon, Apple, Netflix, and others.

Per-Unit Royalties and Hardware Decisions

Per-unit royalties have a profound effect on hardware design decisions, especially for low-cost devices:

Why royalty-free wins in hardware: When a codec costs $0 per device, there's no marginal cost to adding support. SoC vendors can include VP9 and AV1 decoders without worrying about royalty stacking. This is why virtually all new SoCs (Qualcomm Snapdragon 8 Gen 2/3, MediaTek Dimensity, Apple M3/A17 Pro) include hardware AV1 decode β€” the cost is just silicon area, not legal liability.

The Bottom Line

Video codec licensing is not a technical decision β€” it's a business decision that shapes technology adoption more than the technical merits of the codec itself.

Royalty-Free Model

VP9, AV1, AV2. Zero licensing cost. Defensive patent pool. Attracts broad ecosystem support. Hardware decode adoption growing rapidly. The winning model for the future.

Licensed Model

H.264, H.265, VVC. Predictable (or not) per-unit royalties. Caps for large players. Works when there's one pool. Fractures under multiple pools. Creates friction and uncertainty.

Hybrid / Workaround

OpenH264, platform-mediated licensing (e.g., Windows HEVC extension). Third party pays the royalties. Useful for bridging ecosystem gaps. Not sustainable long-term.

The industry is converging on a clear direction: royalty-free for distribution, licensed for production tools. AOMedia's AV1 and AV2 will dominate streaming and communication. VVC/H.266 may survive in broadcast and professional production where per-unit costs are less relevant. The patent pool model that enabled the streaming revolution is slowly being replaced by an open, collaborative alternative β€” driven not by technical superiority, but by the simple economics of removing friction from the video ecosystem.

βœ“ Mark lesson 5 as complete
← Lesson 4: Modern Codec Landscape