Summary: NVIDIA has engaged in a licensing agreement with Groq, where NVIDIA will compensate Groq for the utilization and integration of its chip design and AI inferencing technology. This partnership does not entail an acquisition, allowing Groq to maintain its autonomy. Notably, Groq will appoint a new CEO, Simon Edwards, as existing members of its senior management team, including founder Jonathan Ross, will transition to NVIDIA. The collaboration aims to bolster NVIDIA’s technological advancements through the licensed technology, valued at $20 billion.
Groq: Groq, a company with a decade-long presence, recently secured $750 million in a Series D funding round, elevating its valuation to $6.9 billion. Despite facing challenges in data center capacity, Groq anticipates revenue growth from $500 million to $1.2 billion in 2026. Specializing in language processing units (LPUs) tailored for AI inferencing workloads, Groq’s technology excels in speed and efficiency compared to conventional GPU technology. The unique compiler-enabled software and a developing cloud infrastructure arm further distinguish Groq’s offerings.
Acquisition versus licensing: NVIDIA’s decision to license Groq’s technology, rather than acquire the company, stems from concerns regarding anti-trust regulations. This strategic move allows NVIDIA access to pivotal technology while preserving independence. Despite being a licensing agreement, the arrangement mirrors aspects of an acquisition.
Angle: While NVIDIA holds a dominant position in the market, the collaboration with Groq acknowledges the need for specialized technology in AI infrastructure development, particularly for inferencing tasks. By integrating capabilities to manage inferencing within its ecosystem, NVIDIA aims to solidify its market control and address the surge in inferencing demands efficiently. Partnering with Groq accelerates technology development compared to internal processes.
Cloud and data center impact: The partnership is expected to bolster Groq’s resources for its cloud and data center infrastructure business, potentially involving NVIDIA in Groq’s cloud platform. This alignment is likely to stimulate demand for data center infrastructure.
About the author: Phil Shih is the Managing Director and Founder of Structure Research, a research firm focusing on cloud, edge, AI, and data center infrastructure service provider markets globally.
Related
AI acceleration | AI Chips | AI/ML | cloud inference | Groq | LPU | Nvidia | semiconductors
