Summary:
- AI infrastructure evolving with rack-scale computing as a key approach.
- Industry moving towards 1-MW racks to handle increasing complexity.
- Financial considerations driving decisions around emerging technologies in data centers.
Article:
Revolutionizing AI Infrastructure with Rack-Scale Computing
The Future of Data Centers Unveiled at Data Center World 2025
At the recent Data Center World 2025 event, technology analyst Jeremie Eliahou Ontiveros from SemiAnalysis shared valuable insights into the evolving landscape of AI infrastructure. One of the key takeaways from his presentation was the growing importance of rack-scale computing as a fundamental architectural approach for handling AI workloads efficiently.
Eliahou emphasized the industry’s shift towards 1-MW racks, highlighting the unprecedented complexity that data centers are facing, particularly on the networking side. For instance, Nvidia’s NVL72 racks already consist of thousands of copper cables, illustrating the need for innovative solutions like co-packaged optics to address these challenges effectively.
Looking ahead, Eliahou outlined two distinct timeframes that will shape the trajectory of the data center industry. In the immediate term, the critical bottleneck lies in power access, with providers struggling to secure hundreds of megawatts or even gigawatts of capacity in strategically important locations. However, as we approach the projected $1 trillion data center capex milestone in 2030, economics will become the defining factor influencing decision-making processes.
The analyst stressed the importance of return on investment in justifying substantial capital expenditures, predicting that financial considerations will play a crucial role in the adoption of emerging technologies such as fuel cells and behind-the-meter natural gas generation in data center operations.
For a more in-depth look at Jeremie Eliahou Ontiveros’s insights on the future of AI infrastructure and data centers, check out the full interview here.
By staying abreast of these developments, data center operators can position themselves strategically to navigate the evolving landscape of AI infrastructure and drive innovation in the industry.
