Nebius and Nscale are among the partners planning infrastructure around NVIDIA's Vera CPUs. NVIDIA argues that agentic workloads, which retrieve data, call tools and run code, depend heavily on fast CPU processing, and pitches Vera as the chip to speed up those steps.
The number of neoclouds, which rent out AI computing power, has exploded over the past four years. Wall Street is watching closely because their business model, which moves tens of billions of dollars, raises questions.
HSBC's chief executive cautioned that not every data center, the campuses housing the servers behind AI and cloud computing, will be a sound investment despite the AI boom.
To meet demand for the memory chips packaged alongside AI GPUs, Samsung is building a huge manufacturing complex in Pyeongtaek, South Korea. Three fabs already run around the clock and a fourth is coming online.
IBM and other contributors released version 1.0 of llm-d, an open-source distributed inference framework, ahead of PyTorch Conference North America. The release adds operational controls to help enterprises run large models reliably on their own infrastructure.
In an op-ed in Le Monde, groups fighting data center projects warn of the water and electricity use and the loss of farmland these sites bring. They frame local opposition as a stand against the broader AI build-out.