Meta explains how it uses idle inference capacity across its fleet to run extra ads recommendation work. Two elasticity mechanisms let the workload expand onto spare machines without hurting baseline performance.
At the Open Compute Project Global Summit in San Jose, NVIDIA announced new partnerships and contributions, including opening its Vera Rubin architecture. The company argues open standards help build AI infrastructure faster and more reliably as facilities grow from megawatts to gigawatts.
As companies move AI projects from pilots into production, Dell is changing how it sells to West Coast customers who build much of the AI stack themselves. Infrastructure vendors are finding that these builders call for a different sales approach.
The chief executives of Intel and Broadcom warned that access to capital could emerge as a major constraint on the AI boom.
Microsoft has announced Maia 300, the third generation of its in-house AI chip, meant to be the main inference system for its products and services. It improves cost and efficiency in the cloud and is better suited to reasoning models and agentic tasks.
Deepgram, which expanded its Flux voice model to 10 languages this year, is pushing voice AI onto air-gapped laptops. As voice becomes a main way of using devices, the company needs compute, storage and partners to support both listening and speaking models.