OpenAI engineers cut ChatGPT guest traffic to a few hundred Nvidia GPUs, with no new hardware deployed.

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, using software optimization alone. Engineers achieved more than 50% savings ...
Tech Times

OpenAI Halves Inference Costs With Software Alone: GPUs Drop to Hundreds

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, ...

What the OCI MSA didn't solve for AI scaling

The OCI MSA settled the architecture for optical scale-up. How fast bandwidth scales is a manufacturing question, not an ...
The Next Platform

Optical Scale Up Fabrics Are Limited By Manufacturing, Not Architecture

Earlier this spring, AMD, Broadcom, Meta Platforms, Microsoft, Nvidia, and OpenAI formed the Optical Compute Interconnect ...
Nature

Journal Metrics

Springer Nature is a signatory of the San Francisco Declaration on Research Assessment (DORA). Because small numbers of highly cited articles can have outsized influence on certain citation measures ...