OpenAI engineers cut ChatGPT guest traffic to a few hundred Nvidia GPUs, with no new hardware deployed.

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, using software optimization alone. Engineers achieved more than 50% savings ...
Tech Times

OpenAI Halves Inference Costs With Software Alone: GPUs Drop to Hundreds

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, ...

Hollywood studio disputes from Seedance 2.0 remain open as the new model enters its launch window

ByteDance Seedance 2.5 enters public launch this week with a claim no other AI video model has matched: 30-second native generation without stitching. Hollywood copyright disputes from Seedance 2.0 ...
Tech Times

Compile Once, Run Offline: New AI Method Matches 32B Models With a 23MB File

Local AI inference at 32B-parameter quality, no cloud API required: University of Waterloo researchers released PAW on July 2 ...