AMD's Advancing AI event Thursday focused on enterprise-class GPUs like its Instinct lineup. But it's a software platform you may not have heard of, called ROCm, that AMD depends upon just as much. AMD is releasing ROCm 7 today, which the company says can boost AI inferencing by three times through the software alone. And it's finally coming to Windows to battle Nvidia's CUDA supremacy.
Radeon Open Compute (ROCm) is AMD's open software stack for AI computing, with drivers and tools to run AI workloads. Remember the Nvidia GeForce RTX 5060 debacle of a few weeks back? Without a software driver, Nvidia's latest GPU was a lifeless hunk of silicon.
Early on, AMD was in the same pickle. Without the limitless coffers of companies like Nvidia, AMD made a choice: it would prioritize big businesses with ROCm and its enterprise GPUs instead of client PCs. Ramine Roane, corporate vice president of the AI solutions group, called that a "sore point:" "We focused ROCm on the cloud GPUs, but it wasn't always working on the endpoint — so we're fixing that."
|