GPUs drastically outperform CPUs in AI-related tasks like language model inference and image generation.

“Behind me is a dual AMD Epic 9965 server with 1.7 terab of RAM. The nearly 400 CPU cores in this bad boy alone cost almost $20,000. But even with all of those threads and all of that memory, this thing looks like a bad joke compared to a single one of these GPUs.”