Elon Musk plans to build a supercomputer for the next version of Grok chatbot
Elon Musk said that his artificial intelligence startup xAI plans to build a supercomputer for the next version of its chatbot Grok. This was reported by Reuters.
According to the investor report, Musk intends to launch this supercomputer by the fall of 2025. He also noted that xAI could cooperate with Oracle. During the presentation, Musk said that when completed, the connected groups of chips – Nvidia’s flagship H100 GPUs – will be at least four times larger than the largest GPU clusters that exist today. According to the publication, Nvidia H100 GPUs are currently hard to come by due to high demand, as they dominate the data center chip market for AI. Musk previously stated that Grok 2 required about 20,000 Nvidia H100 GPUs to train, adding that Grok 3 and beyond will require 100,000 Nvidia H100 chips.