OpenAI has received the world’s first NVIDIA DGX H200!

Just in today OpenAI has received the world’s first NVIDIA DGX H200, personally delivered by Jensen, committed to promoting AI, computing, and human development:

The DGX H200 has a total GPU memory of up to 19.5TB for just one machine.

That’s equivalent to 250 80G graphics cards, or 30 A800 machines.

Although one machine can’t train a large model from scratch, it can perform secondary pre-training and fine-tuning for models under 100B.

With just one machine, you can train your own large model!