Baidu Tianchi 1024 Card Super Node Released: Can support training of 5 trillion parameter models, to be launched next year.

Baidu Tianchi's 1024 card super-node is launched, equipped with optical engine technology, inter-card interconnection bandwidth increased 3 times, training performance increased 2.5 times, and inference performance increased 3 times. Accompanied by G3.5 KV Cache GPU memory acceleration cabinet, long context inference performance increased 2 times, multi-round dialogue cache hit scenario TTFT decreased by 90%, and throughput increased 7 times. A single node can support the training of large models with 500 billion parameters, with the ability to scale to ten thousand cards, and will be launched next year.