Together AI has launched GPU cluster automatic repair features
The story so far
Together AI has launched GPU cluster auto-repair functionality, which monitors node health and provides repair suggestions and minimized repair actions upon detecting failures, allowing users to choose automatic execution or manual approval. The feature is now fully available, supporting passive health checks, repair suggestions, auto-repair policies (including fault and node-level authorization), idle wait control, upgrade tiers, and safety guards, and is performed via API and console; the preview version offers repair contracts based on node tags supporting third-party detection systems. Together AI claims that GPU failures are a real issue at scale, and the feature aims to help improve workload elasticity and minimize downtime.
AI-written from the reports · Updated 22 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Together AI BlogAuto repair for Together GPU Clusters: from GPU fault to healthy node
Together AI has launched an auto-repair feature for GPU clusters, which continuously monitors node health on both virtual machines and host machines. When a failure is detected, it recommends minimizing repair actions and provides evidence, allowing users to choose automatic execution or manual approval. This feature is now fully available, supporting passive health checks, repair recommendations, automatic repair policies (including fault and node-level authorization), idle wait control, upgrade tiers, and safety guards, and is performed via API and console; the preview version provides repair commitment support based on node tags for third-party detection systems.