Cohere Model Vault launches confidential computing features
The story so far
Cohere has launched the confidential computing feature of Model Vault, providing hardware-level protection and verifiable security for hosted enterprise AI. The feature runs inference on CPUs and GPUs, protecting workload memory through hardware-enforced isolation, and uses NVIDIA confidential computing technology to encrypt GPU memory and traffic between the CPU and GPU. Customers can verify the processing environment, including hardware, firmware, and software configurations, before sending sensitive data, ensuring that the data is protected during inference. The feature is currently undergoing public testing on NVIDIA GPUs on Microsoft Azure. Customers can create and manage encrypted vaults through Model Vault and integrate them using the same Cohere API, with client-side verification and end-to-end encryption protecting their content before sensitive request content leaves their environment.
AI-written from the reports · Updated 26 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Cohere BlogInside Cohere Model Vault: Building a verifiable confidential AI inference
Cohere Model Vault introduced confidential computing on Microsoft Azure using NVIDIA GPUs in its public test version, designed to reduce the plaintext data infrastructure customers must trust and provide cryptographic evidence for customers to verify before sensitive information is released. The system protects the computation itself through hardware-enforced isolation, uses Oblivious HTTP to encrypt sensitive request content, and employs a remote attestation mechanism to ensure the environment processing requests meets expectations, thereby protecting the entire process from request transmission to computation execution.
- Cohere BlogIntroducing Confidential Computing on Cohere Model Vault
Cohere Model Vault launches confidential computing feature in public test, bringing hardware-level protection and verifiable security for hosted enterprise AI. The feature runs inference on both CPU and GPU, protecting workload memory through hardware-enforced isolation and using NVIDIA confidential computing technology to encrypt GPU memory and traffic between CPU and GPU. Customers can verify the processing environment, including hardware, firmware, and software configuration, before sending sensitive data, ensuring data is protected during the reasoning process.