Skip to content
Live
Trending storyPast story

Cohere Model Vault launches confidential computing features

2 reports1 outlets27 days agoUpdate

The story so far

AI overview

Cohere has launched the confidential computing feature of Model Vault, providing hardware-level protection and verifiable security for hosted enterprise AI. The feature runs inference on CPUs and GPUs, protecting workload memory through hardware-enforced isolation, and uses NVIDIA confidential computing technology to encrypt GPU memory and traffic between the CPU and GPU. Customers can verify the processing environment, including hardware, firmware, and software configurations, before sending sensitive data, ensuring that the data is protected during inference. The feature is currently undergoing public testing on NVIDIA GPUs on Microsoft Azure. Customers can create and manage encrypted vaults through Model Vault and integrate them using the same Cohere API, with client-side verification and end-to-end encryption protecting their content before sensitive request content leaves their environment.

AI-written from the reports · Updated 26 days ago

Coverage timeline

Follow the coverage to see every side of the story.

23 Oct
  1. Cohere Blog
    Inside Cohere Model Vault: Building a verifiable confidential AI inference

    Cohere Model Vault introduced confidential computing on Microsoft Azure using NVIDIA GPUs in its public test version, designed to reduce the plaintext data infrastructure customers must trust and provide cryptographic evidence for customers to verify before sensitive information is released. The system protects the computation itself through hardware-enforced isolation, uses Oblivious HTTP to encrypt sensitive request content, and employs a remote attestation mechanism to ensure the environment processing requests meets expectations, thereby protecting the entire process from request transmission to computation execution.

  2. Cohere Blog
    Introducing Confidential Computing on Cohere Model Vault

    Cohere Model Vault launches confidential computing feature in public test, bringing hardware-level protection and verifiable security for hosted enterprise AI. The feature runs inference on both CPU and GPU, protecting workload memory through hardware-enforced isolation and using NVIDIA confidential computing technology to encrypt GPU memory and traffic between CPU and GPU. Customers can verify the processing environment, including hardware, firmware, and software configuration, before sending sensitive data, ensuring data is protected during the reasoning process.