Skip to content
Live
Trending storyPast story

i14 deploying Laplace 3B model on AWS Trainium2

1 reports1 outlets29 days agoUpdate

The story so far

AI overview

i14 has deployed its 24-layer decoder Laplace 3B (3,072D parameters, using Gated Linear Attention architecture) to AWS Trainium2, achieving a training speed of 120,000 tokens per second and concurrent inference capability for 11,544 output tokens. The AWS Machine Learning Blog reported this deployment without mentioning specific background or controversy.

AI-written from the reports · Updated 27 days ago

Coverage timeline

Follow the coverage to see every side of the story.

21 Oct
  1. AWS Machine Learning Blog
    Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch

    i14 deploys its 24-layer decoder Laplace 3B (3,072D parameters, using Gated Linear Attention architecture) to AWS Trainium2, achieving a training speed of 120,000 tokens per second and concurrent inference capability for 11,544 output tokens.