Live
i14 deploying Laplace 3B model on AWS Trainium2
Trending storyPast story
i14 deploying Laplace 3B model on AWS Trainium2
1 reports1 outlets29 days agoUpdate
The story so far
AI overview
i14 has deployed its 24-layer decoder Laplace 3B (3,072D parameters, using Gated Linear Attention architecture) to AWS Trainium2, achieving a training speed of 120,000 tokens per second and concurrent inference capability for 11,544 output tokens. The AWS Machine Learning Blog reported this deployment without mentioning specific background or controversy.
AI-written from the reports · Updated 27 days ago
Coverage timeline
Follow the coverage to see every side of the story.
21 Oct
- AWS Machine Learning BlogBeyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch
i14 deploys its 24-layer decoder Laplace 3B (3,072D parameters, using Gated Linear Attention architecture) to AWS Trainium2, achieving a training speed of 120,000 tokens per second and concurrent inference capability for 11,544 output tokens.