Base Labs releases decision model joey-1
The story so far
Base Labs released the joey-1 decision model, with parameters of 2B, which performed the best, with a single request P50 latency of 20ms and a cost of $0.01 per million tokens, supporting both text and image input. The model is suitable for high-volume decision-making scenarios with low latency sensitivity and can be used or deployed via Baseten Model APIs. The weights have been open-sourced on Hugging Face.
AI-written from the reports · Updated 20 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- MarkTechPostBaseten Releases joey-1, a 2B Decision Model at $0.01 per 1M Tokens
Baseten released joey-1, a 2B parameter decision model, which returns labels and calibration probabilities instead of generating text, used for high-volume routing, classification, and guardrail checks, with a price of 0.01 USD per million input tokens, and weights open-sourced on Hugging Face under the MIT license
- Baseten BlogDecisions for a penny: introducing joey-1, our fastest decision model
Base Labs releases joey-1 decision model, performs best when parameter count ≤ 3B, single request P50 latency 20ms, cost only 0.01 USD/100M tokens, supports text and image input. This model is suitable for high decision volume, low latency-sensitive scenarios, can be used or deployed via Baseten Model APIs, weights have been open-sourced to Hugging Face.