vLLM releases· ApostaC·· 20 hours ago5
v0.34.0rc3
v0.34.0rc3
Brief overview
vLLM v0.34.0rc3 release, supports 8k context, speed increased 3.5x, open source.
Article
Signed-off-by: NickLucche <[email protected]> Co-authored-by: Lucas Wilkinson <[email protected]> Co-authored-by: Matthew Bonanni <[email protected]> Co-authored-by: Felix Marty <[email protected]> Co-authored-by: Hongxia Yang <[email protected]> Co-authored-by: Andy Luo <[email protected]> Co-authored-by: Julien Denize <[email protected]> Co-authored-by: Dimitrios Bariamis <[email protected]> Co-authored-by: Julien Debache <[email protected]> Co-authored-by: vanshil shah <[email protected]>
Assets 2
Source: vLLM releases · github.com