vLLM releases· ApostaC·· 20 小时前5
vLLM v0.34.0rc3 发布
v0.34.0rc3
要点速览
vLLM v0.34.0rc3 发布，支持 8k context，速度提升 3.5x，开源。
正文
Signed-off-by: NickLucche <[email protected]> Co-authored-by: Lucas Wilkinson <[email protected]> Co-authored-by: Matthew Bonanni <[email protected]> Co-authored-by: Felix Marty <[email protected]> Co-authored-by: Hongxia Yang <[email protected]> Co-authored-by: Andy Luo <[email protected]> Co-authored-by: Julien Denize <[email protected]> Co-authored-by: Dimitrios Bariamis <[email protected]> Co-authored-by: Julien Debache <[email protected]> Co-authored-by: vanshil shah <[email protected]>
Assets 2
来源: vLLM releases · github.com