ByteDance-Seed/Cola2

Cola2 is a continuous latent language model that combines dynamic compression VAE, block causal diffusion Transformer (DiT), and cross-segment causal token decoder, dynamically grouping text into semantic segments, representing each segment with a compact continuous latent, generating latent blocks and implementing them as discrete tokens.