Compressing Sequences in the Latent Embedding Space: $K$-Token Merging for Large Language Models

Loading paper

Compressing Sequences in the Latent Embedding Space: $K$-Token Merging for Large Language Models — Minlit