Context Language Models: self-managing context to improve performance and reduce compute costs
Researchers from Meta, MIT and the University of Washington have introduced Context Language Models, which manage and edit their own context instead of relying on fixed summarization, compression or retrieval. They report substantial gains in performance and compute efficiency.