Dropping the Anchor: Statistical Context Summarization for Distributed Systems via Pulsar Attention
Findings of EMNLP 2026
Developed Pulsar Attention for distributed long-context inference, replacing static anchor duplication with content-aware statistical summaries and reporting up to 4.7% accuracy gain over dense attention, 6.1% over Star Attention, and 3.3x lower Phase-1 FLOPs. Also accepted at the AdaptFM Workshop on Resource-Adaptive Foundation Model Inference, ICML 2026.
Interactive explainer
@misc{sood2026droppinganchorstatisticalcontext,
title={Dropping the Anchor: Statistical Context Summarization for Distributed Systems via Pulsar Attention},
author={Aryan Sood and Shantanu Acharya and Gaurav Kumar Nayak},
year={2026},
eprint={2607.20457},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2607.20457},
}