We present a lightweight SpectrumEncoder forcompressing FFT power spectra using multi-head linear attention(MHLA) with FlashAttention backends and token-dropout. Wereport compression–accuracy trade-offs, latency profiles, and anablation on Rotary Positional Embeddings (RoPE). The method isdesigned for real-time SIGINT pipelines where millisecond-levellatency and energy budgets matter. Multi-Modal Beamforming with Model Compression and … – arXiv This work develops … Continue reading SpectrumEncoder with Token-Dropout and RoPE Ablations