✨Orion-MSP: Multi-Scale Sparse Attention for Tabular In-Context Learning

📝 Summary:
Orion-MSP is a novel tabular in-context learning architecture addressing limitations in existing models. It incorporates multi-scale processing, block-sparse attention, and a Perceiver-style memory. Orion-MSP achieves state-of-the-art performance on various benchmarks while scaling effectively to...

🔹 Publication Date: Published on Nov 4

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2511.02818
• PDF: https://arxiv.org/pdf/2511.02818

🔹 Models citing this paper:
• https://huggingface.co/Lexsi/Orion-MSP

==================================

For more data science resources:
✓ https://t.iss.one/DataScienceT

#TabularLearning #SparseAttention #MachineLearning #DeepLearning #AI