Welcome
  • Biography
  • Publication
  • Recent & Upcoming Talks
    • Example Talk
  • Publications
    • Sparsity Forcing: Reinforcing Token Sparsity of MLLMs
    • OmniSparse: Training-Aware Fine-Grained Sparse Attention for Long-Video MLLMs
    • Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance
    • Neighboring Autoregressive Modeling for Efficient Visual Generation
    • ZipAR: Accelerating Autoregressive Image Generation through Spatial Locality
    • ZipVL: Efficient Large Vision-Language Models with Dynamic Token Sparsification and KV Cache Compression
    • ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification
    • MiniCache: KV Cache Compression in Depth Dimension for Large Language Models
    • EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models
    • Paragraph-to-image generation with information-enriched diffusion model
    • Datasetdm: Synthesizing data with perception annotations using diffusion models
    • Ptqd: Accurate post-training quantization for diffusion models
    • BiViT: Extremely Compressed Binary Vision Transformers
    • Binarizing by classification: Is soft function really necessary?
  • Projects
  • Blog
    • 🎉 Easily create your own simple yet highly customizable blog
    • 📈 Communicate your results effectively with the best data visualizations
    • 🧠 Sharpen your thinking with a second brain
    • 👩🏼‍🏫 Teach academic courses
    • ✅ Manage your projects
  • Projects
    • Pandas
    • PyTorch
    • scikit-learn
  • Experience
  • Teaching
    • Learn JavaScript
    • Learn Python

OmniSparse: Training-Aware Fine-Grained Sparse Attention for Long-Video MLLMs

Jul 1, 2025·
Feng Chen*
,
Yefei He*
,
Shaoxuan He*
,
Yuanyu He*
,
Jing Liu
,
Lequan Lin
,
Akide Liu
,
Zhaoyang Li
,
Jiyuan Zhang
,
Zhenbang Sun
,
Others
· 0 min read
Cite
Type
Journal article
Publication
AAAI 2026
Last updated on Jul 1, 2025
← Sparsity Forcing: Reinforcing Token Sparsity of MLLMs Sep 1, 2025
Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance Apr 1, 2025 →

© 2026 Me. This work is licensed under CC BY NC ND 4.0

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.