Welcome
  • Biography
  • Publication
  • Recent & Upcoming Talks
    • Example Talk
  • Publications
    • ZipAR: Accelerating Autoregressive Image Generation through Spatial Locality
    • ZipVL: Efficient Large Vision-Language Models with Dynamic Token Sparsification and KV Cache Compression
    • ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification
    • MiniCache: KV Cache Compression in Depth Dimension for Large Language Models
    • EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models
    • Paragraph-to-image generation with information-enriched diffusion model
    • Datasetdm: Synthesizing data with perception annotations using diffusion models
    • Ptqd: Accurate post-training quantization for diffusion models
    • BiViT: Extremely Compressed Binary Vision Transformers
    • Binarizing by classification: Is soft function really necessary?
  • Projects
  • Blog
    • 🎉 Easily create your own simple yet highly customizable blog
    • 📈 Communicate your results effectively with the best data visualizations
    • 🧠 Sharpen your thinking with a second brain
    • 👩🏼‍🏫 Teach academic courses
    • ✅ Manage your projects
  • Projects
    • Pandas
    • PyTorch
    • scikit-learn
  • Experience
  • Teaching
    • Learn JavaScript
    • Learn Python

MiniCache: KV Cache Compression in Depth Dimension for Large Language Models

Apr 1, 2024·
Akide Liu
,
Jing Liu
,
Zizheng Pan
,
Yefei He
,
Gholamreza Haffari
,
Bohan Zhuang
· 0 min read
Cite
Type
Journal article
Publication
NeurIPS 2024
Last updated on Apr 1, 2024
← ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification May 25, 2024
EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models Sep 30, 2023 →

© 2025 Me. This work is licensed under CC BY NC ND 4.0

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.