HIMX proposes mixed-format matrix multiplication using customized HIFLOAT4 representations
A new arXiv paper introduces HIMX, a mixed-format matrix multiplication method built on customized HIFLOAT4 representations, targeting efficient 4-bit weight-activation (W4A4) quantization for large language model inference.
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-11-17 05:00 · arXiv cs.LG
HIMX: mixed-format matrix multiplication based on customized HIFLOAT4 representations