ZQN-12B: our second open model, plus the M3-GPTQ compression paper
ZQN-12B is the second open model from ZAQERIS Ai, an independent AI research group in Cairo, Egypt. Trained from scratch 15.55B parameters, compressed with our ZAQERIS M3-GPTQ method to 6.48 GiB (3.25 bits per weight) Runs on a consumer 8 GB GPU at about 25 tokens/second 128K native context (256K w…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-15 10:44 · DEV Community — Machine Learning
ZQN-12B: our second open model, plus the M3-GPTQ compression paper