Fine-tune open models with Training Factory from ThousandML
Hello All! I built a platform to fine-tune open models. I am focusing on fine-tuning 4-bit quantized models by QLoRa instead of full precision fine-tuning to reduce GPU costs. The quant that this finetuning uses is called CQ (Coded Quantization) which is a calibration-free quantization that I built…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-21 15:38 · r/LocalLLM
Fine-tune open models with Training Factory from ThousandML