It is not clear to me which parameter we should use for LoRA training—shift or sigmoid—in the new models (Qwen 2.1, LLaMA 2, and MOSS) within the AI toolkit.
In the past, I heard some people say that "sigmoid balanced" is better—that it’s the only one capable of learning faces. I recently trained a LoRA for "Moss," and the result turned out completely broken. Sigmoid works with Krea 2 and Qwen 2.1—but could "shift" be better? Should I start with "shift…
Read the full story at r/comfyui ↗
Timeline · 1 report
- 2026-10-24 17:18 · r/comfyui
It is not clear to me which parameter we should use for LoRA training—shift or sigmoid—in the new models (Qwen 2.1, LLaMA 2, and MOSS) within the AI toolkit.
More stories
- Qwen 3.8 Flash Next GSQ-RCO IQ_3S at 70tok/s decode/1900tok/s prefill on 2013 Xeon E5-1680v2, 128GB quad channel DDR3-1866 ECC, and an EVGA 3090 FTW3 — r/LocalLLM
- models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp — r/LocalLLaMA
- Benchmark: Recursive's Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine, Claude/Codex/Pi/OpenCode compatible. — r/LocalLLaMA
- DeepSeek V4 Flash API prices compared across providers (Oct 2026) — r/huggingface
- High-Performance llama.cpp fork for Legacy GPUs: Kepler Support, CUDA Graphs & Windows NCCL! — r/LocalLLaMA
- Are there any good finetunes for Blender and/or 3D modeling? — r/LocalLLaMA
- AbliteratedOutTheBox Strata Announcement — r/LocalLLaMA
- Comfy-Org's Qwen-Image-Edit Bundle Hits 1.68M Downloads With Smarter Editing — AlphaSignal
Get the daily brief of stories like this at 6:30 every morning →