H3 lipsync behavior when lyrics are in the prompt vs when they're not
H3 is already pretty good in lipsyncing just based on audio, but it makes guesses what letters are actually being pronounced without trying to figure out the actual word it's part of. The result is that some of the sounds show mismatching mouth movements. Including the sung lyrics improves the moti…
Read the full story at r/StableDiffusion ↗
Timeline · 1 report
- 2026-10-19 20:23 · r/StableDiffusion
H3 lipsync behavior when lyrics are in the prompt vs when they're not