Questions about draft model architecture and MTP
This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.
Hi everyone, I have been experimenting a lot with local LLMs lately and as a result I have been thinking about draft models and how much of a difference they can make. There have been two ideas that have bounced into my head more than once and I was curios if similar ideas have already been tried,…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-01 10:49 · r/LocalLLM
Questions about draft model architecture and MTP