Are there any experimental small models (9B or less) which are out or currently being trained using engram/n-grams?
This story is from 2026-09-13. It is preserved in the archive; the latest stories are on the live feed.
Not sure if anyone out there is working on this, don't see any on huggingface to try out. It might be too new at the moment, but it would be cool to see the difference between a tiny model trained with n-gram and without n-gram on the same dataset.
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-13 21:29 · r/LocalLLaMA
Are there any experimental small models (9B or less) which are out or currently being trained using engram/n-grams?