A Statistical Inference Framework for PMI Estimation and SGNS Word Embeddings
arXiv:2610.05058v1 Announce Type: new Abstract: Pointwise Mutual Information (PMI) is a core measure of testing word association, and Skip-gram with Negative Sampling (SGNS) is essentially a method that implicitly factorizes a shifted PMI matrix. However, a systematic and well-rounded characterizat…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-10-06 04:00 · arXiv stat.ML
A Statistical Inference Framework for PMI Estimation and SGNS Word Embeddings