text-embedding-3-large at 256 dims beats ada-002 at 1,536 — dimension count is a decision, not a default

This story is from 2026-09-02. It is preserved in the archive; the latest stories are on the live feed.

The new OpenAI embedding model outputs 3,072 dimensions. If you truncate it to 256 — discarding over 90% of the vector — it still outperforms the previous generation (ada-002) running at its full 1,536 dimensions. This isn't an accident. These models are trained so the most important semantic infor…

Read the full story at r/deeplearning ↗

Timeline · 1 report

1. 2026-09-02 15:33 · r/deeplearning
   text-embedding-3-large at 256 dims beats ada-002 at 1,536 — dimension count is a decision, not a default