Need to estimate rank or perform dimensionality reduction on big, messy tabular data? The Entropic Scree is an information-theoretic upgrade to PCA

This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.

Here's a new rank estimation method I've been working on. It's basically an upgraded Principal Component Analysis (PCA) built on information theory instead of linear variance. It's robust to mixed data types, highly non-linear generative processes, low signal to noise ratios, and sparsity (more var…

Read the full story at r/deeplearning ↗

Timeline · 2 reports

1. 2026-08-21 03:39 · r/deeplearning
   Need to estimate rank or perform dimensionality reduction on big, messy tabular data? The Entropic Scree is an information-theoretic upgrade to PCA.
2. 2026-08-21 02:44 · r/ArtificialInteligence
   Need to estimate rank or perform dimensionality reduction on big, messy tabular data? The Entropic Scree is an information-theoretic upgrade to PCA