Fine-tuned ModernBERT on 138k financial headlines. Training loss went down, test AUC stayed at 0.50. What I learned.
I wanted to know if news headlines can tell which stocks will do better than others over the next few weeks. Short answer: no. But the way it failed taught me more than the result, so here's the setup. Data 137,934 headlines from Benzinga for 2,518 US stocks. Each case gets the headlines of the 14…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-12 11:41 · r/deeplearning
Fine-tuned ModernBERT on 138k financial headlines. Training loss went down, test AUC stayed at 0.50. What I learned.