Does your multilingual LLM actually reason in Hindi, or translate to English and back? Dataset built to test it: 11k+ bilingual math Q&A pairs, 7 Indian languages
Quick question to start: if you ask an LLM a math problem in Telugu instead of English, is it actually doing the math in Telugu, or silently translating to English, solving it there, and translating back? I couldn't find a dataset built to actually test that cleanly, so I built one, but am looking…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-10-20 23:20 · r/learnmachinelearning
Does your multilingual LLM actually reason in Hindi, or translate to English and back? Dataset built to test it: 11k+ bilingual math Q&A pairs, 7 Indian languages