AINewsnow

UMKM-Bench: I tested 8 LLMs on how Indonesians really text online shops

This is a submission for the Kaggle Benchmarking Challenge . What I Benchmarked Here is a message a small coffee shop in Jogja might get on WhatsApp: kak arabika yg setengah kilo ready gk? The customer wants to know if the 500 gram Arabica is in stock. "yg" is yang, "gk" is nggak, "ready" comes fro…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-09-25 10:22 · DEV Community — Machine Learning
    UMKM-Bench: I tested 8 LLMs on how Indonesians really text online shops

More stories

  1. Introducing GPT-6 Sol and Luna — OpenAI News
  2. Introducing Gemini 3.8 Live with Live Avatar — Google Gemini Blog
  3. Gemini 3.8 text-to-speech says hello — Google Gemini Blog
  4. Sam Altman’s remarks at the United Nations Security Council — OpenAI News
  5. OpenAI Agent Hacked Australian Government Website — Wall Street Journal Technology
  6. Meta Connect 2026: Muse AI Gadget Shows Ambitious Hardware Vision — Bloomberg AI
  7. Introducing Ray-Ban Meta Audio and More AI Glasses Styles — Meta Newsroom
  8. Muse AI now hands over phone calls to human agents: Meta tests new feature in its personal assistant — Mint AI

Get the daily brief of stories like this at 6:30 every morning →