AINewsnow

I need to fine tune Qwen3.5-9B with QLora on about 500 GB of raw data (images/scanned documents/pdfs/word/excel) - what is the best way forward?

Hi All: I done overthought and burned money after consulting with AI chats (from chatgpt to grok to deepseek and kimi/etc). I had to learn. I have in my possession: - 1 Asus ESC4000 G3 with 128 GB DDR4 RDIMM and in it 8x T4s deployment. This server hosts the Qwen 3.5-9B Q5_K_XL at 87k context per s…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-25 22:32 · r/LocalLLaMA
    I need to fine tune Qwen3.5-9B with QLora on about 500 GB of raw data (images/scanned documents/pdfs/word/excel) - what is the best way forward?

More stories

  1. OpenAI and Anthropic support OSS maintainers. Do Chinese AI companies offer similar programs? — r/artificial
  2. Moonshot AI launches Kimi K3.1 Pro with better coding skills, reduced cyber risks — Mint AI
  3. What's the best front-end for LLM assisted studying? — r/LocalLLM
  4. qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA
  5. Meet Groot — four smaller models for reasoning, coding and tool use — r/huggingface
  6. Short overview of models that i used — r/artificial
  7. I made a site to easily compare LLM benchmarks and costs in one place — r/LocalLLM
  8. Is Perplexity Pro worth it instead of paying for ChatGPT, Claude, and Gemini separately? — r/artificial

Get the daily brief of stories like this at 6:30 every morning →