AINewsnow

Absurdly high GPU memory usage while LoRA finetuning Qwen3.5-0.8B model

Is anyone facing this issue while lora fine tuning Qwen3.5-0.8B model or Qwen3.5-4B model ? The GPU memory usage peaks to 70GB on RTX 6000 PRO. I couldn't find any issue or post in any forums about it. I have attached PyTorch memory snapshot during the forward pass of the 1st training step. submitt…

Read the full story at r/deeplearning ↗

Timeline · 1 report

  1. 2026-10-26 19:32 · r/deeplearning
    Absurdly high GPU memory usage while LoRA finetuning Qwen3.5-0.8B model

More stories

  1. Introducing GPT-6.1 Terra — OpenAI News
  2. Meta announces $95B offering to fund AI — Semafor Technology
  3. Microsoft offers buyouts to 60,000 employees — The Verge AI
  4. OpenAI announces three breakthroughs in computer science, math, and physics, including that the Exponential Time Hypothesis, a longstanding conjecture, is false (OpenAI) — Techmeme
  5. Anthropic’s IPO filing lays out a plan to ‘revolutionize every area of human endeavor' with AI — The Verge AI
  6. Anthropic's Claude bypassed a paywall to access Georgia voter data without authorization — Axios AI+
  7. Anthropic's IPO filing shows soaring sales and steep losses — France 24 — Artificial Intelligence
  8. Cohere says Alibaba’s Qwen model tried to send a file to Beijing — TechCrunch AI

Get the daily brief of stories like this at 6:30 every morning →