AINewsnow

Tuned/abliterated Qwen3.8-27b into a 24gb card 262k guff using the newest unreleased version of LexiPanel. It's fast with reliable draft acceptance. Made for 7900xtx but should work on whatever 24gb card with this setup and headless. Doesn't get dumber while coding like most of the other fine-tunes.

This story is from 2026-10-02. It is preserved in the archive; the latest stories are on the live feed.

https://huggingface.co/Wa1k3r/Qwen3.8-27b-CODER-4q_xs-24GB-262k-Optimalcardfit Qwen3.8-27B CODER — IQ4_XS imatrix · 24 GB card fit · ~262k context · MTP draft Quantized, Abliterated, and fitted by LexiPanel. Its Fit planner chose the tensor mix to fill one 24 GB GPU at about 240k tokens of context.…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-02 13:32 · r/LocalLLaMA
    Tuned/abliterated Qwen3.8-27b into a 24gb card 262k guff using the newest unreleased version of LexiPanel. It's fast with reliable draft acceptance. Made for 7900xtx but should work on whatever 24gb card with this setup and headless. Doesn't get dumber while coding like most of the other fine-tunes.

More stories

  1. California sues OpenAI after that Hugging Face rogue hacking incident — Engadget
  2. Hugging Face routes Inference Providers language model traffic through OpenRouter — r/LocalLLaMA
  3. IFBench on Hugging Face: 0 of 23 Rows Are Verified, and Ranks 1 to 6 Sit Inside One 300-Prompt Error Band — DEV Community — Machine Learning
  4. Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run — DEV Community — Machine Learning
  5. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  6. Cloudflare opens weights for Clairic extraction models — DEV Community — AI
  7. ETNews: 70.7% of the World's 300 Most Downloaded Language Models Are Chinese, and One Korean Model Is on the List — DEV Community — AI
  8. Microsoft releases Aion-1.0-Instruct-2.3B open-weights model on Hugging Face — Hugging Face model releases

Read the Daily Brief: the day's most important AI stories →