AINewsnow

Ising-Model Optimization Cuts LLM Depth-Pruning Accuracy Loss on Llama-3.3-70B by 23 MMLU Points

A block-pruning method published today reframes which transformer layers to remove as a constrained binary optimization problem mapped onto an Ising spin glass, rather than scoring each block independently. Tested on Llama-3.3-70B-Instruct at 50% depth compression, it holds MMLU at 76.9 without any…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-09-25 09:16 · DEV Community — Machine Learning
    Ising-Model Optimization Cuts LLM Depth-Pruning Accuracy Loss on Llama-3.3-70B by 23 MMLU Points

More stories

  1. Performance tune for gemma4-26b-a4b flash attention shape. by frobnitzem · Pull Request #28450 · ggml-org/llama.cpp · GitHub — r/LocalLLaMA
  2. Qwen3.8-Flash-Next on 12GB VRAM - 65 tokens per second — r/LocalLLaMA
  3. Qwen3-Coder 30B on RTX 3080 20GB — KV cache stability and context tuning — r/LocalLLM
  4. PSA: llama.cpp -cram should be increased for agentic workflows (default is 8192) — r/LocalLLaMA
  5. Gufo: the all-in-one strix halo inference engine — r/LocalLLM
  6. My foray into local ai. Two BC-250 ex mining apus running Qwen3.6-35B-A3B Q4_K_M at 60 tok/s with 64k context — r/LocalLLaMA
  7. I turned Qwen3.8-27B Q2_64 + llama.cpp into a fully TypeSafe AI-compatible Jev-like system. OpenAI API still intact! World’s first Vision-enabled Jev-like model! <10 GB VRAM, 170 ms on an RTX 3090 and ~140 tok/s in chat. 76% vs. 88% Jev-1.13 Acc. on a diverse 22,000-request typed-decision benchmark — r/LocalLLaMA
  8. GGUFs in transformers natively! — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →