Janas: Run LLMs larger than RAM by streaming experts from SSD

Article URL: https://github.com/prabanta-dev/janas Comments URL: https://news.ycombinator.com/item?id=50063717 Points: 75 # Comments: 28

Read the full story at Hacker News Front Page ↗

Timeline · 1 report

2026-10-12 22:05 · Hacker News Front Page
Janas: Run LLMs larger than RAM by streaming experts from SSD

More stories

Meta launches Muse Wonder AI models to compete with OpenAI and Anthropic — Meta Newsroom
French ecosystem deploys agentic computing with NVIDIA across sectors — NVIDIA Blog
MIT Professor Deb Roy Advocates for Accountability in AI-Generated Civic Text — MIT News AI
Microsoft President Says AI Is Less Regulated Than Milk — BBC Technology
Anthropic AI Model Sends False Homicide Tip to Philadelphia Police — Sky News Technology
Meta claims AI frontier status with new Muse Wonder model — Financial Times AI
Epic Games delays game, mandates AI-first production model — Techmeme
NVIDIA Opens Vera Rubin Architecture to Scale AI Infrastructure — NVIDIA Blog

Get the daily brief of stories like this at 6:30 every morning →