logo
logo
  • AI & Development
    • Computer Vision
    • Machine Learning
    • Natural Language Processing
  • Algorithms
  • Developer Experience
    • Developer Tools
    • Open Source
    • Tech Business
    • Tools
  • Infrastructure
    • Cloud & DevOps
    • Databases
    • Hardware
    • Performance
    • Security
  • News & Analysis
    • Industry Analysis
    • News
    • Opinion
  • Programming
    • JavaScript
    • Programming Languages
    • CSS
    • Web Development
    • Python
  • Technology

Tag: llama-cpp

Laptop connected to NVMe SSD streaming AI expert weights to a neural network, representing Janas LLM inference engine
News

Janas: Run a 48 GB LLM on a 32 GB Laptop from SSD

Janas streams MoE expert weights from NVMe with O_DIRECT, running a 48 GB model on ...
By ByteBot
2 hours ago
feedmatters.com

Categories

  • AI & Development
    • Computer Vision
    • Machine Learning
    • Natural Language Processing
  • Algorithms
  • Technology
  • News & Analysis
    • News
    • Opinion
    • Industry Analysis
  • Temporary
  • Infrastructure
    • Cloud & DevOps
    • Databases
    • Security
    • Hardware
    • Performance
  • Programming
    • JavaScript
    • Programming Languages
    • CSS
    • Web Development
    • Python
  • Developer Experience
    • Open Source
    • Developer Tools
    • Tech Business
    • Tools
  • Uncategorized
logo
© 2021 Byteiota | Designed & Developed by byteiota
logo
  • AI & Development
    • Computer Vision
    • Machine Learning
    • Natural Language Processing
  • Algorithms
  • Developer Experience
    • Developer Tools
    • Open Source
    • Tech Business
    • Tools
  • Infrastructure
    • Cloud & DevOps
    • Databases
    • Hardware
    • Performance
    • Security
  • News & Analysis
    • Industry Analysis
    • News
    • Opinion
  • Programming
    • JavaScript
    • Programming Languages
    • CSS
    • Web Development
    • Python
  • Technology
0 %

logo

✕ Close
  • AI & Development
    • Computer Vision
    • Machine Learning
    • Natural Language Processing
  • Algorithms
  • Developer Experience
    • Developer Tools
    • Open Source
    • Tech Business
    • Tools
  • Infrastructure
    • Cloud & DevOps
    • Databases
    • Hardware
    • Performance
    • Security
  • News & Analysis
    • Industry Analysis
    • News
    • Opinion
  • Programming
    • JavaScript
    • Programming Languages
    • CSS
    • Web Development
    • Python
  • Technology

logo

✕
  • AI & Development
    • Computer Vision
    • Machine Learning
    • Natural Language Processing
  • Algorithms
  • Developer Experience
    • Developer Tools
    • Open Source
    • Tech Business
    • Tools
  • Infrastructure
    • Cloud & DevOps
    • Databases
    • Hardware
    • Performance
    • Security
  • News & Analysis
    • Industry Analysis
    • News
    • Opinion
  • Programming
    • JavaScript
    • Programming Languages
    • CSS
    • Web Development
    • Python
  • Technology

Latest Posts

Meta Muse Wonder: Frontier Model, But the Best Version Isn’t on the API

Janas: Run a 48 GB LLM on a 32 GB Laptop from SSD

Firefox Enterprise: AI Killswitch for Corporate Browsers

AI Agents Are Writing CUDA Kernels That Beat PyTorch

context-mode: Stop Your AI Agent From Burning Context at Minute 30

feedmatters.com