Updates on Llama Cpp

Every AI story we track on Llama Cpp: 18 stories so far, each summarized in our own words and linked to the publisher that reported it.

Pulled from 125 sources

This week

Machine Learning30 min read

How to Run Underdog Saluki 27B: 2-Bit Qwen3.8-27B Tool-Calling Guide

MarkTechPost1d ago

This month

LLM & Text Generation8 min read

7 Open-Source AI Tools That Can Replace Paid Subscriptions

KDnuggets11d ago

Business & Enterprise11 min read

Deploy decision models with llama.cpp on Amazon SageMaker AI

AWS Blog14d ago

Computer Vision5 min read

Accelerating vision-language models with LFM2.5-VL-DSpark

Covered by 2 sourcesSep 24

LLM & Text Generation6 min read

7 Open-Source Alternatives to ChatGPT You Can Run Locally

KDnuggetsSep 22

Machine Learning12 min read

Transformers now runs llama.cpp quants

Hugging FaceSep 22

Machine Learning11 min read

GGUF vs GPTQ vs AWQ vs EXL2: LLM Model Formats Explained

MarkTechPostSep 19

Best Open-Source Agent Harnesses for Local LLMs in 2026

MarkTechPostSep 18

Machine Learning4 min read

Nous Research Adds One-Click Local Model Setup to Hermes Desktop

MarkTechPostSep 5

Machine Learning9 min read

Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps

Hugging FaceSep 3

LLM & Text Generation7 min read

Speed Up LLM Inference with DSpark Speculative Decoding

KDnuggetsAug 31

Machine Learning5 min read

Liquid AI Open-Sources Pipette: A Reproducible Benchmarking Suite That Measures On-Device Models, Quantization, Runtime and Hardware Together

MarkTechPostAug 25

Machine Learning6 min read

Up to 3.2x Faster Inference with LFM2.5-DSpark

Covered by 3 sourcesAug 20

Dev5 min read

Run Muse Glimmer for Local Vibe Coding with llama.cpp, DFlash, and Pi

KDnuggetsAug 21

Machine Learning3 min read

LFM2.5 Q4\_0 Checkpoints from Quantization-Aware Distillation

Hugging FaceAug 19

Agents4 min read

AI Agents that are Portable

Hacker NewsAug 19

Dev3 min read

AI;dr – AI wrote it, you shouldn't have to read it

Hacker NewsAug 18

LLM & Text Generation10 min read

Homebench – Benchmark local LLMs for speed, memory, and quality

Hacker NewsAug 4

That's everything we have on Llama Cpp right now