skill by

Huggingface Local Models

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

Add skill

Follow @huggingface

Permissions

Files

SKILL.md

huggingface-local-models

Hugging Face Local Models

Search the Hugging Face Hub for llama.cpp-compatible GGUF repos, choose the right quant, and launch the model with llama-cli or llama-server.

Default Workflow

Search the Hub with apps=llama.cpp.
Open https://huggingface.co/<repo>?local-app=llama.cpp.
Prefer the exact HF local-app snippet and quant recommendation when it is visible.
Confirm exact .gguf filenames with https://huggingface.co/api/models/<repo>/tree/main?recursive=true.
Launch with llama-cli -hf <repo>:<QUANT> or .

4 files · 15 KB4 KB

Install

It’s free, and every skill you add syncs into every AI tool on your computer, instantly.

Get the Skillet appor

npx skilletmd add @huggingface/huggingface-local-models -y

Version history

Huggingface Local Models

Hugging Face Local Models

Default Workflow

Quick Start

Install llama.cpp

Authenticate for gated repos

Search the Hub

Run directly from the Hub

Run an exact GGUF file

Convert only when no GGUF is available

Smoke test a local server

Quant Choice

Load References

Resources