Daniel Miessler • 10/10/2024

How to Use Hugging Face Models with Ollama

This article provides a step-by-step technical guide for downloading a GGUF model file from Hugging Face, creating a Modelfile, and using Ollama's CLI to run the custom model locally. It bridges the gap between Ollama's simplicity and Hugging Face's extensive model selection, specifically demonstrating the process with a Llama 3.1 model for creative writing tasks.

0 comments

#Ollama #Hugging Face #Local Inference