Submit Blog

Sign up Sign in

Search Articles

Filter by Tag

Sort By

Popular Tags

Vllm Articles

Page 1 of 1 (2 articles)

Evaluate LLMs using Evaluation Harness and Hugging Face TGI/vLLM

9/19/2024 • EN

Evaluate LLMs using Evaluation Harness and Hugging Face TGI/vLLM

A guide to evaluating Large Language Models (LLMs) using the Evaluation Harness framework and optimized serving tools like Hugging Face TGI and vLLM.

benchmarking Evaluation Harness LLM Evaluation Text Generation Inference Vllm

Deploy open LLMs with vLLM on Hugging Face Inference Endpoints

5/2/2024 • EN

Deploy open LLMs with vLLM on Hugging Face Inference Endpoints

A tutorial on deploying open-source large language models (LLMs) like Llama 3 using the vLLM framework on Hugging Face Inference Endpoints.

Hugging Face Inference Endpoints large language models LLM Deployment Vllm