Submit Blog

Sign up Sign in

Search Articles

Filter by Tag

Sort By

Popular Tags

Gpt J Articles

Page 1 of 1 (2 articles)

Accelerate GPT-J inference with DeepSpeed-Inference on GPUs

9/13/2022 • EN

Accelerate GPT-J inference with DeepSpeed-Inference on GPUs

Learn to optimize GPT-J inference using DeepSpeed-Inference and Hugging Face Transformers for faster GPU performance.

Deepspeed Inference Gpt J Gpu Optimization large language models Transformer Models

Deploy GPT-J 6B for inference using Hugging Face Transformers and Amazon SageMaker

1/11/2022 • EN

Deploy GPT-J 6B for inference using Hugging Face Transformers and Amazon SageMaker

A guide to deploying the GPT-J 6B language model for production inference using Hugging Face Transformers and Amazon SageMaker.

Amazon Sagemaker Gpt J Hugging Face Transformers Inference Model Deployment