Submit Blog

Sign up Sign in

Search Articles

Filter by Tag

Sort By

Popular Tags

LLM Pretraining Articles

Page 1 of 1 (2 articles)

Instruction Pretraining LLMs

7/20/2024 • EN

Instruction Pretraining LLMs

Explores recent research on instruction finetuning for LLMs, including a cost-effective method for generating synthetic training data from scratch.

Alignment Data Instruction Finetuning LLM Pretraining Synthetic Data Generation

Sebastian Raschka

Tips for LLM Pretraining and Evaluating Reward Models

3/31/2024 • EN

Tips for LLM Pretraining and Evaluating Reward Models

Analysis of recent AI research papers on continued pretraining for LLMs and reward modeling for RLHF, with insights into model updates and alignment.

Continued Pretraining LLM Pretraining Model Alignment Reinforcement Learning Reward Modeling

Sebastian Raschka