Sam Rose explains how LLMs work with a visual essay
A visual essay explaining LLM internals like tokenization, embeddings, and transformer architecture in an accessible way.
A visual essay explaining LLM internals like tokenization, embeddings, and transformer architecture in an accessible way.
Learn how to accurately calculate token counts for strings using language models with a provided Jupyter Notebook tool.
A step-by-step educational guide to building a Byte Pair Encoding (BPE) tokenizer from scratch, as used in models like GPT and Llama.
A 1-hour video presentation covering the full development cycle of Large Language Models, from architecture and pretraining to finetuning and evaluation.
A 1-hour presentation on the LLM development cycle, covering architecture, training, finetuning, and evaluation methods.
Explores the rise of gold-backed stablecoins like Tether Gold and HSBC Gold Token, analyzing their advantages over traditional gold investments.
A guide on customizing comment colors in VS Code themes using token color customizations in settings.json.
A tutorial on using the PLY (Python Lex-Yacc) library to tokenize source code, covering token definition and lexer creation.