Making LLMs Better at Creative Writing using Entropy
Improving LLM creative writing quality by modifying the sampling process using future entropy information.
Improving LLM creative writing quality by modifying the sampling process using future entropy information.
The author draws parallels between historical perpetual motion claims and modern superintelligence hype, exploring a theoretical link between information theory and thermodynamics.
Explores the concept of 'human collapse' from a tech podcast, arguing for seeking 'entropy' and new inputs to stay creative and unpredictable, with mentions of AI tools.