How to Rate the AI We're All Chasing

This article presents a framework for evaluating AI systems based on three key axes: customization (how deeply aware the AI is of your personal context), integration (how seamlessly it fits into your daily activities and systems), and competence (model capabilities and API access). The author argues that while competence is important, customization and integration are more critical for user experience and harder for competitors to replicate. The post also discusses the open-source PAI system and plans to make it a plugin compatible with any AI substrate. This is a tech-focused analysis of AI evaluation criteria.