An AI Odyssey, Part 3: Lost Needle in the Haystack

This article recounts the author's experience using an AI shopping assistant on a major e-commerce site to ask an obscure product question. The AI tool failed to provide a useful answer, while a traditional keyword search across product reviews immediately yielded helpful results. The author discusses the usability issue of having multiple search mechanisms where only one is reliable, and questions why a retrieval-augmented generation (RAG) approach couldn't match the effectiveness of basic keyword search. It concludes that without improvements, customers will not be satisfied with such AI tools. The post is part of a series on AI challenges.