Tiny Retriever vs ChatGPT 🥊
October 7, 2023

The Tiny Retriever vs OpenAI RAG showdown! Did the fine-tuned underdog beat the champ? See the nDCG results, the tech stack (GPL, SBERT), and why losing isn’t the end.
October 7, 2023
The Tiny Retriever vs OpenAI RAG showdown! Did the fine-tuned underdog beat the champ? See the nDCG results, the tech stack (GPL, SBERT), and why losing isn’t the end.
October 3, 2023
While my model is training, let’s take a moment to pause and reflect on the process so far, its thorns and roses, and make a few more Bert puns while we’re at it!
September 29, 2023
What makes a good retriever for RAG? Join me on a journey from classic BM25 to the world of BERT, DistilBERT, fine-tuning tricks like GPL, and why these ‘smaller’ models still punch above their weight.
September 25, 2023
Why use giant LLMs for RAG? This post kicks off a mission to build a tiny, specialized information retriever using BERT, aiming for better performance on niche/non-English data, faster speeds, and no GPU required!
August 10, 2023
Taylor v0.1 is live! Check out the first release of this AI junior developer agent on Github. Learn about the struggles (Github auth, APIs, TS/ESLint) and triumphs (Langchain agents, prompts) of this project.
August 4, 2023
Inspired by Minecraft’s Voyager, this post lays out the vision for ‘Taylor’ - an autonomous AI junior developer. Explore the goals, constraints, tech stack, and process ideas for automating dev tasks with Langchain.
August 2, 2023
NVIDIA’s Voyager agent showed impressive long-horizon planning in Minecraft. This post breaks down its six key components, GPT-4 powered action loop, and analyzes whether its parts are truly ‘agents’ or just ‘chains’.
July 30, 2023
Curious about AI agents automating software development? This post explains what they are, how they differ from chatbots, and lists popular open-source projects like GPT Engineer, AIder, and Webapp Factory you can explore.