langchain

Tiny Retriever vs ChatGPT 🥊

Featured Image

The Tiny Retriever vs OpenAI RAG showdown! Did the fine-tuned underdog beat the champ? See the nDCG results, the tech stack (GPL, SBERT), and why losing isn’t the end.

Training so far

Featured Image

While my model is training, let’s take a moment to pause and reflect on the process so far, its thorns and roses, and make a few more Bert puns while we’re at it!

Building up my BERT stack

Featured Image

What makes a good retriever for RAG? Join me on a journey from classic BM25 to the world of BERT, DistilBERT, fine-tuning tricks like GPL, and why these ‘smaller’ models still punch above their weight.

Creating the tiniest information retriever

Featured Image

Why use giant LLMs for RAG? This post kicks off a mission to build a tiny, specialized information retriever using BERT, aiming for better performance on niche/non-English data, faster speeds, and no GPU required!

Taylor v0.1 Release

Featured Image

Taylor v0.1 is live! Check out the first release of this AI junior developer agent on Github. Learn about the struggles (Github auth, APIs, TS/ESLint) and triumphs (Langchain agents, prompts) of this project.

Ideating Taylor: A Voyager-type LLM Dev

Inspired by Minecraft’s Voyager, this post lays out the vision for ‘Taylor’ - an autonomous AI junior developer. Explore the goals, constraints, tech stack, and process ideas for automating dev tasks with Langchain.

Breaking down Voyager

Featured Image

NVIDIA’s Voyager agent showed impressive long-horizon planning in Minecraft. This post breaks down its six key components, GPT-4 powered action loop, and analyzes whether its parts are truly ‘agents’ or just ‘chains’.

List of Open Source Software Development AI Agents

Featured Image

Curious about AI agents automating software development? This post explains what they are, how they differ from chatbots, and lists popular open-source projects like GPT Engineer, AIder, and Webapp Factory you can explore.