Fine-Tuning vs. Frozen Embeddings: When to Adapt the LLM vs. the Sklearn Head
In this article, you will learn how to compare two strategies for adapting a large language model to a specific domain: fine-tuning with LoRA versus…
Context Managers Beyond Opening Files in Python
The stopwatch in the opening script is the smallest case of the pattern.
Robust Serialization with JSON and Custom Types
In this article, you will learn how to build a robust JSON serialization pipeline in Python that handles custom data types, graceful error recovery, and…
Speculative Decoding Explained: How to Get 3× Faster Inference from Any LLM
In this article, you will learn how speculative decoding works, why it produces real speed gains at the hardware level, and what modern implementations look…
How to Build a Multi-Modal RAG Pipeline for Images and Documents in Python
In this article, you will learn how to build a multi-modal RAG pipeline in Python that retrieves and reasons over both text and images extracted…
pgvector vs. Dedicated Vector Databases: A Production Benchmark
Run this on a typical laptop and both systems will report latencies in the low single-digit to tens of milliseconds range, with the exact numbers depending heavily on your CPU, available RAM, and whatever else is running on your machine at the time.
Descriptors and Controlled Attributes in Python
In this article, you will learn what Python descriptors are and how to use them to build three types of controlled attributes: validated, computed, and…
Iterators and Generators for Memory-Efficient Processing
Laziness is not a religion.
Choosing a Chunking Strategy for Your LLM Apps: A Decision-Tree Approach
In this article, you will learn how to choose the right chunking strategy for a retrieval-augmented generation system by working through a structured decision tree…
Building a Custom LLM Evaluation Harness in Python from Scratch
In this article, you will learn how to build a custom LLM evaluation harness in Python from scratch, structured around four modular components that give…