5 Lessons Learned Building RAG Systems
Retrieval augmented generation (RAG) is one of 2025’s hot topics in the AI landscape.
Understanding RAG Part X: RAG Pipelines in Production
Be sure to check out the previous articles in this series: •
Defending against Prompt Injection with Structured Queries (StruQ) and Preference Optimization (SecAlign)
Recent advances in Large Language Models (LLMs) enable exciting LLM-integrated applications. However, as LLMs have improved, so have the attacks against them. Prompt injection attack is listed as the #1 threat by OWASP to LLM-integrated applications, where an LLM input contains a trusted prompt (instruction) and an untrusted data. The data may contain injected instructions …
Understanding RAG Part IX: Fine-Tuning LLMs for RAG
Be sure to check out the previous articles in this series: •
How to Perform Scikit-learn Hyperparameter Optimization with Optuna
Optuna is a machine learning framework specifically designed for automating hyperparameter optimization , that is, finding an externally fixed setting of machine learning model hyperparameters that optimizes the model’s performance.
5 Reasons Why Traditional Machine Learning is Alive and Well in the Age of LLMs
Nowadays, everyone across AI and related communities talks about generative AI models, particularly the large language models (LLMs) behind widespread applications like ChatGPT, as if they have completely taken over the field of machine learning.
Repurposing Protein Folding Models for Generation with Latent Diffusion
PLAID is a multimodal generative model that simultaneously generates protein 1D sequence and 3D structure, by learning the latent space of protein folding models. The awarding of the 2024 Nobel Prize to AlphaFold2 marks an important moment of recognition for the of AI role in biology. What comes next after protein folding? In PLAID, we …
Read more “Repurposing Protein Folding Models for Generation with Latent Diffusion”
Example Applications of Text Embedding
This post is divided into five parts; they are: • Recommendation Systems • Cross-Lingual Applications • Text Classification • Zero-Shot Classification • Visualizing Text Embeddings A simple recommendation system can be created by finding a few of the most similar items to the target item.
Using Auto Classes in the Transformers Library
This post is divided into three parts; they are: • What Is Auto Classes • How to Use Auto Classes • Limitations of the Auto Classes There is no class called “AutoClass” in the transformers library.
Text Embedding Generation with Transformers
This post is divided into three parts; they are: • Understanding Text Embeddings • Other Techniques to Generate Embedding • How to Get a High-Quality Text Embedding? Text embeddings are to use numerical vectors to represent text.