3 Smart Ways to Encode Categorical Features for Machine Learning
If you spend any time working with real-world data, you quickly realize that not everything comes in neat, clean numbers.
Pretraining a Llama Model on Your Local GPU
This article is divided into three parts; they are: • Training a Tokenizer with Special Tokens • Preparing the Training Data • Running the Pretraining The model architecture you will use is the same as the one created in the
Rotary Position Embeddings for Long Context Length
This article is divided into two parts; they are: • Simple RoPE • RoPE for Long Context Length Compared to the sinusoidal position embeddings in the original Transformer paper, RoPE mutates the input tensor using a rotation matrix: $$ begin{aligned} X_{n,i} &= X_{n,i} cos(ntheta_i) – X_{n,frac{d}{2}+i} sin(ntheta_i) \ X_{n,frac{d}{2}+i} &= X_{n,i} sin(ntheta_i) + X_{n,frac{d}{2}+i} cos(ntheta_i) …
Read more “Rotary Position Embeddings for Long Context Length”
5 Agentic Coding Tips & Tricks
Agentic coding only feels “smart” when it ships correct diffs, passes tests, and leaves a paper trail you can trust.
How to Fine-Tune a Local Mistral or Llama 3 Model on Your Own Dataset
Large language models (LLMs) like Mistral 7B and Llama 3 8B have shaken the AI field, but their broad nature limits their application to specialized areas.
A new tool is revealing the invisible networks inside cancer
Spanish researchers have created a powerful new open-source tool that helps uncover the hidden genetic networks driving cancer. Called RNACOREX, the software can analyze thousands of molecular interactions at once, revealing how genes communicate inside tumors and how those signals relate to patient survival. Tested across 13 different cancer types using international data, the tool …
Read more “A new tool is revealing the invisible networks inside cancer”
Gemini 3 Flash: frontier intelligence built for speed
Gemini 3 Flash offers frontier intelligence built for speed at a fraction of the cost.
BED-LLM: Intelligent Information Gathering with LLMs and Bayesian Experimental Design
We propose a general-purpose approach for improving the ability of Large Language Models (LLMs) to intelligently and adaptively gather information from a user or other external source using the framework of sequential Bayesian experimental design (BED). This enables LLMs to act as effective multi-turn conversational agents and interactively interface with external environments. Our approach, which …
Read more “BED-LLM: Intelligent Information Gathering with LLMs and Bayesian Experimental Design”
A New Era of Defense Innovation
Leading the Charge on Procurement Reform America’s defense industrial base stands on the precipice of massive, historic change. Given its access to a flourishing and dynamic private sector, the US defense industrial base should be a nimble, powerful engine of both creativity and lethality, capable of churning out the kinds of innovations that guarantee dominance …
Introducing SOCI indexing for Amazon SageMaker Studio: Faster container startup times for AI/ML workloads
Today, we are excited to introduce a new feature for SageMaker Studio: SOCI (Seekable Open Container Initiative) indexing. SOCI supports lazy loading of container images, where only the necessary parts of an image are downloaded initially rather than the entire container. SageMaker Studio serves as a web Integrated Development Environment (IDE) for end-to-end machine learning (ML) development, …