Categories: AI/ML Research

Custom Fine-Tuning for Domain-Specific LLMs

Fine-tuning a large language model (LLM) is the process of taking a pre-trained model — usually a vast one like GPT or Llama models, with millions to billions of weights — and continuing to train it, exposing it to new data so that the model weights (or typically parts of them) get updated.

Proxy-FDA: Proxy-Based Feature Distribution Alignment for Fine-Tuning Vision Foundation Models Without Forgetting

Vision foundation models pre-trained on massive data encode rich representations of real-world concepts, which can be adapted to downstream tasks by fine-tuning. However, fine-tuning foundation models on one task often leads to the issue of concept forgetting on other tasks. Recent methods of robust fine-tuning aim to mitigate forgetting of…

June 5, 2025

In "FAANG"

Getting Started with Loras and Fine-Tuning on NightCafe

Personalize Your AI Art Like Never Before Today, we introduce the magic of fine-tuning to NightCafe. But, what is fine-tuning? It's a new feature that lets you further customize our AI, teaching it to replicate faces, animals, objects, and styles. How does fine-tuning work? You can begin with just chosen 20 images (we…

September 22, 2023

In "Image"