Categories: FAANG

Proxy-FDA: Proxy-Based Feature Distribution Alignment for Fine-Tuning Vision Foundation Models Without Forgetting

Vision foundation models pre-trained on massive data encode rich representations of real-world concepts, which can be adapted to downstream tasks by fine-tuning. However, fine-tuning foundation models on one task often leads to the issue of concept forgetting on other tasks. Recent methods of robust fine-tuning aim to mitigate forgetting of prior knowledge without affecting the fine-tuning performance. Knowledge is often preserved by matching the original and fine-tuned model weights or feature pairs. However, such point-wise matching can be too strong, without explicit awareness of the…
AI Generated Robotic Content

Recent Posts

Chatterbox TTS fork *HUGE UPDATE*: 3X Speed increase, Whisper Sync audio validation, text replacement, and more

Check out all the new features here: https://github.com/petermg/Chatterbox-TTS-Extended Just over a week ago Chatterbox was…

18 mins ago

Agent-based computing is outgrowing the web as we know it

AI agents are moving from passive assistants to active participants. Today, we ask them to…

1 hour ago

Bill Atkinson, Macintosh Pioneer and Inventor of Hypercard, Dies at 74

Atkinson’s gleeful brilliance helped people draw on computer screens and access information via links.

1 hour ago

This “robot bird” flies at 45 mph through forests—With no GPS or light

Unlike birds, which navigate unknown environments with remarkable speed and agility, drones typically rely on…

1 hour ago

Novel analytics framework measures empathy of people captured in video recordings

Empathy, the ability to understand what others are feeling and emotionally connect with their experiences,…

1 hour ago

The 8 Rules of Open-Source Generative AI Club!

Fully made with open-source tools within ComfyUI: - Image: UltraReal Finetune (Flux 1 Dev) +…

1 day ago