Robustness in Multimodal Learning under Train-Test Modality Mismatch
Multimodal learning is defined as learning over multiple heterogeneous input modalities such as video, audio, and text. In this work, we are concerned with understanding how models behave as the type of modalities differ between training and deployment, a situation that naturally arises in many applications of multimodal learning to hardware platforms. We present a …
Read more “Robustness in Multimodal Learning under Train-Test Modality Mismatch”