Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer
In this work, we analyze a pre-trained mT5 to discover the attributes of cross-lingual connections learned by this model. Through a statistical interpretation framework over 90 language pairs across three tasks, we show that transfer performance can be modeled by a few linguistic and data-derived features. These observations enable us to interpret cross-lingual understanding of …
Read more “Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer”