About
Multilingual multimodal research focuses on collecting resources, developing models, and evaluating systems that need to jointly reason over multilingual text and multimodal inputs, including images, videos, texts, and knowledge bases. Multilingual multimodal NLP presents new and unique challenges. First, it is one of the areas that suffer the most from language imbalance issues. Texts in most multimodal datasets are usually only available in high-resource languages. Second, multilingual multimodal research provides opportunities to investigate culture-related phenomena. On top of the language imbalance issue in text-based corpora and models, the data of additional modalities (e.g. images or videos) are mostly collected from North American and Western European sources (and their worldviews). As a result, multimodal models do not capture our world’s multicultural diversity and do not generalise to out-of-distribution data from minority cultures. The interplay of the two issues leads to extremely poor performance of multilingual multimodal systems in real-life scenarios. This workshop encourages and promotes research efforts towards more inclusive multimodal technologies and tools to assess them. We invite papers which focus on the topics of interest include (but are not limited to):
- Datasets for multilingual multimodal learning
- Modeling multilingual multimodal Data
- Approaches to improving the inclusion of multilingual multimodal models
- Evaluation and analysis for multilingual multimodal learning
- Future challenges of multilingual multimodal research
Invited Talks (In alphabetical order)
Important Dates
Important Dates:
- February 28, 2022: Submission Date
- March 26, 2022: Notification of Acceptance
- April 10, 2022: Camera-ready papers due (hard deadline)
- May 27, 2022: Workshop on Multimodal Multilingual Learning
Organizers and Contact
Organizers are in the alphabetical order. For any question, please contact mml DOT wksp AT gmail DOT com.
- Emanuele Bugliarello (University of Copenhagen)
- Kai-Wei Chang (UCLA)
- Desmond Elliott (University of Copenhagen)
- Spandana Gella (Amazon Alexa AI)
- Aishwarya Kamath (NYU)
- Liunian Harold Li (UCLA)
- Fangyu Liu (Cambridge)
- Jonas Pfeiffer (TU Darmstadt)
- Edoardo M. Ponti (MILA Montreal)
- Krishna Srinivasan (Google Research)
- Ivan Vulić (Cambridge)
- Yinfei Yang (Google Research)
- Da Yin (UCLA)
Follow Us
Twitter: @MML_WKSP
Sponsors
We are grateful for the generous funding from our list of sponsors:
