28.08.2020

LANTERN workshop at COLING 2020

Barcelona, Spain — December 13, 2020
Workshop website: https://www.lantern.uni-saarland.de/2020/

——————————————

ABOUT THE WORKSHOP

——————————————

LANTERN: The Second Workshop Beyond Vision and LANguage: InTEgrating Real World KNowledge

Language is acquired, used, and evaluated by understanding the world around us. It is thus essential to capture such an understanding by exploiting knowledge from sources that are useful for grounding language. Recent work showed the potential of visually-grounded language in addressing task-specific challenges (e.g., visual captioning, VQA, dialog, etc.). In this workshop, we aim to go beyond the task-specific integration of language and vision, and encourage submissions that leverage knowledge from external sources that are either provided by an environment or some fixed knowledge.

Our motto: When you are groping in the dark, knowledge gives you the light!

——————————————

TOPICS OF INTEREST

——————————————

Topics of interest include, but are not limited to:

Application of language and vision to robotics
Cognitively- and neuroscience-driven vision and language learning (eye-tracking, fMRI, etc.)
Common-sense knowledge acquisition from vision
Enhancing visual perception with language and structured knowledge
Human-robot interaction with language understanding and visual perception
Integration of vision and language by building cross-modal relationship networks
Integrated models of real-world knowledge, vision, and language for generating context-sensitive embeddings
Language and vision for learning games
Learning of quantities from vision
Multi-task learning for integration of language and vision
Reasoning with language to improve visual perception
Text-to-Image (natural, sketch, synthetic) generation with external knowledge
Theoretical understanding of limitations in the integration of vision and language
Visual dialog, captioning and Q&A by incorporating common-sense/real-world knowledge
Other novel tasks which combine language and vision with means of external knowledge

——————————————

IMPORTANT DATES

——————————————

Deadline for submission: August 21, 2020
Notification of acceptance: September 24, 2020
Deadline for camera-ready version: October 11, 2020
Workshop date: December 13, 2020

All deadlines are calculated at 11:59pm Pacific Daylight Savings Time (UTC – 12h)

——————————————

INVITED SPEAKERS

——————————————

Yonatan Bisk, Microsoft Research & CMU
Gemma Boleda, Universitat Pompeu Fabra & ICREA
Angeliki Lazaridou, DeepMind
Stefan Lee, Oregon State University

———————————————–

SUBMISSION INSTRUCTIONS

———————————————–

We solicit two categories of papers: long and short workshop papers that will be included in the workshop proceedings as archival publications. All submissions should be in PDF format and made through the Softconf link (https://www.softconf.com/coling2020/LANTERN/)

Submissions will go through a double-blind review process, where each submission is reviewed by at-least two program committee members. Accepted papers will be presented by the authors in a regular workshop session either as a talk or a poster.

All submissions must be written in English and follow the COLING 2020 formatting requirements using either Word or LaTeX template files provided by COLING 2020 (https://coling2020.org/).

Long paper submission: up to 9 pages of content, plus bibliography
Short paper submission: up to 4 pages of content, plus bibliography

——————————————