Advanced Topics in Computer Science: Embodied Language Understanding

Recent advances in deep learning have ushered in exciting developments in natural language processing (NLP) but comprehending language requires an understanding of contextual signals beyond just reading text, such as visual stimuli, interactive signals from an agent's environment, or even the mental state of other agents. This seminar studies the latest research in the area of embodied language understanding, to develop artificial agents that can understand and generate natural language in the context of extra-linguistic signals.