[Corpora-List] The 5th Workshop on Vision and Language (VL'16): Call for Participation

Anya Belz A.S.Belz at brighton.ac.uk
Tue Jul 5 15:34:35 CEST 2016

Call for Participation


At ACL'16, Berlin, Germany

12 August 2016

Organised by COST Action IC1307 The European Network on Integrating Vision and Language (iV&L Net)


Invited Speaker: Yejin Choi, University of Washington


Research involving both language and vision computing spans a variety of disciplines and applications, and goes back a number of decades. In a recent scene shift, the big data era has thrown up a multitude of tasks in which vision and language are inherently linked. The explosive growth of visual and textual data, both online and in private repositories by diverse institutions and companies, has led to urgent requirements in terms of search, processing and management of digital content. Solutions for providing access to or mining such data effectively depend on the connection between visual and textual content being made interpretable, hence on the 'semantic gap' between vision and language being bridged.

One perspective has been integrated modelling of language and vision, with approaches located at different points between the structured, cognitive modelling end of the spectrum, and the unsupervised machine learning end, with state-of-the-art results in many areas currently being produced at the latter end, in particular by deep learning approaches.

Another perspective is exploring how knowledge about language can help with predominantly visual tasks, and vice versa. Visual interpretation can be aided by text associated with images/videos and knowledge about the world learned from language. On the NLP side, images can help ground language in the physical world, allowing us to develop models for semantics. Words and pictures are often naturally linked online and in the real world, and each modality can provide reinforcing information to aid the other.

The 5th Workshop on Vision and Language (VL’16) aims to address all the above, with a particular focus on the integrated modelling of vision and language. We welcome papers describing original research combining language and vision. To encourage the sharing of novel and emerging ideas we also welcome papers describing new data sets, grand challenges, open problems, benchmarks and work in progress as well as survey papers.

The European Network on Integrating Vision and Language (iV&L Net):

The explosive growth of visual and textual data (both on the World Wide Web and held in private repositories by diverse institutions and companies) has led to urgent requirements in terms of search, processing and management of digital content. Solutions for providing access to or mining such data depend on the semantic gap between vision and language being bridged, which in turn calls for expertise from two so far unconnected fields: Computer Vision (CV) and Natural Language Processing (NLP). The central goal of iV&L Net is to build a interdisciplinary European CV/NLP research community, targeting 4 focus themes: (i) Integrated Modelling of Vision and Language for CV and NLP Tasks; (ii) Applications of Integrated Models; (iii) Automatic Generation of Image & Video Descriptions; and (iv) Semantic Image & Video Search. iV&L Net organises and funds annual summer schools, technical meetings, research visits, data/task bench marking, and industry/end-user liaison.


--- 09:00-10:30 ------ * Opening * Mohamed Elhoseiny, Scott Cohen, Walter Chang, Brian Price and Ahmed Elgammal: Automatic Annotation of Structured Facts in Images * Manuela Hürlimann and Johan Bos: Combining Lexical and Spatial Knowledge to Predict Spatial Relations between Objects in Images --- 10:30-11:00 ------ Coffee Break --- 11:00-12:30 ------ * Invited talk: Yejin Choi, University of Washington * Micah Hodosh and Julia Hockenmaier: Focused Evaluation for Image Description --- 12:30-14:00 ------ Lunch --- 14:00-15:30 ------ * Mert Kilickaya, Nazli Ikizler-Cinbis, Erkut Erdem and Aykut Erdem: Leveraging Captions in the Wild to Improve Object Detection * Quick-fire presentations for posters (5mins each) --- 15:30-16:00 ------ Break --- 16:00-17:30 ------ Poster Session: * Nouf Alharbi and Yoshihiko Gotoh: Natural Language Descriptions of Human Activities Scenes: Corpus Generation and Analysis (LP) * Yanchao Yu, Arash Eshghi and Oliver Lemon: Interactively learning visually grounded word meanings from a human tutor * Emiel van Miltenburg, Roser Morante and Desmond Elliott: Pragmatic factors in image description: the case of negations * Sandro Pezzelle, RAVI SHEKHAR and Raffaella Bernardi: a bagpipe with a bag and a pipe: Exploring Conceptual Combination in Vision * Anja Belz, Adrian Muscat and Brandon Birmingham: Exploring Different Preposition Sets, Models and Feature Sets in Automatic Generation of Spatial Image Descriptions * Desmond Elliott, Stella Frank, Khalil Sima'an and Lucia Specia: Multi30K: Multilingual English-German Image Descriptions * Ionut Sorodoc, Angeliki Lazaridou, Gemma Boleda, Aurélie Herbelot, Sandro Pezzelle and Raffaella Bernardi: ``Look, some green circles!'': Learning to quantify from images * Alexander Mehler, Tolga Uslu and Wahed Hemati: text2voronoi - An Image-driven Approach to Differential Diagnosis * Olivia Winn, Madhavan Kavanur Kidambi and Smaranda Muresan: Detecting Visually Relevant Sentences for Fine-Grained Classification

Travel Grants:

We have a limited number of travel grants available for students who are members of iV&L Net. Please write to a.s.belz at brighton.ac.uk by 15 July 2016 to apply for a grant and/or iV&L Net membership.

Bring Your Own Poster:

All participants can bring posters along on the day of the workshop, up to A2 in size. There will be spare poster boards available during the poster session. Please put up your posters at the beginning of the session.


Anya Belz, University of Brighton, UK Erkut Erdem, Hacettepe University, Turkey Katerina Pastra, CSRI and ILSP Athena Research Center, Athens, Greece Krystian Mikolajczyk, Imperial College London, UK

Contact and Links:

Contact: a.s.belz at brighton.ac.uk<mailto:a.s.belz at brighton.ac.uk> Workshop website: http://vision.cs.hacettepe.edu.tr/vl2016/<http://vision.cs.hacettepe.edu.tr/vl2015/> iV&L Net website: http://ivl-net.eu

___________________________________________________________ This email has been scanned by MessageLabs' Email Security System on behalf of the University of Brighton. For more information see: https://staff.brighton.ac.uk/is/computing/Pages/Email/spam.aspx -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 10165 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20160705/799bac5c/attachment.txt>

More information about the Corpora mailing list