We are happy to announce the next webinar in the Language Technology webinar series organized by the HiTZ research center (Basque Center for Language Technology, http://hitz.eus). We are organizing one seminar every month. You can check the videos of previous webinars and the schedule for upcomming webinars here: http://www.hitz.eus/webinars
Next webinar: * Speaker: Hinrich Schuetze (University of Munich) * Title: Humans Learn From Task Descriptions and So Should Our Models * Date: November 4, 2021, 15:00 CET * Summary: Task descriptions are ubiquitous in human learning. They are usually accompanied by a few examples, but there is little human learning that is based on examples only. In contrast, the typical learning setup for NLP tasks lacks task descriptions and is supervised with 100s or 1000s and often many more examples. This webinar will introduce Pattern-Exploiting Training (PET), an approach to learning that mimics human learning in that it leverages task descriptions in few-shot settings. PET is built on top of a pretrained language model that "understands" the task description, especially after fine-tuning, resulting in excellent performance compared to other few-shot methods. In particular, a model trained with PET outperforms GPT-3 even though it has 99.9% fewer parameters. The idea of task descriptions can also be applied to reducing bias in text generated by language models. Instructing a model to reveal and reduce its biases is remarkably effective as will be demonstrated in an evaluation on several benchmarks. This may contribute in the future to a fairer and more inclusive NLP.
Check past and upcomming webinars at the following url: http://www.hitz.eus/webinars If you are interested in participating, please complete this registration form: http://www.hitz.eus/webinar_izenematea
If you cannot attend this seminar, but you want to be informed of the following HiTZ webinars, please complete this registration form instead: http://www.hitz.eus/webinar_info
-------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 3226 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20211102/3c77b431/attachment.txt>