The 2nd Summer School on Deep Learning in NLP will take place as part of the 14th biennial RANLP conference (RANLP 2023) from 30th August to 1st September 2023 in the city of Varna, Bulgaria.
Deep Learning is a branch of machine learning that has gained significant traction and has advanced the state of the art in Artificial Intelligence, with many sub-disciplines, including natural language, image, and speech processing, employing it widely in their best-performing models.
This summer school will feature presentations from outstanding researchers in the field of Natural Language Processing (NLP) and Deep Learning. These will include coverage of recent advances in theoretical foundations and will be held in conjunction with practical coding sessions showcasing the latest relevant technology.
The summer school would be of interest to novices and established practitioners in the fields of NLP, corpus linguistics, language technologies, and similar related areas.
Materials
This repository contains the materials which will be used in the summer school. We will be using Google Colab for these tutorials.
Programme
Below you will find the programme schedules for three days of the summer school.
30th August | 9.00am
Introduction to NLP tasks
Tharindu Ranasinghe (Aston University, UK)
I will introduce different NLP tasks such as text classification, token classification etc and their applications. Then I will introduce word embeddings and how we can solve the previous tasks using word embeddings and basic neural network architectures.
30th August | 10.30am
Coffee Break
30th August | 11.00am
Word embeddings (contd.)
Tharindu Ranasinghe (Aston University, UK)
30th August | 12.30am
Lunch Break
30th August | 2.00pm
Using word embeddings - Practical session
Practical Session
30th August | 3.30pm
Coffee Break
30th August | 4.00pm - 5.30pm
LSTM and CNNs
Practical Session
31th August | 9.00am
Transformers
Lucas Bayer (Google Brain)
I will introduce the Transformer architecture, diving into very deep detail of how it works while constantly providing intuition at every level. I will also show how it has been used and adapted for many different domains (vision, speech, RL) and tasks beyond the Translation task it was originally invented for.
31th August | 10.30am
Coffee Break
31th August | 11.00am
Transformers (contd.)
Lucas Bayer (Google Brain)
31th August | 12.30am
Lunch Break
31th August | 2.00pm
Finetuning Transformers - Practical session
Practical Session
31th August | 3.30pm
Coffee Break
31th August | 4.00pm
Visualising and tracking transformer training
Practical Session
31th August | 5.00pm - 6.00pm
Panel Discussion - "NLP in the era of large language models"
Tharindu Ranasinghe,
Iacer Calixto,
Lucas Bayer, and
more experts.
1st September | 9.00am
NLP in healthcare: promises and challenges
Iacer Calixto (University of Amsterdam)
In our talk, we discuss pressing methodological and societal challenges on implementing NLP methods for healthcare. We focus on the challenges of data scarcity, patient privacy, model explainability, and model fairness. When applicable, we discuss representative (NLP) methods that (partially) address these challenges, and we also provide research avenues and suggestions on what to do next.
1st September | 10.30am
Coffee Break
1st September | 11.00am
NLP in healthcare: promises and challenges (contd.)
Varna, the largest city on the Bulgarian Black Sea Coast, in the Hotel "Cherno More". This venue is centrally located at the entrance of the Sea Garden and offers excellent conference facilities. The city is a major tourist destination with flights to/from Varna International Airport. It is also known for its Archaeological Museum, which features the oldest gold treasure in the world and is in walking distance from the conference venue.
Contact
For more information please check the RANLP website here.
For any enquiries, please send an email to dlinnlp2023@gmail.com
