Checking date: 29/06/2021


Course: 2021/2022

Natural language processing with deep learning
(18834)
Master in Computer Science and Technology (Plan: 462 - Estudio: 71)
EPI


Coordinating teacher: SEGURA BEDMAR, ISABEL

Department assigned to the subject: Computer Science and Engineering Department

Type: Compulsory
ECTS Credits: 3.0 ECTS

Course:
Semester:




Objectives
- Create and train deep neural network architectures (such as Convolutional Neural Networks, Recurrent Neural Networks, LSTMs, Transformers) and apply them to tackle NLP applications such as text classification, machine translations, information extraction, text simplification and text summarization. - Study, implement and use word embeddings to represents texts.
Skills and learning outcomes
Description of contents: programme
1. Introduction 2. NLP basic tasks. 3. Word embeddings. 4. Deep Learning architectures for text classification. 5. Deep Learning architectures for named entity recognition (NER). 6. Deep Learning architectures for relation extraction (RE). 7. Text similarity 8. Deep Learning architectures for text summarization. 9. Deep Learning architectures for machine translation.
Learning activities and methodology
The flippled classroom model will be applied: Each week, the teacher will publish in aulaglobal a Jupyter notebook that describes and contains the implementation of a deep architecture for the resolution of a certain NLP application (for example, the detection of fake news or the anonymization of clinical notes). Students should study and run these notebooks before class. During class, the teacher will explain the notebook and resolve any possible doubts. Once resolved, the teacher will propose possible improvements and raises new challenges or problems to solve. Students should try to extend or adapt the implementations of notebooks to solve the new challenges posed by the teacher. The methodology is practical. The classes will have a configuration of work in pairs in a computer room. Tutoring by appointment is limited to 2 hours per week. These can be online or face to face.
Assessment System
  • % end-of-term-examination 0
  • % of continuous assessment (assigments, laboratory, practicals...) 100
Calendar of Continuous assessment
Basic Bibliography
  • Delip Rao, Brian McMahan. Natural Language Processing with PyTorch: Build Intelligent Language Applications Using Deep Learning. o'really. 2019
  • Delip Rao, Brian McMahan. Natural Language Processing with PyTorch: Build Intelligent Language Applications Using Deep Learning. o'really. 2019
  • Li Deng (Redactor), Yang Liu (Redactor). Deep Learning in Natural Language Processing. SPRINGER. 2018
  • Palash Goyal, Sumit Pandey, Karan Jain. Deep Learning for Natural Language Processing: Creating Neural Networks with Python. APRESS. 2018
  • Edward Loper, Steven Bird, Ewan Klein. Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit. 0'REALLY. 2009
Recursos electrónicosElectronic Resources *
Additional Bibliography
  • Amandeep . Implement NLP use-cases using BERT: Explore the Implementation of NLP Tasks Using the Deep Learning Framework and Python. bpb. 2021
(*) Access to some electronic resources may be restricted to members of the university community and require validation through Campus Global. If you try to connect from outside of the University you will need to set up a VPN


The course syllabus may change due academic events or other reasons.