Logo FIB

Master in Artificial Intelligence (MAI)

Advanced Human Language Technology - Spring 2024

Instructor

Sessions

Date Content
February 15th Introduction
Statistical Language Models
MLE practical example
Lab Session 1 : Group 11
Task data & other stuff
Guidelines and code for task 1 (rule-based NERC)
February 22nd MEM practical example
Exercises about estimation and smoothing
Lab Session 1 : Group 12
Task data & other stuff
Guidelines and code for task 1 (rule-based NERC)
February 29th Lexical similarity. Distributional Semantics.
Exercises about similarities
Lab Session 2 : Group 11
Guidelines and code for task 2 (ML-based NERC)
March 7th Sequence Prediction
Exercises about features
Lab Session 2 : Group 12
Guidelines and code for task 2 (ML-based NERC)
March 14th Constituency Parsing
Exercises about constituent parsing
Lab Session 3 : Group 11
Guidelines and code for task 3 (rule based DDI)
March 21st Dependency Parsing
Exercises about dependency parsing
Lab Session 3 : Group 12
Guidelines and code for task 3 (rule based DDI)
March 28th No class (spring break)
April 4th No class - FIB midterm exam week
(No AHLT midterm, though)
April 11th Recap exercises on all previous topics
Lab Session 4 : Group 11
Guidelines and code for task 4 (machine-learning DDI)
April 18th Word Vectors
Word Vectors (old)
Exercises about Word Embeddings
Lab Session 4 : Group 12
Guidelines and code for task 4 (machine-learning DDI)
April 25th Word Classification
Exercises about Word Classification
Lab Session 5 : Group 11
Guidelines and code for task 5 (NN-based NER)
May 2nd Recurrent NN Language Models
Exercises about RNNs
Lab Session 5 : Group 12
Guidelines and code for task 5 (NN-based NER)
May 9th Transformers
Advanced Transformers
Sequence-to-sequence
Lab Session 6 : Group 11
Guidelines and code for task 6 (NN-based DDI)
May 16th Large Language Models
Ethics
Lab Session 6 : Group 12
Guidelines and code for task 6 (NN-based DDI)
May 23 Discussion/Review
Lab Session 7 : Group 11
Consulting & Autonomous Work
May 23 Recap exercises on all previous topics
Lab Session 7 : Group 12
Consulting & Autonomous Work

Resources

Books

  • Alexander Clark, Chris Fox, Shalom Lappin (eds.)
    The Handbook of Computational Linguistics and Natural Language Processing
    Blackwell Handbooks in Linguistics, John Wiley & Sons, 2012.
  • R. Dale, H. Moisl, H.Somers (eds.)
    Handbook of Natural Language Processing
    Marcel Dekker, New York, 2000.
  • Nitin Indurkhya, Fred J. Damerau
    Handbook of Natural Language Processing, Second Edition
    Chapman & Hall/CRC Machine Learning & Pattern Recognition, 2010.
  • D. Jurafsky, James H. Martin
    Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
    Prentice Hall, Upper Saddle River, N.J., 2017
  • C. Manning, H. Schütze
    Foundations of Statistical Natural Language Processing
    MIT Press, Cambridge, Mass., 1999.
  • R. Mitkov (ed.)
    The Oxford Handbook of Computational Linguistics
    Oxford University Press, 2004.

Similar Courses

Software

Important Dates

March 24th Deadline for delivery of NER report (lab tasks 1 and 2)
May 12th Deadline for delivery of DDI report (lab tasks 3 and 4)
June 20th, 15:30-18:30h Final exam
June 21st Deadline for delivery of NN report (lab tasks 5 and 6)

Solved Exercises