Computational Linguistics Course A.A. '05-'06 at FUB
Course Description
Syllabus^
Why is language/speech difficult and interesting?; Ambiguity; History of the field; Morphology; Syntax; Semantics; Pragmatics; Formal Grammars; Parsing; Logic and NLP.
Objectives ^
This course presents a graduate-level introduction to computational linguistics, the primary concern of which is the study of human language use from a computational perspective. The principal objectives of the course are to provide students with a broad overview of the field, and prepare them for further study computational linguistics and language technologies. No previous knowledge of linguistic theory and linguistic applications is assumed. Some background in First Order Logic is preferred.
Grading^
- 50%: You are to complete an independent project on some topic in computational linguistics. Projects will be presented either (a) to the lecturer only (in this case, you will have to send a written report), or (b) to the other students too during the lab session (in this case you will have to prepare slides). The presentation must include a brief overview of the litterature, a critique of a selected paper and a description of your own idea/implementation... Labs will be used to carry out your project under the supervision of the lecturer (see below). Projects' topics will have to be decided together with the lecturer. You can find tips on how to write a paper and on how to give a talk here.
- 50%: final exam. Winter session: Friday 18/11/05 (To be confirmed). Summer Session: TBA.
Practical Info^
- Students: Compulsory course for (first year) students enrolled in the European Masters Program in LCT. Optional course for 2nd and 3rd year bachelor students and students of other MSc offered at FUB, Faculty of CS.
- Pre-requisites: None (some background in Logic is preferred.)
- Lecturer: Dr. Raffaella Bernardi
- Credits: 4 credits for master students and 6 credits for bachelor students (24 hs lectures, 12 hs labs in both cases)
- Schedule: 1st semester 2005-2006, 1st part (October-November). Lectures: Wednesdays (16:00-18:00), Fridays (08:30-10:30). Labs: Fridays (11:00-13:00).
- Place: See the updated info in the: RIS
- Office hours: Fridays 16:00-18:00 during the course period (confirmation by email) or by prior arrangement via e-mail during the whole academic year
^
- 07-10-2005
- Friday 14th of October, there will be 4 hs of labs (08:30-10:30 and 11:00-13:00, Room E531)
- 07-10-2005
- Rember that updated info on the lecture's rooms can be find in the RIS
- 05-10-2005
- This Friday there will be 4 hs of frontal lesson (usal time: 10:30-12:30 and 14:00-16:00 ---check the RIS to know about the Room)
Participants^
For organizational reasons, it would be good if you could register to the course expressing your intend to attend it by sending an e-mail to the lecturer. Please, specify whether you are a Bachelor or a Master student, and, in the latter case, whether you will be following the European Masters Program in LCT. If you have not done it yet, please fill in this form and return it to the lecturer.Material
Textbooks^
The recommended text books for the course are:- Daniel Jurafsky and James H. Martin, Speech and Language Processing, Prentice-Hall, 2000.
- Patrick Blackburn and Kristina Striegnitz (BS) Natural Language Processing Techniques in Prolog
- Patrick Blackburn and Johan Bos (BB1) Representation and Inference for Natural Language A First Course in Computational Semantics
- Patrick Blackburn and Johan Bos (BB2) Working with Discourse Representation Theory
Lecture Notes ^
During the frontal lessons I will use slides that will made available after the lesson from this link.
Labs^
Labs will be divided into two parts. During the first part, they will be organized as reading groups: we will be discussing articles toghether and each student will be asked to report on a specific topic (i.e. give a critique). During the second part, students will work on small projects on their own under the supervision of the lecturers. The topic of the project will be decided togehter on the base of the student interest and the program of the course. Both the critique and the project will be part of the grading.Critiques^
During the first part of the labs, we will have reading groups and presentation by the students of papers that will be listed here.
Guidelines for writing critiques
An example of a critique of A
Prototype Reading Coach that Listens. Mostow et al. AAAI 94.
If you want to write your critique in LaTeX, you will find this site intersting.
- Lauri KarttunenApplications of Finite-State Transducers in NLP [FST, morphology]
- Eric Brill. Transformation-Based Error-Driven Learning and NLP: A case study in POS Tagging. 1995. [PoS]
- Jay Earley An Efficient Context Free Parsing Algorithm. 1970. [Parsing]
- Blackburn and Bos Computational Semantics [Semantics]
- Something about lambda-calculus (with implementation in PROLOG) [Semantics]
- Something about underspecification [Semantics]
- Aravind Joshi. "Tree-Adjoining Grammars". In The Oxford Handbook of Computational Linguistics (In the Library)[FG, TAG]
- Aravind Joshi. "Starting with Complex Primitives Pays Off: Complicate Locally, Simplify Globally". Elsevier Science, 2004. [FG, TAG]
- Michael Moortgat. Categorial grammar and formal semantics. In L. Nagel (ed.) Encyclopedia of Cognitive Science, Vol. 1, pp. 435-447. London, Nature Publishing Group. 2002.[FG, CTL]
- Something about DRT [Discourse]
Projects^
During the second part of the labs, students will carry out small projects on the base of their interest and backgrounds. The topics will be listed here.
Weekly Programme ^
The program below is provisional since it will be adapted to the students background. Slides will be updated through the course after each lesson.| Week | Date | Slides | SLP | Lab | Deepen in/Related to |
|---|---|---|---|---|---|
| 1 | 05/10/05 | Introduction to LCT and CL | Chapters 1-3,8.1,8.2: Course Info; Goals of CL; Challenges: Ambiguities at all levels; Morphology; Finite State Automata; Part-of-Speech; Word Class; Constituency. | FSA: Theory of Computing, Formal Languages PoS: Text Processing | |
| 07/10/05 | Syntax I, Exercises | Chapter 9: Coordination; Formal Grammars; Context-Free Rules and Trees; Sentence-Level Constructions. | |||
| 07/10/05 | Syntax II | Chapters 9, 11: Agreement; The VP and Subcategorization; Feature Structures; Unification of Feature Structures; Features Structures in the Grammar. See also BS | |||
| 2 | 12/10/05 | Parsing | Chapter 10, 11: Bottom up Parsing; Top down Parsing; Depth First Search; Breadth First Search; [Feature Unification]. See also BS | Text Processing, Compiler | |
| 14/10/05 | Lab 0 (intro to prolog) Lab 1 (prolog: ) | ||||
| 3 | 19/10/05 | Semantics, | Chapter 15.1,15.2: Syntax-Driven Semantics; Lambda-Calculus. [Inference]. See also BB1 | Reasoning methods: Computational Logic, Knowledge Representation | |
| 21/10/05 | Semantics II | ||||
| 21/10/05 | |
Lab 2 (parsing) | |||
| 4 | 26/10/05 | Semantics Exercises Solutions | Gamut (ch. 4) | ||
| 28/10/05 | Syntax-Semantics Interface: CG | Lab 3 (CG) | |||
| 5 | 02/11/05 | Categorial Type Logic and CFG | My thesis (ch. 1): Syntax-Semantics Interface in CTL. | and BS: Long Distance Dependency in CFGLab 5 (CTL + CFG) , | |
| 04/11/05 | Formal Grammars II Files on TAG | Slides only History of Formal Grammars; Comparison of Formal Grammars |
|||
| 6 | 09/11/05 | Formal Grammars III | Chapter 13: Generative Power; The Chomsky Hierarchy; Complexity, History and Current Directions of CL | Theory of Computing | |
| 11/11/05 | Discourse | Chapter 18.1,18.2,18.3: Reference Resolution; Text Coherence; Discourse Structure; [DRT]. See BB2 ch. 1 | Lab 6: Projects presenations |