Web Mining

Laurea Magistrale in Computer Science
Academic year 2010-2011, second semester

News

Registration, optional oral exams, discussions

• Tuesday, June 21, at 09:30, in my office (Faculty old building, stairs in the main entrance, first floor, right corridor).

Exam results, solutions

• The results of the written proof (June 14, 2011) have been published on Esse3.
• The text and solutions are below.

Schedule

• Wednesday and Friday, 0830-1030, room A213

Every student in the course is kindly asked to send me an email containing name and matricola number. Every mail exchanged for purposes related to the course should contain [webmining] in the subject.

Program

1. Web crawling
2. Web page indexing
3. Information retrieval
4. Unsupervised learning: clustering
5. PageRank and HITS
6. Search engine attack and defense strategies

Bibliography

Official Textbook

• SOUMEN CHAKRABARTI
  Mining the Web - Discovering knowledge from hypertext data
  Morgan Kaufmann - Elsevier, 2003.
  ISBN: 978-1-55860-754-5

External links

• Google research page on MapReduce (see both paper and slides)
• Paper about the FastMap algorithm
• Paper about the PageRank algorithm

Course material

Sample code

• Word counting (using the Hadoop framework)
• Earliest occurrence (using the Hadoop framework)
• Code for the LSI example (uses the R statistical package)
• PageRank sample code
• HITS sample code

Exercises

• Exercise sheet (2011-05-18 version. Check the date for updates)

Exam sheets

• 2011-06-14 [text] [solution]