Tutorial: How to build a Search-Engine with Common Unix-Tools

Preparation steps

UNIX/Linux/Mac-OS users don't need to install anything, only Windows-users have to install cygwin to run the exercises. There are 32-bit as well as 64-bit versions available. The installation process is straightforward.

Presentation Slides

• Presentation Slides

• Supplemental Slidesets about used commands
  • Command Refcard
  • grep command
  • cat, less, head, tail commands
  • tr command
  • sort, uniq, comm, join commands
  • sed & awk commands

Exercises

• Exercise I (Text Analytics)
• Exercise II (Build an Inverted-Index)
• Exercise III (Querying)

  Helpful resources

  • Command overview for this Tutorial
  • awk & sed tutorials from www.theunixschool.com/
  • Arnold Robbins, Dale Dougherty. sed & awk from O'Reilly at Safari Online books
  • Advanced Bash Scripting Guide: Chapter 16.4 - Text Processing Commands