Tutorial: Powerful Data Analysis and Composition with the UNIX Shell

Preparation steps

UNIX/Linux/Mac-OS users don't need to install anything, only Windows-users have to install cygwin to run the exercises. There are 32-bit as well as 64-bit versions available. The installation process is straightforward. Please note that gnuplot is not part of the standard installation and must be selected explicitly. The same is true for the installation of the dos2unix-tools (only for line-break conversion between Windows and UNIX).

Presentation Slides

• Presentation Slides

• Supplemental Slidesets about used commands
  • Command Refcard
  • grep command
  • cat, less, head, tail commands
  • tr command
  • sort, uniq, comm, join commands
  • sed & awk commands

Exercises

• Exercise I
• Exercise II
• Exercise III

Datasets

• Gutenberg: The Adventures of Tom Sawyer
• Gutenberg: Moby Dick (2701-0.txt)
• city.csv
• country.csv

Helpful resources

• Command overview for this Tutorial
• awk & sed tutorials from www.theunixschool.com/
• Arnold Robbins, Dale Dougherty. sed & awk from O'Reilly at Safari Online books
• Advanced Bash Scripting Guide: Chapter 16.4 - Text Processing Commands