Learn Data Science with Bash Shell

Gain insights into data processing using Bash, sed, awk, and RegEx. Explore sorting, searching, replacing, and optimizing data tasks interactively with animated videos, projects, quizzes, and tasks.

Beginner

71 Lessons

Certificate of Completion

Gain insights into data processing using Bash, sed, awk, and RegEx. Explore sorting, searching, replacing, and optimizing data tasks interactively with animated videos, projects, quizzes, and tasks.

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

91 Playgrounds

This course includes

91 Playgrounds

Course Overview

2500+ students have taken this innovative project-based data learning course (includes video lectures). It demonstrates the use of Bash shell (Bash, sed and awk including RegEx) in processing textual data. It can help to learn to sort, search, match, replace, clean and optimize various aspects of data with Bash Shell. The target audience (students, researchers, scientists, journalists, data miners, developers) didn't have to go through any tough learning curve. This course also should have helped RedHat, Su...Show More

Course Content

Course Introduction

Get familiar with using Bash for efficient data manipulation and foundational scripting skills.

Introduction What is Bash?

Project 1: Analyzing the 'US News' University Ranking Data

Get started with analyzing university ranking data using essential Bash commands.

Unirank: Data Preview (head, pipe and csvlook)

Find the colleges in the ranklist (grep, pipe and wc)

Finding the percent of colleges in the ranklist (wc, grep)Listing the Institutes from a given state (grep)

Finding the number of Institutes from each state Finding the correlation between university tuition and ranks Project demonstration Project Summary Test your skills

Project 2: Facebook Data Mining

Go hands-on with mining Facebook data using Bash commands for insightful analysis.

FB: Data Preview (csvstat, csvcut, head, cat)Finding the number of status entry (csvcut, sort, uniq)Find the most popular status entry (awk, sort, cat, csvcut, head)Finding the most popular entry (Bash function)Project demonstration Project Summary Test your skills

Project 3: Australian Cities Crime Statistics

Break down the steps to analyze Australian cities' crime stats using Bash commands.

AU Crime Stats: Introduction Data Preview Row and Columns Statistics (sed, wc, head, cat)Finding the top most crime in the whole country (sort, tail, awk)Finding the top most crime per city (csvcut, sort, tail, awk)Finding the best city in Australia! (Bash Shell Script)Prject demonstration Project Summary Test your skills

Project 4: Shakespearean-era plays and poems data mining

Solve problems in analyzing Shakespearean texts using advanced Bash commands and data mining techniques.

Plays and Poems: Data Preview (cat, cut, head and csvlook)Counting the Plays and Poems (head, sed, grep, wc)Finding plays/poems by each author (sed, sort, uniq, head)Finding the most frequent words by Shakespeare Project Summary

Bash Tutorials

11 Lessons

Investigate Bash scripting essentials from basics, variables, and command execution to redirections and loops.

REGEX Tutorials

7 Lessons

Analyze regex fundamentals, BRE and ERE syntax, character classes, lookarounds, atomic groups, and Bash regex usage.

AWK Tutorials

4 Lessons

Get familiar with AWK's text processing capabilities, variables, functions, and practical examples.

SED, GREP and Find Tutorials

6 Lessons

Grasp the fundamentals of powerful text-processing and search tools: SED, GREP, and Find.

10.

Beyond the Text Files! Enter into the Big Data Landscape - Concepts

10 Lessons

Examine key technologies in Hadoop's Big Data landscape, including HDFS, MapReduce, YARN, and more.

11.

Conclusion

1 Lesson

Enhance your skills in data science tools, practical applications, and further learning resources.

Course Author

Trusted by 1.4 million developers working at companies

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Evan Dunbar

ML Engineer

Carlos Matias La Borde

Software Developer

Souvik Kundu

Front-end Developer

Vinay Krishnaiah

Software Developer

Eric Downs

Musician/Entrepeneur

Kenan Eyvazov

DevOps Engineer

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!