Coding/Learn/bash/bash exercises
Bash Shell & CLI Automation Complete Course
01.What Bash Is & Shell Architecture
02.Terminal and Shell Basics
03.Running Commands & PATH Resolution
04.Command Structure: Options, Flags & Arguments
05.Getting Help with Commands: man, info & --help
06.Basic Filesystem Navigation & Directory Hierarchy
07.Listing Files with ls & Options
08.Changing Directories with cd
09.Current Directory: pwd & $PWD Variable
10.Creating Files: touch, Redirection & Here-Docs
11.Creating Directories with mkdir & Nested Parents
12.Copying Files and Directories with cp
13.Moving and Renaming Files with mv
14.Removing Files and Directories with rm & rmdir
15.Viewing File Contents: cat, less, more, head & tail
16.Command Aliases: alias, unalias & Persistence
17.Searching Text with grep & ripgrep
18.Pattern Matching: Regex & Extended Globs
19.Processing Columns & Structured Data with awk
20.Editing Text Streams with sed
21.Extracting Sections with cut, paste & tr
22.Sorting and Deduplication with sort & uniq
23.Viewing Beginning & End: head, tail & wc
24.Understanding Linux Processes & PID Lifecycle
25.Process Monitoring: top, htop & Background Jobs
26.Monitoring Disk Space with df
27.Directory Size Analysis with du & ncdu
28.Monitoring Memory Usage with free & /proc/meminfo
29.Terminating Processes: kill, killall, pkill & Signals
30.System Uptime, Load & Reboot History
31.Testing Connectivity: ping, nc, traceroute & nslookup
32.Making HTTP Requests with curl
33.Downloading Files with wget & curl -O
34.Remote SSH Connections: ssh, Keys & Config
35.Secure File Transfer with scp & sftp
36.File Synchronization with rsync
37.Creating and Managing ZIP Files
38.Extracting Archives: unzip & Safe Decompression
39.TAR Archives: Tape Archive Basics (tar -cvf, -tvf, -xvf)
40.Creating and Extracting Compressed Files (.tar.gz, .tar.bz2, .tar.xz)
41.Users and Groups: /etc/passwd, /etc/group & id
42.File Ownership: User Owner, Group Owner & Inodes
43.Read, Write & Execute Permissions: Files vs Directories
44.Changing Permissions with chmod: Symbolic & Octal Modes
45.Changing Ownership with chown
46.Changing Groups with chgrp & SetGID Inheritance
47.Script Structure & Strict Mode (set -euo pipefail)
48.The Shebang (#!) & Interpreter Portability
49.Variables: Declaration, Scope & Parameter Expansion
50.Data Types, Typeset & Declare Attributes
51.Operators: Arithmetic, String & Logical Operators
52.Handling User Input: read, Prompts & Secret Masking
53.Conditional Branching: if, elif, else & case Statements
54.Loops: for, while, until & Loop Control (break, continue)
55.Functions: Declarations, Local Scope & Return Values
56.Arrays: Indexed Arrays, Associative Maps & Slicing
57.Exit Codes ($?), Error Handling & Custom Exits
58.Scheduling with Cron & Crontab Automation
59.Combining Commands: Semicolons (;), &&, || & Subshells
60.Pipes (|), Pipefail & Process Pipelines
61.I/O Redirection: >, >>, 2>, 2>&1, &>, /dev/null & Here-Strings
62.Environment Variables: export, env, printenv & .env Loading
63.Command Substitution: $(command) vs Legacy Backticks
64.Basic Automation: Batch Processing & Lockfiles
65.Small Real-World Scripts: Health Checkers & Backup Utilities
66.Comprehensive Bash Exercises: Pipeline & Automation Challenges
67.Core Knowledge Quiz & Conceptual Review
68.Capstone Mini-Project: Automated Backup & Health Dispatcher
69.Course Completion & Verified Certificate
Course Certificate0%

Complete all lessons to earn

LearnComprehensive Bash Exercises: Pipeline & Automation Challenges
66 / 69 0%
Lesson 66 of 69
6 mins read

Comprehensive Bash Exercises: Pipeline & Automation Challenges

PreviousNext Lesson
In Plain English

Test your command line mastery across essential system engineering scenarios: extracting specific columns from access logs, filtering active processes, calculating memory consumption, and batch archiving directories.

The Mental Model

"Think of this as the obstacle course where you apply every tool from your terminal utility belt (grep, awk, sed, cut, sort, uniq, tar, and bash scripting) in rapid succession."

Deep Dive: How It Works

Challenge 1: Parse a mock web server log and extract the top 3 most requested API endpoints.

Challenge 2: Process numbers in a loop, calculate sums, and output formatted summaries.

Challenge 3: Combine parameter expansion and string manipulation to sanitize filenames.

Syntax Blueprint

# Challenge Pipeline:
cat access.log | awk '{print $7}' | sort | uniq -c | sort -nr | head -n 3

Chain core Unix tools to solve real-world system data extraction challenges.

PointCore Rules to Remember

Point star
Tool Synergy: Combining single-purpose CLI utilities yields immense analytical power.
Point star
Defensive Scripting: Ensure your scripts handle empty lines, whitespace, and non-zero exit codes gracefully.
Point star
Terminal Efficiency: Solve complex problems in 1-3 lines of elegant piped bash code.

Common Beginner Traps & How to Fix Them

Mistake:Trying to write 50 lines of complex script when a 1-line awk/grep pipeline solves it.

Why it happens: Overcomplicating straightforward text filtering problems.

How to fix: Embrace Unix philosophy: stream data through pipes.

Pro Tip: Always start pipeline development step by step, inspecting stdout after adding each pipe stage.

Live Interactive Example

Hit Run Code to see it live
Top Endpoint Analytics Pipeline Challenge
Git 2.45 / CLI
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
Output Console
Click "Run Code" to view the rendered output.
How it works: awk extracted the path, sort grouped identical endpoints, and uniq -c counted requests.

Your Turn: Micro Challenge

No pressure! Edit the starter code below and test your solution with instant feedback.

Micro Exercise

Extract Top Endpoint

  • PointCreate a pipeline that prints the top endpoint: `printf "/api/users\n/api/users\n/api/auth\n" | sort | uniq -c | sort -nr | head -n 1`.
1
2
3
Sandbox Output
Click "Run & Check" to test your solution.

Finished reading and practicing?

Mark this lesson as completed to update your course progress.

PreviousNext Lesson
Overview100 SheetLearnCertificates