SED command in UNIX is stands for stream editor and it can perform lot's of function on file like, searching, find and replace, insertion or deletion. Though most common use of SED command in UNIX is for substitution or for find and replace. By using SED you can edit files even without opening it, which is much quicker way to find and replace something in file, than first opening that file in VI Editor and then changing it. In this SED command tutorial we will see some practical examples of SED command in UNIX based systems e.g. Linux. I must say having a good grip on find, grep, sort, vi editor and SED can take you next level of UNIX and Linux working experience. These are very powerful UNIX command and helps with lot of different tasks in server. By the way we will use following text file for our SED common example. As I have said before, best way to learn any UNIX command is to use them in your day to day task, and a good example is a good start. This file contains details of some popular android and iPhone smartphones, e.g. Model, company, price etc, separated by colon. You can also use any CSV file for this example.
Few things to keep in mind about SED in UNIX
1) SED is a powerful text stream editor. Can do insertion, deletion, search and replace(substitution).
2) SED command in unix supports regular expression which allows it perform complex pattern matching.
SED command to Remove a Line from File in UNIX:
Using SED command to delete lines or remove lines is one of the popular use of SED command in unix. most of the time you either delete first line or last line in unix. "d" flag is used to delete lines in SED. Following example of SED command in unix will show how to delete first and last line in UNIX based system e.g. Linux:
sed command to delete first line
$ sed '1d' list-of-smartphones-2011.txt
sed command to delete last line
$ sed '$d' list-of-smartphones-2011.txt
sed command to delete from line 1,4
$ sed '1,4d' list-of-smartphones-2011.txt
quote around "d" is not mandatory but its good practice and increase readability.
SED Command to Remove blank lines
One of the common usage of SED command is to delete empty lines or remove blank lines from files, without opening them. Unix sysadmin often use SED command in Linux to clean up files by removing empty lines. Following example of UNIX SED command will show you how to remove blank lines using SED in unix:
sed '/^$/d' list-of-smartphones-2011.txt
here text between /--/ is a regular expression for matching matching empty lines i.e. “^$”. Since “^” denote start of line and “$” denote end of line, “^$” means empty lines.
I have inserted 3 blank line in our example file and now number of lines are 10
with this same technique we can remove spaces, or any lines which is matching to a string by using sed command in unix.
SED Command to Remove Matching String in UNIX
In this SED command example, we will learn how to remove lines which are matching to particular text.
Above sed command in unix has already removed all lines which matches string "Apple" in it. You can see that, there is no line which contains “Apple”, because they are already removed.
UNIX SED Command to Find and Replace text from File
One of my favorite use of SED command in UNIX is, to find and replace strings or patterns without opening file. Though you can also do find and replace in VI, sed is much faster for such operation, especially if you are dealing with large files which can take relative long time to open in Vi editor. Linux SED command support regular expression which allows you to peform sophisticated find and replace in unix. "s" flag is used for substitution in sed and it works mostly like in VI.
SED command to find and replace:
sed 's/Apple/Microsoft/' list-of-smartphones-2011.txt
In below example of unix SED command we will find "Apple" in line and replace it with "Microsoft" string.
An important thing is to note here is that it will only replace first occurrence of matching string on each line. Suppose if you have two matching string in one line , second will not be deleted. You can see this in second line of above SED command example, Apple is not replaced by Microsoft, to remove all occurrence of matching string use "g" at the end.
That’s all on How to use SED command in UNIX based operating systems like Linux or Solaris. We have seen some of the most common examples of SED command, e.g. doing find and replace in file without opening it.