Tuesday, February 10th, 2009 / 2,386 views

Remove duplicate lines using uniq

   

Display all the lines sorted in alphabetic order:

sort file_name

Now show only the unique lines:

sort file_name | uniq

And finally save the unique lines in a new file:

sort file_name | uniq > file_name_uniques

Posted by admin on Tuesday, February 10th, 2009 at 10:27 pm and filed under Linux with tags , . You can leave a response, or trackback from your own site.

Related Articles

One Approved Response

  1. Ashley Says:
    February 22nd, 2010 at 6:45 am

    Easy and simple step to remove duplicate lines.I think it will works great. By using uniq now we can easily delete the duplicate lines.

    Thanks for sharing..

Leave a Reply