SyntaxFix

Write A Post

Hire A Developer

Questions

Tags

[bash] Remove duplicate entries in a Bash script

I want to remove duplicate entries from a text file, e.g:

kavitha= Tue Feb    20 14:00 19 IST 2012  (duplicate entry) 
sree=Tue Jan  20 14:05 19 IST 2012  
divya = Tue Jan  20 14:20 19 IST 2012  
anusha=Tue Jan 20 14:45 19 IST 2012 
kavitha= Tue Feb    20 14:00 19 IST 2012 (duplicate entry)

Is there any possible way to remove the duplicate entries using a Bash script?

Desired output

kavitha= Tue Feb    20 14:00 19 IST 2012 
sree=Tue Jan  20 14:05 19 IST 2012  
divya = Tue Jan  20 14:20 19 IST 2012  
anusha=Tue Jan 20 14:45 19 IST 2012

This question is related to bash shell

The answer is

Source: Stackoverflow.com

Examples related to bash

• Comparing a variable with a string python not working when redirecting from bash script • Zipping a file in bash fails • How do I prevent Conda from activating the base environment by default? • Get first line of a shell command's output • Fixing a systemd service 203/EXEC failure (no such file or directory) • /bin/sh: apt-get: not found • VSCode Change Default Terminal • Run bash command on jenkins pipeline • How to check if the docker engine and a docker container are running? • How to switch Python versions in Terminal?

Examples related to shell

• Comparing a variable with a string python not working when redirecting from bash script • Get first line of a shell command's output • How to run shell script file using nodejs? • Run bash command on jenkins pipeline • Way to create multiline comments in Bash? • How to do multiline shell script in Ansible • How to check if a file exists in a shell script • How to check if an environment variable exists and get its value? • Curl to return http status code along with the response • docker entrypoint running bash script gets "permission denied"