How to convert Windows end of line in Unix end of line CR LF to LF

Question

I m a Java developer and I m using Ubuntu to develop  The project was created in Windows with Eclipse and it s using the Windows-1252 encoding  To convert to UTF-8 I ve used the recode program  find Web -iname    java   xargs recode CP1252   UTF-8  This command gives this error  recode  Web src br cits projeto geral presentation GravacaoMessageHelper java failed  Ambiguous output in step  CR-LF  data  I ve searched about it and get the solution in Bash and Windows  Recode  Ambiguous output in step  data  CR-LF  and it says   Convert line endings from CR LF to a single LF  Edit the file with Vim  give the command  set ff unix and save the file  Recode now should run without errors   Nice  but I ve many files to remove the CR LF character from  and I can t open each to do it  Vi doesn t provide any option to command line for Bash operations  Can sed be used to do this  How

User · Answer

Go back to Windows  tell Eclipse to change the encoding to UTF-8  then back to Unix and run d2u on the files

User · Answer

Did you try the python script by Bryan Maupin found here    I ve modified it a little bit to be more generic      usr bin env python  import sys  input file name   sys argv 1  output file name   sys argv 2   input file   open input file name  output file   open output file name   w    line number   0  for input line in input file      line number    1     try     first try to decode it using cp1252  Windows  Western Europe          output line   input line decode  cp1252   encode  utf8       except UnicodeDecodeError  error     if there s an error         sys stderr write  ERROR  line  s   t s n     line number  error      write to stderr         try     then if that fails  try to decode using latin1  ISO 8859-1                       output line   input line decode  latin1   encode  utf8           except UnicodeDecodeError  error     if there s an error             sys stderr write  ERROR  line  s   t s n     line number  error      write to stderr             sys exit 1     and just keep going     output file write output line   input file close   output file close     You can use that script with       cp1252 utf8 py file cp1252 sql file utf8 sql

User · Answer

The tr command can also do this  tr -d   15 32   lt  winfile txt  gt  unixfile txt  and should be available to you  You ll need to run tr from within a script  since it cannot work with file names  For example  create a file myscript sh     bin bash  for f in  find -iname    java   do     echo  quot  f quot      tr -d   15 32   lt   quot  f quot   gt   quot  f tr quot      mv  quot  f tr quot   quot  f quot      recode CP1252   UTF-8  quot  f quot  done  Running myscript sh would process all the java files in the current directory and its subdirectories

User · Answer

I ll take a little exception to jichao s answer   You can actually do everything he just talked about fairly easily   Instead of looking for a  n  just look for carriage return at the end of the line  sed -i  s  r      quot   FILE NAME  quot   To change from unix back to dos  simply look for the last character on the line and add a form feed to it    I ll add -r to make this easier with grep regular expressions   sed -ri  s       1 r    quot   FILE NAME  quot   Theoretically  the file could be changed to mac style by adding code to the last example that also appends the next line of input to the first line until all lines have been processed   I won t try to make that example here  though  Warning  -i changes the actual file   If you want a backup to be made  add a string of characters after -i   This will move the existing file to a file with the same name with your characters added to the end

User · Answer

sed cannot match  n because the trailing newline is removed before the line is put into the pattern space but can match  r  so you can convert  r n  dos  to  n  unix  by removing  r  sed -i  s  r  g  file   Warning  this will change the original file  However  you cannot change from unix EOL to dos or old mac   r  by this  More readings here   How can I replace a newline   n  using sed

User · Answer

There should be a program called dos2unix that will fix line endings for you   If it s not already on your Linux box  it should be available via the package manager

User · Answer

In order to overcome  Ambiguous output in step  CR-LF  data    simply solution might be to add -f flag to force conversion

User · Answer

Actually  vim does allow what you re looking for  Enter vim  and type the following commands     args      java  argdo set ff unix   update   next   The first of these commands sets the argument list to every file matching      java  which is all Java files  recursively  The second of these commands does the following to each file in the argument list  in turn    Sets the line-endings to Unix style  you already know this  Writes the file out iff it s been changed Proceeds to the next file

[windows] How to convert Windows end of line in Unix end of line (CR/LF to LF)

Examples related to windows

Examples related to linux

Examples related to end-of-line