How can I output UTF-8 from Perl

Question

I am trying to write a Perl script using the utf8 pragma  and I m getting unexpected results   I m using Mac OS X 10 5  Leopard   and I m editing with TextMate   All of my settings for both my editor and operating system are defaulted to writing files in utf-8 format  However  when I enter the following into a text file  save it as a  quot  pl quot   and execute it  I get the friendly  quot diamond with a question mark quot  in place of the non-ASCII characters     usr bin env perl -w  use strict  use utf8   my  str      ir    s   print   quot  str n quot      Any idea what I m doing wrong  I expect to get    ir    s  in the output  but I get   ir  s  instead

User · Answer

You can use the open pragma     For eg  below sets STDOUT  STDIN  amp  STDERR to use UTF-8      use open qw  std  utf8

User · Answer

do in your shell    env  grep LANG  This will probably show that your shell is not using a utf-8 locale

User · Answer

Thanks  finally got an solution to not put utf8  encode all over code   To synthesize and complete for other cases  like write and read files in utf8 and also works with LoadFile of an YAML file in utf8  use utf8  use open   encoding utf8    binmode STDOUT    utf8     open FH    gt test txt     print FH  something         use YAML qw LoadFile Dump   my  PUBS   LoadFile  cache yaml    my  f    2917   my  ref    PUBS- gt   f   print   f      ref- gt  name          ref- gt  primary uri         where cache yaml is   --- 2917    id  2917   name  Seman  rio   primary uri  2917 xml

User · Answer

use utf8  does not enable Unicode output - it enables you to type Unicode in your program  Add this to the program  before your print   statement   binmode STDOUT    utf8      See if that helps  That should make STDOUT output in UTF-8 instead of ordinary ASCII

User · Answer

TMTOWTDI  chose the method that best fits how you work   I use the environment method so I don t have to think about it   In the environment   export PERL UNICODE SDL   on the command line   perl -CSDL -le  print   x 1815       or with binmode   binmode STDOUT    utf8              treat as if it is UTF-8 binmode STDIN    encoding utf8      actually check if it is UTF-8   or with PerlIO   open my  fh    gt  utf8    filename     or die  could not open  filename     n    open my  fh    lt  encoding utf-8     filename     or die  could not open  filename     n     or with the open pragma   use open   encoding utf8    use open IN   gt    encoding utf8    OUT   gt    utf8

User · Answer

You also want to say  that strings in your code are utf-8  See Why does modern Perl avoid UTF-8 by default   So set not only PERL UNICODE SDAL but also PERL5OPT -Mutf8

[perl] How can I output UTF-8 from Perl?

Examples related to perl

Examples related to unicode

Examples related to utf-8