Error Input is not proper UTF-8 indicate encoding using PHP s simplexml load string

Question

I m getting the error   parser error   Input is not proper UTF-8  indicate encoding   Bytes  0xED 0x6E 0x2C 0x20  When trying to process an XML response using simplexml load string from a 3rd party source  The raw XML response does declare the content type    lt  xml version  1 0  encoding  UTF-8   gt   Yet it seems that the XML is not really UTF-8  The langauge of the XML content is Spanish and contain words like Dubl  n in the XML   I m unable to get the 3rd party to sort out their XML   How can I pre-process the XML and fix the encoding incompatibilities   Is there a way to detect the correct encoding for a XML file

User · Answer

When generating mapping files using doctrine I ran into same issue   I fixed it by removing all comments that some fields had in the database

User · Answer

Instead of using javascript  you can simply put this line of code after your mysql connect sentence   mysql set charset  utf8   connection     Cheers

User · Answer

Can you open the 3rd party XML source in Firefox and see what it auto-detects as encoding  Maybe they are using plain old ISO-8859-1  UTF-16 or something else    If they declare it to be UTF-8  though  and serve something else  their feed is clearly broken  Working around such a broken feed feels horrible to me  even though sometimes unavoidable  I know    If it s a simple case like  UTF-8 versus ISO-8859-1   you can also try your luck with mb detect encoding

User · Answer

If you are sure that your xml is encoded in UTF-8 but contains bad characters  you can use this function to correct them     content   iconv  UTF-8    UTF-8  IGNORE    content

User · Answer

If you download XML file and open it for example in Notepad   you ll see that encoding is set to something else than UTF8 - I v had the same problem with xml made myself  and it was just te encoding in the editor     String  lt  xml version  1 0  encoding  UTF-8   gt  don t set up the encoding of the document  it s only info for validator or another resource

User · Answer

We recently ran into a similar issue and was unable to find anything obvious as the cause  There turned out to be a control character in our string but when we outputted that string to the browser that character was not visible unless we copied the text into an IDE   We managed to solve our problem thanks to this post and this      preg replace     x00- x1F x7F          input

User · Answer

I solved this using   content   utf8 encode file get contents  http   example com rss xml      xml   simplexml load string  content

User · Answer

After several tries i found htmlentities function works    value   htmlentities  value

User · Answer

Your 0xED 0x6E 0x2C 0x20 bytes correspond to    n    in ISO-8859-1  so it looks like your content is in ISO-8859-1  not UTF-8  Tell your data provider about it and ask them to fix it  because if it doesn t work for you it probably doesn t work for other people either   Now there are a few ways to work it around  which you should only use if you cannot load the XML normally  One of them would be to use utf8 encode    The downside is that if that XML contains both valid UTF-8 and some ISO-8859-1 then the result will contain mojibake  Or you can try to convert the string from UTF-8 to UTF-8 using iconv   or mbstring  and hope they ll fix it for you   they won t  but you can at least ignore the invalid characters so you can load your XML   Or you can take the long  long road and validate fix the sequences by yourself  That will take you a while depending on how familiar you are with UTF-8  Perhaps there are libraries out there that would do that  although I don t know any   Either way  notify your data provider that they re sending invalid data so that they can fix it     Here s a partial fix  It will definitely not fix everything  but will fix some of it  Hopefully enough for you to get by until your provider fix their stuff   function fix latin1 mangled with utf8 maybe hopefully most of the time  str        return preg replace callback      xA1-  xFF       x80-  xBF  2        utf8 encode callback    str      function utf8 encode callback  m        return utf8 encode  m 0

User · Answer

I just had this problem  Turns out the XML file  not the contents  was not encoded in utf-8  but in ISO-8859-1  You can check this on a Mac with file -I xml filename   I used Sublime to change the file encoding to utf-8  and lxml imported it no issues

[php] Error: "Input is not proper UTF-8, indicate encoding !" using PHP's simplexml_load_string

Examples related to php

Examples related to xml

Examples related to encoding

Examples related to character-encoding

Examples related to simplexml