How to fix Invalid byte 1 of 1-byte UTF-8 sequence

Question

I am trying to fetch the below xml from db using a java method but I am getting an error  Code used to parse the xml  DocumentBuilderFactory dbf   DocumentBuilderFactory newInstance    DocumentBuilder db   dbf newDocumentBuilder     InputSource is   new InputSource new ByteArrayInputStream cond getBytes       Document doc   db parse is    Element elem   doc getDocumentElement        here we expect a series of  lt data gt  lt name gt N lt  name gt  lt value gt V lt  value gt  lt  data gt  NodeList nodes   elem getElementsByTagName  data     TableID jobId   new TableID  processInstanceId   Job myJob   Job queryByID  clientContext  jobId  true    if  nodes getLength      0        log Level DEBUG   No data found on condition XML        for  int i   0  i  lt  nodes getLength    i             loop through the  lt data gt  in the XML      Element dataTags    Element  nodes item i       String name   getChildTagValue dataTags   name        String value   getChildTagValue dataTags   value         log Level INFO   UserData Value     name         value        myJob setBulkUserData name  value      myJob save      The Data   lt ContactDetails gt 307896043 lt  ContactDetails gt   lt ContactName gt 307896043 lt  ContactName gt   lt Preferred Completion Date gt   lt  Preferred Completion Date gt   lt service address gt A-End Address  1ST HELIERST HELIERJT2 3XP832THE CABLES 1 POONHA LANEST HELIER JE JT2 3XP lt  service address gt   lt ServiceOrderId gt 315473043 lt  ServiceOrderId gt   lt ServiceOrderTypeId gt 50 lt  ServiceOrderTypeId gt   lt CustDesiredDate gt 2013-03-20T18 12 04 lt  CustDesiredDate gt   lt OrderId gt 307896043 lt  OrderId gt   lt CreateWho gt csmuser lt  CreateWho gt   lt AccountInternalId gt 20100333 lt  AccountInternalId gt   lt ServiceInternalId gt 20766093 lt  ServiceInternalId gt   lt ServiceInternalIdResets gt 0 lt  ServiceInternalIdResets gt   lt Primary Offer Name  action  del  gt MyMobile Blue  amp  163 44 99  12 month term  lt  Primary Offer Name gt   lt Disc Reason  action  del  gt 8 lt  Disc Reason gt   lt Sup Offer  action  del  gt 80000257 lt  Sup Offer gt   lt Service Type  action  del  gt A-01-00 lt  Service Type gt   lt Priority  action  del  gt 4 lt  Priority gt   lt Account Number  action  del  gt 0 lt  Account Number gt   lt Offer  action  del  gt 80000257 lt  Offer gt   lt msisdn  action  del  gt 447797142520 lt  msisdn gt   lt imsi  action  del  gt 234503184 lt  imsi gt   lt sim  action  del  gt 5535 lt  sim gt   lt ocb9 ARM  action  del  gt false lt  ocb9 ARM gt   lt port in required  action  del  gt   lt  port in required gt   lt ocb9 mob  action  del  gt none lt  ocb9 mob gt   lt ocb9 mob BB  action  del  gt   lt  ocb9 mob BB gt   lt ocb9 LandLine  action  del  gt   lt  ocb9 LandLine gt   lt ocb9 LandLine BB  action  del  gt   lt  ocb9 LandLine BB gt   lt Contact 2 gt   lt  Contact 2 gt   lt Acc middle name gt   lt  Acc middle name gt   lt MarketCode gt 7 lt  MarketCode gt   lt Acc last name gt Port OUT lt  Acc last name gt   lt Contact 1 gt   lt  Contact 1 gt   lt Acc first name gt   lt  Acc first name gt   lt EmaiId gt   lt  EmaiId gt    The ERROR   org apache xerces impl io MalformedByteSequenceException  Invalid byte 1 of 1-byte UTF-8 sequence    I read in some threads it s because of some special characters in the xml  How to fix this issue

User · Answer

I was getting the xml as a String and using xml getBytes   and getting this error   Changing to xml getBytes Charset forName  UTF-8    worked for me

User · Answer

I had a similar problem  I had saved some xml in a file and when reading it into a DOM document  it failed due to special character  Then I used the following code to fix it  String enco   new String Files readAllBytes Paths get listPayloadPath  quot  Payload xml quot     StandardCharsets UTF 8    Document doc   builder parse new ByteArrayInputStream enco getBytes StandardCharsets UTF 8      Let me know if it works for you

User · Answer

Those like me who understand character encoding principles  also read Joel s article which is funny as it contains wrong characters anyway and still can t figure out what the heck  spoiler alert  I m Mac user  then your solution can be as simple as removing your local repo and clone it again   My code base did not change since the last time it was running OK so it made no sense to have UTF errors given the fact that our build system never complained about it    till I remembered that I accidentally unplugged my computer few days ago with IntelliJ Idea and the whole thing running  Java Tomcat Hibernate   My Mac did a brilliant job as pretending nothing happened and I carried on business as usual but the underlying file system was left corrupted somehow  Wasted the whole day trying to figure this one out  I hope it helps somebody

User · Answer

This error comes when you are trying to load jasper report file with the extension  jasper For Example  c   reports  EmployeeReport jasper quot   While you should load jasper report file with the extension  jrxml For Example  c   reports  EmployeeReport jrxml quot   See Problem Screenshot   1   1   https   i stack imgur com D5SzR png  See Solution Screenshot  2   2   https   i stack imgur com VeQb9 png

User · Answer

I happened to run into this problem because of an Ant build   That Ant build took files and applied filterchain expandproperties to it  During this file filtering  my Windows machine s implicit default non-UTF-8 character encoding was used to generate the filtered files - therefore characters outside of its character set could not be mapped correctly   One solution was to provide Ant with an explicit environment variable for UTF-8  In Cygwin  before launching Ant  export ANT OPTS  -Dfile encoding UTF-8

User · Answer

I have met the same problem and after long investigation of my XML file I found the problem  there was few unescaped characters like

User · Answer

How to fix this issue     Read the data using the correct character encoding   The error message means that you are trying to read the data as UTF-8  either deliberately or because that is the default encoding for an XML file that does not specify  lt  xml version  1 0  encoding  somethingelse   gt   but it is actually in a different encoding such as ISO-8859-1 or Windows-1252   To be able to advise on how you should do this I d have to see the code you re currently using to read the XML

User · Answer

Try   InputStream inputStream     Your InputStream from your database  Reader reader   new InputStreamReader inputStream  UTF-8     InputSource is   new InputSource reader   is setEncoding  UTF-8     saxParser parse is  handler     If it s anything else than UTF-8  just change the encoding part for the good one

User · Answer

I had the same issue  My problem was it was missing    -Dfile encoding UTF8    argument under the JAVA OPTION in statWeblogic cmd file in WebLogic server

User · Answer

I had the same problem in my JSF application which was having a comment line containing some special characters in the XMHTL page  When I compared the previous version in my eclipse it had a comment     Some     special characters found   Removed those characters and the page loaded fine  Mostly it is related to XML files  so please compare it with the working version

User · Answer

I had this problem  but the file was in UTF-8  it was just that somehow on character had come in that was not encoded in UTF-8  To solve the problem I did what is stated in this thread  i e  I validated the file  How to check whether a file is valid UTF-8   Basically you run the command     iconv -f UTF-8 your file -o  dev null  And if there is something that is not encoded in UTF-8 it will give you the line and row numbers so that you can find it

User · Answer

Open the xml in notepad  Make sure you dont have extra space at the beginning and end of the document  Select File -  Save As select save as type -  All files Enter file name as abcd xml select Encoding - UTF-8 -  Click Save

User · Answer

You have a library that needs to be erased Like the following library     implementation  org apache maven plugins maven-surefire-plugin 2 4 3

[java] How to fix Invalid byte 1 of 1-byte UTF-8 sequence

Examples related to java

Examples related to xml

Examples related to xml-parsing