How can I transform string to UTF-8 in C

Question

I have a string that I receive from a third party app and I would like to display it correctly in any language using C  on my Windows Surface    Due to incorrect encoding  a piece of my string looks like this in Spanish       Acci    n   whereas it should look like this       Acci  n   According to the answer on this question     How to know string encoding in C   the encoding I am receiving should be coming on UTF-8 already  but it is read on Encoding Default  probably ANSI     I am trying to transform this string into real UTF-8  but one of the problems is that I can only see a subset of the Encoding class  UTF8 and Unicode properties only   probably because I m limited to the windows surface API   I have tried some snippets I ve found on the internet  but none of them have proved successful so far for eastern languages  i e  korean   One example is as follows   var utf8   Encoding UTF8  byte   utfBytes   utf8 GetBytes myString   myString  utf8 GetString utfBytes  0  utfBytes Length          I also tried extracting the string into a byte array and then using UTF8 GetString   byte   myByteArray   new byte myString Length   for  int ix   0  ix  lt  myString Length    ix        char ch   myString ix       myByteArray ix     byte  ch     myString   Encoding UTF8 GetString myByteArray  0  myString Length     Do you guys have any other ideas that I could try

User · Answer

string utf8String    Acci    n   string propEncodeString   string Empty   byte   utf8 Bytes   new byte utf8String Length   for  int i   0  i  lt  utf8String Length    i       utf8 Bytes i     byte utf8String i      propEncodeString   Encoding UTF8 GetString utf8 Bytes  0  utf8 Bytes Length     Output should look like       Acci  n      day        s displays    day s   call    DecodeFromUtf8     private static void DecodeFromUtf8         string utf8 String    day        s       byte   bytes   Encoding Default GetBytes utf8 String       utf8 String   Encoding UTF8 GetString bytes

User · Answer

If you want to save any string to mysql database do this -   Your database field structure i phpmyadmin   or any other control panel  should set to utf8-gerneral-ci  2  you should change your string  Ex  textbox1 text  to byte  therefor  2-1  define byte   st2   2-2  convert your string  textbox1 text  to unicode   mmultibyte string  by      byte   st2   System Text Encoding UTF8 GetBytes textBox1 Text     3  execute this sql command before any query   string mysql query2    SET NAMES  utf8    cmd CommandText   mysql query2  cmd ExecuteNonQuery      3-2  now you should insert this value in to for example name field by    cmd CommandText    INSERT INTO customer   name   values   name      4  the main job that many solution didn t attention to it is the below line     you should use addwithvalue instead of add in command parameter like below   cmd Parameters AddWithValue   name  ut                                        enjoy real data in your database server instead of

User · Answer

As you know the string is coming in as Encoding Default you could simply use   byte   bytes   Encoding Default GetBytes myString   myString   Encoding UTF8 GetString bytes     Another thing you may have to remember  If you are using Console WriteLine to output some strings  then you should also write Console OutputEncoding   System Text Encoding UTF8     Or all utf8 strings will be outputed as gbk

User · Answer

anothershrubery answer worked for me  I ve made an enhancement using StringEntensions Class so I can easily convert any string at all in my program  Method  public static class StringExtensions       public static string ToUTF8 this string text                return Encoding UTF8 GetString Encoding Default GetBytes text             Usage  string myString    quot Acci    n quot   string strConverted   myString ToUTF8     Or simply  string strConverted    quot Acci    n quot  ToUTF8

User · Answer

Your code is reading a sequence of UTF8-encoded bytes  and decoding them using an 8-bit encoding   You need to fix that code to decode the bytes as UTF8   Alternatively  not ideal   you could convert the bad string back to the original byte array mdash by encoding it using the incorrect encoding mdash then re-decode the bytes as UTF8

User · Answer

Use the below code snippet to get bytes from csv file  protected byte   GetCSVFileContent string fileName                StringBuilder sb   new StringBuilder            using  StreamReader sr   new StreamReader fileName  Encoding Default  true                         String line                 Read and display lines from the file until the end of                 the file is reached              while   line   sr ReadLine       null                                sb AppendLine line                                   string allines   sb ToString              UTF8Encoding utf8   new UTF8Encoding              var preamble   utf8 GetPreamble             var data   utf8 GetBytes allines             return data          Call the below and save it as an attachment             Encoding csvEncoding   Encoding UTF8                       byte   csvFile   GetCSVFileContent FileUpload1 PostedFile FileName             byte   csvFile   GetCSVFileContent  Your CSV File NAme              string attachment   String Format  attachment  filename  0  csv    uomEncoded             Response Clear            Response ClearHeaders            Response ClearContent            Response ContentType    text csv           Response ContentEncoding   csvEncoding          Response AppendHeader  Content-Disposition   attachment             Response BinaryWrite csvEncoding GetPreamble             Response BinaryWrite csvFile           Response Flush            Response End

User · Answer

Encoding Convert Encoding Default  Encoding UTF8  Encoding Default GetBytes mystring

[c#] How can I transform string to UTF-8 in C#?

Examples related to c#

Examples related to string

Examples related to encoding

Examples related to utf-8

Examples related to character-encoding