encode string to utf-8 python code example
Example 1: how to convert utf-16 file to utf-8 in python
with open(ff_name, 'rb') as source_file:
with open(target_file_name, 'w+b') as dest_file:
contents = source_file.read()
dest_file.write(contents.decode('utf-16').encode('utf-8'))
Example 2: python unicode point to utf8 string
#! /usr/bin/python3
import re
def makeNice(s):
return re.subn('(#U[0-9a-f]{4})', lambda cp: chr(int(cp.groups()[0][2:],16)), s) [0]
a = '-#U2605-#U79c1-'
print(a, makeNice(a))
Example 3: encode file to utf-8 in java
String charset = "ISO-8859-1";
BufferedReader in = new BufferedReader(
new InputStreamReader (new FileInputStream(file), charset));
String line;
while( (line = in.readLine()) != null) {
....
}