python unicode to utf8 code example

Example 1: convert \x unicode utf 8 bytes to \u python

>>> '\xc5\x81'.decode('utf-8')
u'\u0141'

Example 2: how to convert utf-16 file to utf-8 in python

with open(ff_name, 'rb') as source_file:
  with open(target_file_name, 'w+b') as dest_file:
    contents = source_file.read()
    dest_file.write(contents.decode('utf-16').encode('utf-8'))

Example 3: python unicode point to utf8 string

#! /usr/bin/python3
import re

def makeNice(s):
    return re.subn('(#U[0-9a-f]{4})', lambda cp: chr(int(cp.groups()[0][2:],16)), s) [0]

a = '-#U2605-#U79c1-'
print(a, makeNice(a))

Tags:

Php Example