Õ¹¿ªÈ«²¿ÏÂÃæµÄÄÚÈÝת×ÔÎҵİٶȿռä,ÊÇÎÒÊÕ¼¯À´µÄ,ÔÚÕâÀï¿´ÆðÀ´Èç¹û¾õµÃÅÅ°æ²»ºÃ,¿ÉÒÔÖ±½Ó¿´ÎҵĿռäÄÚµÄÎÄÕÂ:http://hi.baidu.com/newkedison/blog/item/1c7d2c392cc192f63b87ce12.htmlÓйØUTF-8µÄһЩ×ÊÁÏ2008Äê06ÔÂ13ÈÕ ÐÇÆÚÎå 08:17Ò», ×îÖØÒªµÄ,UTF-8ºÍUnicodeµÄת»»UTF-8 ±àÂëÊÇÒ»ÖÖ±»¹ã·ºÓ¦ÓõıàÂ룬ÕâÖÖ±àÂëÖÂÁ¦ÓÚ°ÑÈ«ÇòµÄÓïÑÔÄÉÈëÒ»¸öͳһµÄ±àÂ룬ĿǰÒѾ½«¼¸ÖÖÑÇÖÞÓïÑÔÄÉÈë¡£UTF ´ú±í UCS Transformation Format. UTF-8 ²ÉÓñ䳤¶È×Ö½ÚÀ´±íʾ×Ö·û£¬ÀíÂÛÉÏ×î¶à¿ÉÒÔµ½ 6 ¸ö×Ö½Ú³¤¶È¡£UTF-8 ±àÂë¼æÈÝÁË ASC II(0-127)£¬ Ò²¾ÍÊÇ˵ UTF-8 ¶ÔÓÚ ASC II ×Ö·ûµÄ±àÂëÊÇºÍ ASC II Ò»ÑùµÄ¡£¶ÔÓÚ³¬¹ýÒ»¸ö×Ö½Ú³¤¶ÈµÄ×Ö·û£¬²ÅÓÃÒÔϱàÂë¹æ·¶£º ×ó±ßµÚÒ»¸ö×Ö½Ú1µÄ¸öÊý±íʾÕâ¸ö×Ö·û±àÂë×Ö½ÚµÄλÊý£¬ÀýÈçÁ½Î»×Ö½Ú×Ö·û±àÂëÑùʽΪΪ£º110xxxxx 10xxxxxx£» Èýλ×Ö½Ú×Ö·ûµÄ±àÂëÑùʽΪ£º1110xxxx 10xxxxxx 10xxxxxx.£»ÒÔ´ËÀàÍÆ£¬Áùλ×Ö½Ú×Ö·ûµÄ±àÂëÑùʽΪ£º1111110x 10xxxxxx 10xxxxxx 10xxxxxx 10xxxxxx 10xxxxxx¡£ xxx µÄÖµÓÉ×Ö·û±àÂëµÄ¶þ½øÖƱíʾµÄλÌîÈë¡£Ö»ÓÃ×î¶ÌµÄÄǸö×ã¹»±í´ïÒ»¸ö×Ö·û±àÂëµÄ¶à×Ö½Ú´®¡£ÀýÈ磺 Unicode ×Ö·û£º 00 A9£¨°æȨ·ûºÅ£© = 1010 1001£¬ UTF-8 ±àÂëΪ£º11000010 10101001 = 0x C2 0xA9; ×Ö·û 22 60 (²»µÈÓÚ·ûºÅ) = 0010 0010 0110 0000£¬ UTF-8 ±àÂëΪ£º11100010 10001001 10100000 = 0xE2 0x89 0xA0ÒÔÉÏת»»Àý×ÓÒѾȷÈÏÊÇÕýÈ·µÄ,²»Óû³ÒÉ,Èç¹û¿´²»¶®ÇëÔÙ×ÐϸÏëÏëUnicode±àÂëºÍutf-8±àÂëÖ®¼äµÄ¶ÔÓ¦¹Øϵ±í The table below summarizes the format of these different octet types. The letter x indicates bits available for encoding bits of the character number.Char. number range | UTF-8 octet sequence (hexadecimal) | (binary) --------------------+--------------------------------------------- 0000 0000-0000 007F | 0xxxxxxx 0000 0080-0000 07FF | 110xxxxx 10xxxxxx 0000 0800-0000 FFFF | 1110xxxx 10xxxxxx 10xxxxxx //////A///////// 0001 0000-0010 FFFF | 11110xxx 10xxxxxx 10xxxxxx 10xxxxxxÕâÊÇÒ»¸öUnicode±àÂëºÍutf-8±àÂëÖ®¼äµÄ¶ÔÓ¦¹Øϵ±í¡£ÖÐÎĵÄUnicode±àÂ뷶ΧÔÚ0000 0800-0000 FFFF ÖС£¶þ, ¹ØÓÚBOMUTF-8ÒÔ×Ö½ÚΪ±àÂëµ¥Ôª£¬Ã»ÓÐ×Ö½ÚÐòµÄÎÊÌâ¡£UTF-16ÒÔÁ½¸ö×Ö½ÚΪ±àÂëµ¥Ôª£¬ÔÚ½âÊÍÒ»¸öUTF-16Îı¾Ç°£¬Ê×ÏÈҪŪÇå³þÿ¸ö±àÂëµ¥ÔªµÄ×Ö½ÚÐò¡£ÀýÈçÊÕµ½Ò»¸ö¡°¿ü¡±µÄUnicode±àÂëÊÇ594E£¬¡°ÒÒ¡±µÄUnicode±àÂëÊÇ4E59¡£Èç¹ûÎÒÃÇÊÕµ½UTF-16×Ö½ÚÁ÷¡°594E¡±£¬ÄÇôÕâÊÇ¡°¿ü¡±»¹ÊÇ¡°ÒÒ¡±£¿ Unicode¹æ·¶ÖÐÍƼöµÄ±ê¼Ç×Ö½Ú˳ÐòµÄ·½·¨ÊÇBOM¡£BOM²»ÊÇ¡°Bill Of Material¡±µÄBOM±í£¬¶øÊÇByte Order Mark¡£BOMÊÇÒ»¸öÓеãС´ÏÃ÷µÄÏë·¨£º ÔÚUCS±àÂëÖÐÓÐÒ»¸ö½Ð×ö"ZERO WIDTH NO-BREAK SPACE"µÄ×Ö·û£¬ËüµÄ±àÂëÊÇFEFF¡£¶øFFFEÔÚUCSÖÐÊDz»´æÔÚµÄ×Ö·û£¬ËùÒÔ²»Ó¦¸Ã³öÏÖÔÚʵ¼Ê´«ÊäÖС£UCS¹æ·¶½¨ÒéÎÒÃÇÔÚ´«Êä×Ö½ÚÁ÷Ç°£¬ÏÈ´«Êä×Ö·û"ZERO WIDTH NO-BREAK SPACE"¡£ ÕâÑùÈç¹û½ÓÊÕÕßÊÕµ½FEFF£¬¾Í±íÃ÷Õâ¸ö×Ö½ÚÁ÷ÊÇBig-EndianµÄ£»Èç¹ûÊÕµ½FFFE£¬¾Í±íÃ÷Õâ¸ö×Ö½ÚÁ÷ÊÇLittle-EndianµÄ¡£Òò´Ë×Ö·û"ZERO WIDTH NO-BREAK SPACE"ÓÖ±»³Æ×÷BOM¡£ UTF-8²»ÐèÒªBOMÀ´±íÃ÷×Ö½Ú˳Ðò£¬µ«¿ÉÒÔÓÃBOMÀ´±íÃ÷±àÂ뷽ʽ¡£×Ö·û"ZERO WIDTH NO-BREAK SPACE"µÄUTF-8±àÂëÊÇEF BB BF£¨¶ÁÕß¿ÉÒÔÓÃÎÒÃÇÇ°Ãæ½éÉܵıàÂë·½·¨Ñé֤һϣ©¡£ËùÒÔÈç¹û½ÓÊÕÕßÊÕµ½ÒÔEF BB BF¿ªÍ·µÄ×Ö½ÚÁ÷£¬¾ÍÖªµÀÕâÊÇUTF-8±àÂëÁË¡£Èý, VBʵÏÖUTF-8תUnicodeµÄº¯Êý1.²»Ê¹ÓÃAPIFunction Utf8ToUnicode(ByRef Utf() As Byte) As StringDim utfLen As LongutfLen = -1On Error Resume NextutfLen = UBound(Utf)If utfLen = -1 Then Exit FunctionOn Error GoTo 0Dim i As Long, j As Long, k As Long, N As LongDim B As Byte, cnt As ByteDim Buf() As StringReDim Buf(utfLen)i = 0j = 0Do While i <= utfLen B = Utf(i) If (B And &HFC) = &HFC Then cnt = 6 ElseIf (B And &HF8) = &HF8 Then cnt = 5 ElseIf (B And &HF0) = &HF0 Then cnt = 4 ElseIf (B And &HE0) = &HE0 Then cnt = 3 ElseIf (B And &HC0) = &HC0 Then cnt = 2 Else cnt = 1 End If If i + cnt - 1 > utfLen Then Buf(j) = "?" Exit Do End If Select Case cnt Case 2 N = B And &H1F Case 3 N = B And &HF Case 4 N = B And &H7 Case 5 N = B And &H3 Case 6 N = B And &H1 Case Else Buf(j) = Chr(B) GoTo Continued: End Select For k = 1 To cnt - 1 B = Utf(i + k) N = N * &H40 + (B And &H3F) Next Buf(j) = ChrW(N)Continued: i = i + cnt j = j + 1LoopUtf8ToUnicode = Join(Buf, "")End Function2. ʹÓÃAPI (°üÀ¨UnicodeתUTF-8)Private Declare Function WideCharToMultiByte Lib "kernel32" (ByVal CodePage As Long, ByVal dwFlags As Long, ByVal lpWideCharStr As Long, ByVal cchWideChar As Long, ByRef lpMultiByteStr As Any, ByVal cchMultiByte As Long, ByVal lpDefaultChar As String, ByVal lpUsedDefaultChar As Long) As LongPrivate Declare Function MultiByteToWideChar Lib "kernel32" (ByVal CodePage As Long, ByVal dwFlags As Long, ByVal lpMultiByteStr As Long, ByVal cchMultiByte As Long, ByVal lpWideCharStr As Long, ByVal cchWideChar As Long) As LongPrivate Const CP_UTF8 = 65001Function Utf8ToUnicode(ByRef Utf() As Byte) As StringDim lRet As LongDim lLength As LongDim lBufferSize As LonglLength = UBound(Utf) - LBound(Utf) + 1If lLength <= 0 Then Exit FunctionlBufferSize = lLength * 2Utf8ToUnicode = String$(lBufferSize, Chr(0))lRet = MultiByteToWideChar(CP_UTF8, 0, VarPtr(Utf(0)), lLength, StrPtr(Utf8ToUnicode), lBufferSize)If lRet <> 0 Then Utf8ToUnicode = Left(Utf8ToUnicode, lRet)End IfEnd FunctionFunction UnicodeToUtf8(ByVal UCS As String) As Byte()Dim lLength As LongDim lBufferSize As LongDim lResult As LongDim abUTF8() As BytelLength = Len(UCS)If lLength = 0 Then Exit FunctionlBufferSize = lLength * 3 + 1ReDim abUTF8(lBufferSize - 1)lResult = WideCharToMultiByte(CP_UTF8, 0, StrPtr(UCS), lLength, abUTF8(0), lBufferSize, vbNullString, 0)If lResult <> 0 ThenlResult = lResult - 1ReDim Preserve abUTF8(lResult)UnicodeToUtf8 = abUTF8End IfEnd FunctionPrivate Sub Command1_Click()Dim byt() As Bytebyt = UnicodeToUtf8("²âÊÔ")Debug.Print Hex(byt(0)) & Hex(byt(1)) & Hex(byt(2))Debug.Print Utf8ToUnicode(byt()) End Sub
Õ¹¿ªÈ«²¿'¸´ÖÆÏÂÃæÎļþµ½Ä£¿éÖÐ'µ÷ÓãºText1.Text = UTF8_Decode(UTF8Zfc)'×¢Ò⣺ÎļþÏÂÔغóÖ±½Óת»»£¬²»ÄÜ×öÈκÎÆäËûת»»(Èçstrconv)¡£'***************Ä£¿é´úÂë********************'Utf8×Ö·ûת»¯³ÉUnicode×Ö·û¶¨ÒåPublic Declare Function MultiByteToWideChar Lib "kernel32" (ByVal CodePage As Long, ByVal dwFlags As Long, ByRef lpMultiByteStr As Any, ByVal cchMultiByte As Long, ByVal lpWideCharStr As Long, ByVal cchWideChar As Long) As LongPublic Const CP_UTF8 = 65001'»ñµÃϵͳµÄÀàÐͶ¨ÒåPrivate Declare Function GetVersionExA Lib "kernel32" (lpVersionInformation As OSVERSIONINFO) As IntegerPrivate Type OSVERSIONINFO dwOSVersionInfoSize As Long dwMajorVersion As Long dwMinorVersion As Long dwBuildNumber As Long dwPlatformId As Long szCSDVersion As String * 128End Type'»ñµÃϵͳµÄÀàÐÍPublic Function GetVersion() As String Dim osinfo As OSVERSIONINFO Dim retvalue As Integer osinfo.dwOSVersionInfoSize = 148 osinfo.szCSDVersion = Space$(128) retvalue = GetVersionExA(osinfo) With osinfo Select Case .dwPlatformId Case 1 Select Case .dwMinorVersion Case 0 GetVersion = "1Windows 95" Case 10 GetVersion = "1Windows 98" Case 90 GetVersion = "1Windows Mellinnium" End Select Case 2 Select Case .dwMajorVersion Case 3 GetVersion = "2Windows NT 3.51" Case 4 GetVersion = "2Windows NT 4.0" Case 5 If .dwMinorVersion = 0 Then GetVersion = "2Windows 2000" Else GetVersion = "2Windows XP" End If End Select Case Else GetVersion = "Failed" End Select End WithEnd Function'¹¦ÄÜ: °ÑUtf8×Ö·ûת»¯³ÉUnicode×Ö·ûPublic Function UTF8_Decode(ByVal sUTF8 As String) As String Dim lngUtf8Size As Long Dim strBuffer As String Dim lngBufferSize As Long Dim lngResult As Long Dim bytUtf8() As Byte Dim n As Long If LenB(sUTF8) = 0 Then Exit Function If Left(GetVersion(), 1) = "2" Then On Error GoTo EndFunction 'bytUtf8 = StrConv(sUTF8, vbFromUnicode) bytUtf8 = sUTF8 lngUtf8Size = UBound(bytUtf8) + 1 On Error GoTo 0 'Set buffer for longest possible string i.e. each byte is 'ANSI, thus 1 unicode(2 bytes)for every utf-8 character. lngBufferSize = lngUtf8Size * 2 strBuffer = String$(lngBufferSize, vbNullChar) 'Translate using code page 65001(UTF-8) lngResult = MultiByteToWideChar(CP_UTF8, 0, bytUtf8(0), _ lngUtf8Size, StrPtr(strBuffer), lngBufferSize) 'Trim result to actual length If lngResult Then UTF8_Decode = Left(strBuffer, lngResult) End If Else Dim i As Long Dim TopIndex As Long Dim TwoBytes(1) As Byte Dim ThreeBytes(2) As Byte Dim AByte As Byte Dim TStr As String Dim BArray() As Byte 'Resume on error in case someone inputs text with accents 'that should have been encoded as UTF-8 On Error Resume Next TopIndex = LenB(sUTF8) ' Number of bytes equal TopIndex+1 If TopIndex = 0 Then Exit Function ' get out if there's nothing to convert 'BArray = StrConv(sUTF8, vbFromUnicode) BArray = sUTF8 i = 0 ' Initialise pointer TopIndex = TopIndex - 1 ' Iterate through the Byte Array Do While i <= TopIndex AByte = BArray(i) If AByte < &H80 Then ' Normal ANSI character - use it as is TStr = TStr & Chr$(AByte): i = i + 1 ' Increment byte array index ElseIf AByte >= &HE0 Then 'was = &HE1 Then ' Start of 3 byte UTF-8 group for a character ' Copy 3 byte to ThreeBytes ThreeBytes(0) = BArray(i): i = i + 1 ThreeBytes(1) = BArray(i): i = i + 1 ThreeBytes(2) = BArray(i): i = i + 1 ' Convert Byte array to UTF-16 then Unicode TStr = TStr & ChrW$((ThreeBytes(0) And &HF) * &H1000 + (ThreeBytes(1) And &H3F) * &H40 + (ThreeBytes(2) And &H3F)) ElseIf (AByte >= &HC2) And (AByte <= &HDB) Then ' Start of 2 byte UTF-8 group for a character TwoBytes(0) = BArray(i): i = i + 1 TwoBytes(1) = BArray(i): i = i + 1 ' Convert Byte array to UTF-16 then Unicode TStr = TStr & ChrW$((TwoBytes(0) And &H1F) * &H40 + (TwoBytes(1) And &H3F)) Else ' Normal ANSI character - use it as is TStr = TStr & Chr$(AByte): i = i + 1 ' Increment byte array index End If Loop UTF8_Decode = TStr ' Return the resultant string Erase BArray End IfEndFunction:End Function