http://95.179.246.60/mediawiki/index.php?action=history&feed=atom&title=Convert_UTF16_to_Latin1 Convert UTF16 to Latin1 - Revision history 2026-05-08T12:47:07Z Revision history for this page on the wiki MediaWiki 1.39.17 http://95.179.246.60/mediawiki/index.php?title=Convert_UTF16_to_Latin1&diff=168&oldid=prev Nmingott: syntax hilight 2025-05-12T20:16:17Z <p>syntax hilight</p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 20:16, 12 May 2025</td> </tr><tr> <td colspan="2" class="diff-lineno">Line 1:</td> <td colspan="2" class="diff-lineno">Line 1:</td> </tr> <tr> <td class="diff-marker"></td> <td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td> <td class="diff-marker"></td> <td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>'''Problem'''. We got a data file in XML, but it is encoded in UTF16. Cuis is <del style="font-weight: bold; text-decoration: none;">bases</del> on Latin1 characters, so, if possible we should convert to this character set before doing any operation.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>'''Problem'''. We got a data file in XML, but it is encoded in UTF16. Cuis is <ins style="font-weight: bold; text-decoration: none;">based</ins> on Latin1 characters, so, if possible we should convert to this character set before doing any operation.</div></td> </tr> <tr> <td class="diff-marker"></td> <td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td> <td class="diff-marker"></td> <td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br /></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>'''Solution'''. Provided by Juan on the mailing list on date 11-Jun-2022.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>'''Solution'''. Provided by Juan on the mailing list on date 11-Jun-2022.<ins style="font-weight: bold; text-decoration: none;">&lt;syntaxhighlight lang="smalltalk"&gt;</ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> &lt;code&gt;</del>utf16 <del style="font-weight: bold; text-decoration: none;">_</del> 'expo-test-IT-UTF16.xml' asFileEntry binaryContents.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>utf16 <ins style="font-weight: bold; text-decoration: none;">:=</ins> 'expo-test-IT-UTF16.xml' asFileEntry binaryContents.<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del>possibleBOM <del style="font-weight: bold; text-decoration: none;">_</del> utf16 copyFrom: 1 to: 2.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>possibleBOM <ins style="font-weight: bold; text-decoration: none;">:=</ins> utf16 copyFrom: 1 to: 2.<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del>isLittleEndian <del style="font-weight: bold; text-decoration: none;">_</del> true. "use your best guess"</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>isLittleEndian <ins style="font-weight: bold; text-decoration: none;">:=</ins> true. "use your best guess"<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del>possibleBOM = #[255 254] ifTrue: [</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>possibleBOM = #[255 254] ifTrue: [<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> isLittleEndian <del style="font-weight: bold; text-decoration: none;">_</del> true.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> </ins> isLittleEndian <ins style="font-weight: bold; text-decoration: none;">:=</ins> true.<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> utf16 <del style="font-weight: bold; text-decoration: none;">_</del> utf16 copyFrom: 3 to: utf16 size ].</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> </ins> utf16 <ins style="font-weight: bold; text-decoration: none;">:=</ins> utf16 copyFrom: 3 to: utf16 size ].<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del>possibleBOM = #[254 255] ifTrue: [</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>possibleBOM = #[254 255] ifTrue: [<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> isLittleEndian <del style="font-weight: bold; text-decoration: none;">_</del> false.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> </ins> isLittleEndian <ins style="font-weight: bold; text-decoration: none;">:=</ins> false.<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> utf16 <del style="font-weight: bold; text-decoration: none;">_</del> utf16 copyFrom: 3 to: utf16 size ].</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> </ins> utf16 <ins style="font-weight: bold; text-decoration: none;">:=</ins> utf16 copyFrom: 3 to: utf16 size ].<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del>String streamContents: [ :out |</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>String streamContents: [ :out |<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> index <del style="font-weight: bold; text-decoration: none;">_</del> 1.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div> index <ins style="font-weight: bold; text-decoration: none;">:=</ins> 1.<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> [index &lt; utf16 size] whileTrue: [</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div> [index &lt; utf16 size] whileTrue: [<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del> codePoint <del style="font-weight: bold; text-decoration: none;">_</del> utf16 unsignedShortAt: index bigEndian: isLittleEndian not.</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div> codePoint <ins style="font-weight: bold; text-decoration: none;">:=</ins> utf16 unsignedShortAt: index bigEndian: isLittleEndian not.<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del> out nextPut: (Character codePoint: codePoint).</div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div> out nextPut: (Character codePoint: codePoint).<ins style="font-weight: bold; text-decoration: none;"> </ins></div></td> </tr> <tr> <td class="diff-marker" data-marker="−"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> </del> index _ index + 2 ]].<del style="font-weight: bold; text-decoration: none;">&lt;/code&gt;</del></div></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div> index _ index + 2 ]].</div></td> </tr> <tr> <td colspan="2" class="diff-empty diff-side-deleted"></td> <td class="diff-marker" data-marker="+"></td> <td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>&lt;/syntaxhighlight&gt;</div></td> </tr> </table> Nmingott http://95.179.246.60/mediawiki/index.php?title=Convert_UTF16_to_Latin1&diff=85&oldid=prev Nmingott: imported material 2025-05-04T20:10:21Z <p>imported material</p> <p><b>New page</b></p><div><br /> &#039;&#039;&#039;Problem&#039;&#039;&#039;. We got a data file in XML, but it is encoded in UTF16. Cuis is bases on Latin1 characters, so, if possible we should convert to this character set before doing any operation.<br /> <br /> &#039;&#039;&#039;Solution&#039;&#039;&#039;. Provided by Juan on the mailing list on date 11-Jun-2022.<br /> &lt;code&gt;utf16 _ &#039;expo-test-IT-UTF16.xml&#039; asFileEntry binaryContents.<br /> possibleBOM _ utf16 copyFrom: 1 to: 2.<br /> isLittleEndian _ true. &quot;use your best guess&quot;<br /> possibleBOM = #[255 254] ifTrue: [<br /> isLittleEndian _ true.<br /> utf16 _ utf16 copyFrom: 3 to: utf16 size ].<br /> possibleBOM = #[254 255] ifTrue: [<br /> isLittleEndian _ false.<br /> utf16 _ utf16 copyFrom: 3 to: utf16 size ].<br /> String streamContents: [ :out |<br /> index _ 1.<br /> [index &lt; utf16 size] whileTrue: [<br /> codePoint _ utf16 unsignedShortAt: index bigEndian: isLittleEndian not.<br /> out nextPut: (Character codePoint: codePoint).<br /> index _ index + 2 ]].&lt;/code&gt;</div> Nmingott