Byte order mark - Revision history

Unknown user: /* How to see Byte order mark */

2023-09-17T10:15:24Z

How to see Byte order mark

@@ Line 82: / Line 82: @@
 * {{kbd | key=<nowiki>=CODE(A1)</nowiki>}} returns {{kbd | key=95}} on Excel 2016 of {{Mac}}
 * {{kbd | key=<nowiki>=CODE(A1)</nowiki>}} returns {{kbd | key=65279}} or other numeric value e.g. {{kbd | key=28201}} on Google sheet
 === File command ===

Unknown user: /* How to remove Byte order mark */

2023-05-31T03:39:46Z

How to remove Byte order mark

← Older revision		Revision as of 11:39, 31 May 2023
Line 93:		Line 93:
	* [https://stackoverflow.com/questions/10290849/how-to-remove-multiple-utf-8-bom-sequences php - How to remove multiple UTF-8 BOM sequences - Stack Overflow]		* [https://stackoverflow.com/questions/10290849/how-to-remove-multiple-utf-8-bom-sequences php - How to remove multiple UTF-8 BOM sequences - Stack Overflow]
	* [https://stackoverflow.com/questions/22600235/remove-or-match-a-unicode-zero-width-space-php replace - Remove or match a Unicode Zero Width Space PHP - Stack Overflow]		* [https://stackoverflow.com/questions/22600235/remove-or-match-a-unicode-zero-width-space-php replace - Remove or match a Unicode Zero Width Space PHP - Stack Overflow]

			<pre>
			// 原始資料：程式碼編輯器會顯示為 ZWNBSP，但是一般編輯器試看不到
			$text = "\xef\xbb\xbf" . "單位名稱";

			// 移除 BOM
			$text = preg_replace('/[\x{200B}-\x{200D}\x{FEFF}]/u', '', $text);
			</pre>

	== References ==		== References ==

Unknown user: /* References */

2023-05-31T03:10:14Z

References

← Older revision		Revision as of 11:10, 31 May 2023
Line 88:		Line 88:
	=== Hex editor ===		=== Hex editor ===
	Using Hext editor to open the text file. [https://zh.wikipedia.org/wiki/%E4%BD%8D%E5%85%83%E7%B5%84%E9%A0%86%E5%BA%8F%E8%A8%98%E8%99%9F 位元組順序記號 - 維基百科，自由的百科全書]		Using Hext editor to open the text file. [https://zh.wikipedia.org/wiki/%E4%BD%8D%E5%85%83%E7%B5%84%E9%A0%86%E5%BA%8F%E8%A8%98%E8%99%9F 位元組順序記號 - 維基百科，自由的百科全書]

			== How to remove Byte order mark ==
			PHP
			* [https://stackoverflow.com/questions/10290849/how-to-remove-multiple-utf-8-bom-sequences php - How to remove multiple UTF-8 BOM sequences - Stack Overflow]
			* [https://stackoverflow.com/questions/22600235/remove-or-match-a-unicode-zero-width-space-php replace - Remove or match a Unicode Zero Width Space PHP - Stack Overflow]

	== References ==		== References ==

Unknown user: Text replacement - "Category:Text file processing" to "Category:String manipulation"

2021-03-09T11:30:57Z

Text replacement - "Category:Text file processing" to "Category:String manipulation"

← Older revision		Revision as of 19:30, 9 March 2021
Line 93:		Line 93:
	<references />		<references />

	[[Category:Programming]] [[Category:Data Science]] [[Category:~~Text file processing~~]]		[[Category:Programming]] [[Category:Data Science]] [[Category:String manipulation]]

Planetoid: /* PHP way */

2018-10-21T08:05:07Z

PHP way

← Older revision		Revision as of 16:05, 21 October 2018
Line 55:		Line 55:

	=== PHP way ===		=== PHP way ===
	PHP code<ref>[https://stackoverflow.com/questions/14674834/php-convert-string-to-hex-and-hex-to-string PHP convert string to hex and hex to string - Stack Overflow]</ref><ref>[https://www.w3schools.com/php/func_misc_unpack.asp PHP unpack() Function]</ref>:		PHP code<ref>[https://stackoverflow.com/questions/14674834/php-convert-string-to-hex-and-hex-to-string PHP convert string to hex and hex to string - Stack Overflow]</ref><ref>[https://www.w3schools.com/php/func_misc_unpack.asp PHP unpack() Function]</ref><ref>[https://stackoverflow.com/questions/10290849/how-to-remove-multiple-utf-8-bom-sequences-before-doctype php - How to remove multiple UTF-8 BOM sequences before "<!DOCTYPE>"? - Stack Overflow]</ref>:
	<pre>		<pre>

Planetoid at 08:03, 21 October 2018

2018-10-21T08:03:53Z

← Older revision		Revision as of 16:03, 21 October 2018
Line 93:		Line 93:
	<references />		<references />

	[[Category:Programming]] [[Category:Data Science]]		[[Category:Programming]] [[Category:Data Science]] [[Category:Text file processing]]

Planetoid at 08:02, 21 October 2018

2018-10-21T08:02:48Z

← Older revision		Revision as of 16:02, 21 October 2018
Line 33:		Line 33:
	<td>31323334353637383930</td>		<td>31323334353637383930</td>
	<td>1234567890</td>		<td>1234567890</td>
	<td>no BOM</td>		<td>UTF-8 without BOM</td>
	</tr>		</tr>
	<tr>		<tr>
Line 40:		Line 40:
	<td>EFBBBF31323334353637383930</td>		<td>EFBBBF31323334353637383930</td>
	<td>1234567890</td>		<td>1234567890</td>
	<td>BOM</td>		<td>UTF-8 with BOM</td>
	</tr>		</tr>
	<tr>		<tr>
Line 83:		Line 83:
	* {{kbd \| key=<nowiki>=CODE(A1)</nowiki>}} returns {{kbd \| key=65279}} or other numeric value e.g. {{kbd \| key=28201}} on Google sheet		* {{kbd \| key=<nowiki>=CODE(A1)</nowiki>}} returns {{kbd \| key=65279}} or other numeric value e.g. {{kbd \| key=28201}} on Google sheet

	=== File command ~~way~~ ===		=== File command ===
	Using [https://en.wikipedia.org/wiki/File_(command) file (command)]: {{kbd \| key=<nowiki>file filename.txt</nowiki>}} on {{Linux}}, {{Mac}}<ref>[https://developer.apple.com/legacy/library/documentation/Darwin/Reference/ManPages/man1/file.1.html file(1) Mac OS X Manual Page]</ref> & Cygwin on {{Win}}. See details on [[Text file encoding]]		Using [https://en.wikipedia.org/wiki/File_(command) file (command)]: {{kbd \| key=<nowiki>file filename.txt</nowiki>}} on {{Linux}}, {{Mac}}<ref>[https://developer.apple.com/legacy/library/documentation/Darwin/Reference/ManPages/man1/file.1.html file(1) Mac OS X Manual Page]</ref> & Cygwin on {{Win}}. See details on [[Text file encoding]]

			=== Hex editor ===
			Using Hext editor to open the text file. [https://zh.wikipedia.org/wiki/%E4%BD%8D%E5%85%83%E7%B5%84%E9%A0%86%E5%BA%8F%E8%A8%98%E8%99%9F 位元組順序記號 - 維基百科，自由的百科全書]

	== References ==		== References ==

Planetoid: /* File command way */

2018-10-21T07:55:34Z

File command way

@@ Line 84: / Line 84: @@
 === File command way ===
-Using [https://en.wikipedia.org/wiki/File_(command) file (command)]: {{kbd | key=<nowiki>file filename.txt</nowiki>}} on {{Linux}}, {{Mac}}<ref>[https://developer.apple.com/legacy/library/documentation/Darwin/Reference/ManPages/man1/file.1.html file(1) Mac OS X Manual Page]</ref> & Cygwin on {{Win}}
+Using [https://en.wikipedia.org/wiki/File_(command) file (command)]: {{kbd | key=<nowiki>file filename.txt</nowiki>}} on {{Linux}}, {{Mac}}<ref>[https://developer.apple.com/legacy/library/documentation/Darwin/Reference/ManPages/man1/file.1.html file(1) Mac OS X Manual Page]</ref> & Cygwin on {{Win}}. See details on [[Text file encoding]]
 == References ==

Planetoid: /* Excel way */

2018-04-26T06:01:07Z

Excel way

← Older revision		Revision as of 14:01, 26 April 2018
Line 77:		Line 77:
	</pre>		</pre>

	=== Excel way ===		=== Excel / Google sheet way ===
	Using the [https://support.office.com/en-us/article/code-function-c32b692b-2ed0-4a04-bdd9-75640144b928 CODE function] to check the "numeric code for the first character in a text string".		Using the [https://support.office.com/en-us/article/code-function-c32b692b-2ed0-4a04-bdd9-75640144b928 CODE function] to check the "numeric code for the first character in a text string". If the cell {{kbd \| key=A1}} contains BOM,
			* {{kbd \| key=<nowiki>=CODE(A1)</nowiki>}} returns {{kbd \| key=63}} on Excel 2016 of {{Win}}<ref>[http://www.asciitable.com/ Ascii Table - ASCII character codes and html, octal, hex and decimal chart conversion]</ref>
			* {{kbd \| key=<nowiki>=CODE(A1)</nowiki>}} returns {{kbd \| key=95}} on Excel 2016 of {{Mac}}
			* {{kbd \| key=<nowiki>=CODE(A1)</nowiki>}} returns {{kbd \| key=65279}} or other numeric value e.g. {{kbd \| key=28201}} on Google sheet

	=== File command way ===		=== File command way ===

Planetoid: +excel way

2018-04-25T10:16:32Z

+excel way

← Older revision		Revision as of 18:16, 25 April 2018
Line 76:		Line 76:
	1234567890 contains BOM --> after str2hex: efbbbf31323334353637383930		1234567890 contains BOM --> after str2hex: efbbbf31323334353637383930
	</pre>		</pre>

			=== Excel way ===
			Using the [https://support.office.com/en-us/article/code-function-c32b692b-2ed0-4a04-bdd9-75640144b928 CODE function] to check the "numeric code for the first character in a text string".

	=== File command way ===		=== File command way ===