LemonWiki共筆 - Recent changes [en]

排除 MySQL 技術疑難問題

Planetoid — Fri, 19 Jun 2026 15:28:31 GMT

錯誤代碼: 13 拒絕存取

← Older revision		Revision as of 23:28, 19 June 2026
Line 566:		Line 566:
	$ sudo chmod 774 /Applications/XAMPP/xamppfiles/var/mysql/XXXMacBook-Pro.local.err		$ sudo chmod 774 /Applications/XAMPP/xamppfiles/var/mysql/XXXMacBook-Pro.local.err
	</pre>		</pre>

			=== 錯誤代碼: 11 資源暫時無法取得 ===
			錯誤訊息：'''Can't create a new thread (errno 11 "Resource temporarily unavailable")'''

			解決方案：[https://errerrors.blogspot.com/2026/06/xampp-mariadb-errno-11-open-files-limit.html 解決 XAMPP MariaDB 遇到 errno 11「Resource temporarily unavailable」錯誤]

	=== 錯誤代碼: 13 拒絕存取 ===		=== 錯誤代碼: 13 拒絕存取 ===
Line 597:		Line 602:

	以管理員特權開啟命令行。（如何操作: [https://www.howtogeek.com/194041/how-to-open-the-command-prompt-as-administrator-in-windows-8.1/ 如何在 Windows 8 或 10 中以管理員身份開啟命令提示符]）		以管理員特權開啟命令行。（如何操作: [https://www.howtogeek.com/194041/how-to-open-the-command-prompt-as-administrator-in-windows-8.1/ 如何在 Windows 8 或 10 中以管理員身份開啟命令提示符]）


	=== 錯誤！：SQLSTATE[HY000]：一般錯誤：3 寫入檔案 'xxx\Temp\xxx.tmp' 時出錯（錯誤代碼：28 - 設備上沒有剩餘空間） ===		=== 錯誤！：SQLSTATE[HY000]：一般錯誤：3 寫入檔案 'xxx\Temp\xxx.tmp' 時出錯（錯誤代碼：28 - 設備上沒有剩餘空間） ===

Troubleshooting of MySQL errors

Planetoid — Fri, 19 Jun 2026 15:26:39 GMT

errno 41 - Error dropping database

← Older revision		Revision as of 23:26, 19 June 2026
Line 649:		Line 649:
	Validation		Validation
	* Query the syntax {{kbd \| key=<nowiki>SHOW VARIABLES LIKE 'tmpdir';</nowiki>}} to validate the modification of mysql configuration file.		* Query the syntax {{kbd \| key=<nowiki>SHOW VARIABLES LIKE 'tmpdir';</nowiki>}} to validate the modification of mysql configuration file.

			=== errno 11 - Resource temporarily unavailable ===
			Message: '''Can't create a new thread (errno 11 "Resource temporarily unavailable")'''

			Solution: [https://duntuk.com/how-raise-ulimit-open-files-and-mysql-openfileslimit How to permanently raise ulimit 'open files' and MySQL 'open_files_limit']

	=== errno 41 - Error dropping database ===		=== errno 41 - Error dropping database ===

User:Planetoid

Planetoid — Thu, 18 Jun 2026 14:38:46 GMT

social

← Older revision		Revision as of 22:38, 18 June 2026
Line 41:		Line 41:
	* [http://zh.scratchpad.wikia.com/wiki/Special:Contributions/Planetoid my contribution][http://scratchpad.wikia.com/wiki/Special:Contributions/Planetoid] to [http://zh.scratchpad.wikia.com/wiki/%E5%9C%8D%E7%B4%80%E5%AF%A6%E9%A9%97%E5%AE%A4 圍紀實驗室]/[http://scratchpad.wikia.com/wiki/Scratchpad_Wiki_Labs Scratchpad]		* [http://zh.scratchpad.wikia.com/wiki/Special:Contributions/Planetoid my contribution][http://scratchpad.wikia.com/wiki/Special:Contributions/Planetoid] to [http://zh.scratchpad.wikia.com/wiki/%E5%9C%8D%E7%B4%80%E5%AF%A6%E9%A9%97%E5%AE%A4 圍紀實驗室]/[http://scratchpad.wikia.com/wiki/Scratchpad_Wiki_Labs Scratchpad]
	* [http://userstyles.org/users/3650 planetoid - userstyles.org]		* [http://userstyles.org/users/3650 planetoid - userstyles.org]
	* [https://greasyfork.org/zh-TW/users/160335-planetoid greasyfork] ~~(user scripts)~~		* user scripts hosted by [https://greasyfork.org/zh-TW/users/160335-planetoid greasyfork]
	** [https://greasyfork.org/zh-TW/scripts/506037-hackmd-copy-code-snippet HackMD Copy Code Snippet] MIT License		** [https://greasyfork.org/zh-TW/scripts/506037-hackmd-copy-code-snippet HackMD Copy Code Snippet] MIT License
	** [https://greasyfork.org/zh-TW/scripts/570350-hide-referrer Hide Referrer] MIT License		** [https://greasyfork.org/zh-TW/scripts/570350-hide-referrer Hide Referrer] MIT License

Troubleshooting of GIT

Planetoid — Wed, 17 Jun 2026 08:04:55 GMT

SSH Authentication Failed: Permission denied (publickey)

← Older revision		Revision as of 16:04, 17 June 2026
Line 60:		Line 60:

	{{exclaim}} Notice: `-o IdentitiesOnly=yes` prevents SSH from trying other keys loaded in the agent, which can cause unexpected auth failures.		{{exclaim}} Notice: `-o IdentitiesOnly=yes` prevents SSH from trying other keys loaded in the agent, which can cause unexpected auth failures.


			=== Git Submodule Pull Failed: unable to create file — File exists ===

			'''Error Message'''

			After pulling in GitHub Desktop, met the error message

			<pre>
			Fetching submodule lib
			error: unable to create file feeds/example.php: File exists
			Updating xxxxxxxx..xxxxxxxx
			</pre>

			'''Cause'''

			When Git tries to update the submodule to a newer commit, it finds a local untracked file with the same name, blocking the checkout. A mid-pull failure leaves the submodule in an inconsistent state and causes a large number of unexpected unstaged changes to appear in GitHub Desktop.

			'''Solution'''

			Run the following command in the project root directory to force re-sync the submodule:

			<pre>
			git submodule update --init --recursive --force
			</pre>

			If it still fails, manually remove the conflicting file and retry:

			<pre>
			rm lib/feeds/example.php
			git submodule update --init --recursive
			</pre>

			Enter the submodule directory and verify the status is clean:

			<pre>
			cd lib
			git status
			</pre>

			The expected output should be:

			<pre>
			HEAD detached from xxxxxxxx
			nothing to commit, working tree clean
			</pre>

			`nothing to commit, working tree clean` confirms the submodule has been successfully synced — return to GitHub Desktop and continue as normal. `HEAD detached` is the expected state for a submodule and does not require any action.

			{{exclaim}} Notice: The large number of unstaged changes appearing in GitHub Desktop after a failed Pull will typically return to normal once the submodule is fixed. If unexpected changes still remain, run <code>git submodule foreach git checkout .</code> to revert all modifications inside every submodule.

	== Further Reading ==		== Further Reading ==

Troubleshooting of PostgreSQL

Planetoid — Tue, 16 Jun 2026 07:17:54 GMT

pgAdmin 4 on macOS Has No Autocomplete for Field or Table Names

← Older revision		Revision as of 15:17, 16 June 2026
(2 intermediate revisions by the same user not shown)
Line 1:		Line 1:
	Troubleshooting of [https://www.postgresql.org/ PostgreSQL]		Troubleshooting of [https://www.postgresql.org/ PostgreSQL]

	== ~~How to fix Syntax error~~ of PostgreSQL ==		== Troubleshooting of PostgreSQL ==
	=== How to fix Syntax error: 7 ERROR: LIMIT #,# syntax is not supported ===		=== How to fix Syntax error: 7 ERROR: LIMIT #,# syntax is not supported ===
	Query syntax mer error		Query syntax mer error
Line 87:		Line 87:
	=== How to fix: The numeric column data all became null after imported ===		=== How to fix: The numeric column data all became null after imported ===
	[[Troubleshooting of Navicat for PostgreSQL]]		[[Troubleshooting of Navicat for PostgreSQL]]


			=== pgAdmin 4 on macOS Has No Autocomplete for Field or Table Names ===

			[https://www.pgadmin.org/download/ pgAdmin] 4 has autocomplete built in by default, but it sometimes needs to be triggered manually or configured first.

			'''How to trigger it'''
			In the Query Tool, press `Ctrl / Cmd + Space`. However, on macOS, `Ctrl + Space` is reserved for switching input methods, and `Cmd + Space` opens Spotlight, so the shortcut conflict likely prevents the autocomplete menu from appearing. This menu is what normally shows suggestions for tables, columns, schemas, and keywords.

			'''How to make autocomplete appear as you type'''

			# Windows / Linux: Go to File → Preferences → Query Tool → Auto Completion, and make sure "Keywords autocomplete?" is checked.
			# Mac: Go to pgAdmin 4 → Preferences → Query Tool → Auto Completion, and make sure "Keywords autocomplete?" is checked.

	== Further reading ==		== Further reading ==

PDF Table Parsing

Planetoid — Mon, 15 Jun 2026 12:48:04 GMT

1. Terminology

← Older revision		Revision as of 20:48, 15 June 2026
(2 intermediate revisions by the same user not shown)
Line 1:		Line 1:
	== Technical Notes on PDF Table Parsing ==		Technical Notes on PDF Table Parsing

	PDF table parsing usually cannot rely solely on the raw output produced by tools such as <code>pdfplumber.extract_tables()</code>, Camelot, Tabula, or similar libraries. Since PDF is primarily a layout-oriented format rather than a structured data format, practical implementations often require additional rules, state management, and post-processing steps in order to produce stable and usable datasets.		PDF table parsing usually cannot rely solely on the raw output produced by tools such as <code>pdfplumber.extract_tables()</code>, Camelot, Tabula, or similar libraries. Since PDF is primarily a layout-oriented format rather than a structured data format, practical implementations often require additional rules, state management, and post-processing steps in order to produce stable and usable datasets.

	~~The following notes summarize common technical issues that can serve as a reference when developing a PDF table parser.~~		=== Comparison of Different Parsers ===

	# ~~Terminology~~		# [https://github.com/jsvine/pdfplumber pdfplumber] requires writing code to process the data.
	# ~~Section Detection Requires Cross~~-~~Page State~~		# [https://www.xpdfreader.com/pdftotext-man.html pdftotext] with the `-layout` option: The drawback is that columns are aligned using spaces, rather than being extracted as a truly structured table.
	~~# A Single Section May Contain Multiple Table Schemas~~		# [https://jina.ai/ jina.ai parser]: The drawback is that columns are aligned using spaces, rather than being extracted as a truly structured table.
	~~# Parent~~-~~Child Row Relationships Require Forward-Fill Support~~
	# ~~Cross-Page Continuation Is More Than Repeated Headers~~
	~~# Headers, Notes~~, ~~and Data Rows Should Be Detected in Stages~~
	~~# Metadata Should Be Stored at the Record Level~~
	~~# Implementation Recommendations~~

	=== 1. Terminology ===		=== 1. Terminology ===

	~~====~~ Parser ~~====~~		'''Parser'''

	A <code>parser</code> is a program responsible for parsing PDF content and converting it into structured data. It usually does more than simply read text or tables; it also needs to identify sections, table types, column positions, data rows, continuations, and source metadata.		A <code>parser</code> is a program responsible for parsing PDF content and converting it into structured data. It usually does more than simply read text or tables; it also needs to identify sections, table types, column positions, data rows, continuations, and source metadata.

	~~====~~ Record ~~====~~		'''Record'''

	A <code>record</code> is a standardized data entry produced by the parser.		A <code>record</code> is a standardized data entry produced by the parser.
Line 26:		Line 21:
	A single row in a PDF does not necessarily correspond to one record. The same record may be split across multiple rows, continue across pages, or require inherited information from a parent row before it becomes complete.		A single row in a PDF does not necessarily correspond to one record. The same record may be split across multiple rows, continue across pages, or require inherited information from a parent row before it becomes complete.

	~~====~~ Section / Subsection ~~====~~		'''Section / Subsection'''

	<code>section</code> and <code>subsection</code> refer to the section and subsection in a document.		<code>section</code> and <code>subsection</code> refer to the section and subsection in a document.
Line 32:		Line 27:
	These fields are typically used to describe the source context of the data, such as which section or table block a particular record comes from.		These fields are typically used to describe the source context of the data, such as which section or table block a particular record comes from.

	~~====~~ Table Type ~~====~~		'''Table Type'''

	<code>table_type</code> is a table-type label defined by the parser to indicate what kind of data structure the current table represents.		<code>table_type</code> is a table-type label defined by the parser to indicate what kind of data structure the current table represents.
Line 48:		Line 43:
	It is not a built-in PDF field, nor is it information automatically provided by <code>pdfplumber</code>, Camelot, or Tabula.		It is not a built-in PDF field, nor is it information automatically provided by <code>pdfplumber</code>, Camelot, or Tabula.

	~~====~~ Table Schema ~~====~~		'''Table Schema'''

	A <code>table schema</code> refers to the column structure and parsing rules for a specific type of table.		A <code>table schema</code> refers to the column structure and parsing rules for a specific type of table.
Line 56:		Line 51:
	In PDF table parsing, a <code>table schema</code> is not necessarily a database schema. Instead, it is a set of rules used by the parser to align and standardize table data.		In PDF table parsing, a <code>table schema</code> is not necessarily a database schema. Instead, it is a set of rules used by the parser to align and standardize table data.

	~~====~~ Column Mapping ~~====~~		'''Column Mapping'''

	<code>column mapping</code> refers to the process of mapping original PDF columns to standardized fields.		<code>column mapping</code> refers to the process of mapping original PDF columns to standardized fields.
Line 62:		Line 57:
	For example, different documents may use headers such as “Item Name,” “Object Name,” or “Target Name,” but all of them can be normalized into <code>item_name</code> in the output data.		For example, different documents may use headers such as “Item Name,” “Object Name,” or “Target Name,” but all of them can be normalized into <code>item_name</code> in the output data.

	~~====~~ Alias Mapping ~~====~~		'''Alias Mapping'''

	<code>alias mapping</code> refers to a lookup table for header aliases.		<code>alias mapping</code> refers to a lookup table for header aliases.
Line 68:		Line 63:
	Because PDF table headers often vary across versions, formats, or reporting units, the parser needs to map multiple header names to the same standardized field.		Because PDF table headers often vary across versions, formats, or reporting units, the parser needs to map multiple header names to the same standardized field.

	~~====~~ Forward-Fill ~~====~~		'''Forward-Fill'''

	<code>forward-fill</code> refers to the process of allowing later rows to inherit field values from previous rows.		<code>forward-fill</code> refers to the process of allowing later rows to inherit field values from previous rows.
Line 74:		Line 69:
	In a parent-child row structure, a parent row may appear only once, while subsequent child rows omit repeated information. In this case, the parser needs to fill the parent-row information into the child rows.		In a parent-child row structure, a parent row may appear only once, while subsequent child rows omit repeated information. In this case, the parser needs to fill the parent-row information into the child rows.

	~~====~~ Parent Row / Child Row ~~====~~		'''Parent Row / Child Row'''

	A <code>parent row</code> is a row that provides main category, group, or summary information.		A <code>parent row</code> is a row that provides main category, group, or summary information.
Line 82:		Line 77:
	In PDF tables, it is common for a parent row to list primary information while child rows only list detailed items. Without handling parent-child row relationships, the output data may lose necessary context.		In PDF tables, it is common for a parent row to list primary information while child rows only list detailed items. Without handling parent-child row relationships, the output data may lose necessary context.

	~~====~~ Cross-Page Continuation ~~====~~		'''Cross-Page Continuation'''

	<code>cross-page continuation</code> refers to a situation where the same record is split and continues onto the next page.		<code>cross-page continuation</code> refers to a situation where the same record is split and continues onto the next page.
Line 90:		Line 85:
	Cross-page continuation handling requires determining whether text on the next page belongs to an unfinished record from the previous page, instead of treating it directly as a new data row.		Cross-page continuation handling requires determining whether text on the next page belongs to an unfinished record from the previous page, instead of treating it directly as a new data row.

	~~====~~ Metadata ~~====~~		'''Metadata'''

	<code>metadata</code> refers to auxiliary information that describes the data source and parsing state.		<code>metadata</code> refers to auxiliary information that describes the data source and parsing state.
Line 219:		Line 214:

	[[Category: Tool]]		[[Category: Tool]]
			[[Category: Revised with LLMs]]

PDF Table Parsing

Planetoid — Mon, 15 Jun 2026 10:31:38 GMT

Created page with "== Technical Notes on PDF Table Parsing == PDF table parsing usually cannot rely solely on the raw output produced by tools such as <code>pdfplumber.extract_tables()</code>, Camelot, Tabula, or similar libraries. Since PDF is primarily a layout-oriented format rather than a structured data format, practical implementations often require additional rules, state management, and post-processing steps in order to produce stable and usable datasets. The following notes summ..."

New page

== Technical Notes on PDF Table Parsing ==

PDF table parsing usually cannot rely solely on the raw output produced by tools such as <code>pdfplumber.extract_tables()</code>, Camelot, Tabula, or similar libraries. Since PDF is primarily a layout-oriented format rather than a structured data format, practical implementations often require additional rules, state management, and post-processing steps in order to produce stable and usable datasets.

The following notes summarize common technical issues that can serve as a reference when developing a PDF table parser.

# Terminology
# Section Detection Requires Cross-Page State
# A Single Section May Contain Multiple Table Schemas
# Parent-Child Row Relationships Require Forward-Fill Support
# Cross-Page Continuation Is More Than Repeated Headers
# Headers, Notes, and Data Rows Should Be Detected in Stages
# Metadata Should Be Stored at the Record Level
# Implementation Recommendations

=== 1. Terminology ===

==== Parser ====

A <code>parser</code> is a program responsible for parsing PDF content and converting it into structured data. It usually does more than simply read text or tables; it also needs to identify sections, table types, column positions, data rows, continuations, and source metadata.

==== Record ====

A <code>record</code> is a standardized data entry produced by the parser.

A single row in a PDF does not necessarily correspond to one record. The same record may be split across multiple rows, continue across pages, or require inherited information from a parent row before it becomes complete.

==== Section / Subsection ====

<code>section</code> and <code>subsection</code> refer to the section and subsection in a document.

These fields are typically used to describe the source context of the data, such as which section or table block a particular record comes from.

==== Table Type ====

<code>table_type</code> is a table-type label defined by the parser to indicate what kind of data structure the current table represents.

Examples include:

* <code>summary_table</code>
* <code>detail_table</code>
* <code>parent_child_table</code>
* <code>cross_reference_table</code>
* <code>unknown_table</code>

The purpose of <code>table_type</code> is to help the parser determine which set of parsing rules should be applied.

It is not a built-in PDF field, nor is it information automatically provided by <code>pdfplumber</code>, Camelot, or Tabula.

==== Table Schema ====

A <code>table schema</code> refers to the column structure and parsing rules for a specific type of table.

It usually includes the number of columns, column order, standardized column names, column aliases, required fields, nullable fields, and whether special continuation handling or parent-child row handling is needed.

In PDF table parsing, a <code>table schema</code> is not necessarily a database schema. Instead, it is a set of rules used by the parser to align and standardize table data.

==== Column Mapping ====

<code>column mapping</code> refers to the process of mapping original PDF columns to standardized fields.

For example, different documents may use headers such as “Item Name,” “Object Name,” or “Target Name,” but all of them can be normalized into <code>item_name</code> in the output data.

==== Alias Mapping ====

<code>alias mapping</code> refers to a lookup table for header aliases.

Because PDF table headers often vary across versions, formats, or reporting units, the parser needs to map multiple header names to the same standardized field.

==== Forward-Fill ====

<code>forward-fill</code> refers to the process of allowing later rows to inherit field values from previous rows.

In a parent-child row structure, a parent row may appear only once, while subsequent child rows omit repeated information. In this case, the parser needs to fill the parent-row information into the child rows.

==== Parent Row / Child Row ====

A <code>parent row</code> is a row that provides main category, group, or summary information.

A <code>child row</code> is a detail row that belongs to a parent row.

In PDF tables, it is common for a parent row to list primary information while child rows only list detailed items. Without handling parent-child row relationships, the output data may lose necessary context.

==== Cross-Page Continuation ====

<code>cross-page continuation</code> refers to a situation where the same record is split and continues onto the next page.

This may occur in names, descriptive text, category fields, remarks, or other long fields.

Cross-page continuation handling requires determining whether text on the next page belongs to an unfinished record from the previous page, instead of treating it directly as a new data row.

==== Metadata ====

<code>metadata</code> refers to auxiliary information that describes the data source and parsing state.

Common fields include <code>page</code>, <code>table_index</code>, <code>table_type</code>, <code>section</code>, <code>subsection</code>, <code>source_file</code>, <code>raw_row</code>, and <code>parse_warning</code>.

Metadata helps with debugging, auditing, data traceability, and data quality checks.

=== 2. Section Detection Requires Cross-Page State ===

Section, subsection, and table category information in PDF documents may not be repeated on every page. Therefore, the parser needs to preserve the current <code>section</code>, <code>subsection</code>, or other document-level context and reuse it on subsequent pages.

Common scenarios include:

* Continuation pages may contain only table content without repeating the section title.
* Table of contents, summary, or explanatory pages may contain multiple section names at once. If the parser only checks whether a page contains certain keywords, it may misclassify the page.
* Section titles may use different punctuation or spacing due to layout variations, such as full-width or half-width parentheses, enumeration marks, colons, full-width periods, or extra spaces.
* When switching sections, subsections, or table types, inherited state from the previous table must be cleared to prevent data from being incorrectly carried over into the next block.

A recommended approach is to determine sections using a combination of text position, title patterns, and contextual state, rather than relying only on keyword matching across the entire page.

=== 3. A Single Section May Contain Multiple Table Schemas ===

A single section may contain multiple types of tables. If the parser determines column mapping only from the section name, columns may be misaligned.

When parsing each table, the parser should first inspect the header or the first few rows of the table to determine:

* <code>table_type</code>
* Number of columns
* Column order
* Standardized column names
* Whether parent-child row relationships exist
* Whether special continuation handling is required

Header names may also contain aliases, abbreviations, or terms that vary across document versions. For example, “Item Name,” “Object Name,” and “Target Name” may refer to similar fields in different documents. The implementation should therefore maintain an alias mapping that normalizes different header names into consistent fields.

=== 4. Parent-Child Row Relationships Require Forward-Fill Support ===

Some PDF tables use parent rows to list primary information, while subsequent child rows only list detail fields. For example, a parent row may contain a main category, group name, case number, or summary information, while child rows only list sub-item numbers, detail names, or detailed content.

These tables require forward-fill support, where child rows inherit field values from the parent row.

Design considerations include:

* Parent row state should be isolated by context such as <code>section</code>, <code>subsection</code>, and <code>table_type</code>.
* Parent row state may need to persist across pages.
* A single text field should not be used as the parent row identifier, because different parent rows may have identical or similar names.
* Backfilling should consider at least the section, subsection, table type, and parent-row identifier.

When the section or table changes, parent row state should be explicitly reset to avoid carrying data from the previous table into the next one.

=== 5. Cross-Page Continuation Is More Than Repeated Headers ===

When PDF tables span multiple pages, data may be split in various ways. A parser that only handles repeated headers on the next page is usually insufficient for real-world documents.

Common cross-page continuation cases include:

* The first row on the next page contains only the latter part of a field from the previous page.
* Names, categories, descriptive text, or remarks are split across pages.
* The next page starts with multiple repeated header rows before continuing an unfinished record from the previous page.
* Continuation text and a new data-row identifier appear in the same row.
* Empty columns are compressed, causing column positions to shift.
* Table borders, line breaks, or OCR results split what was originally one row into multiple rows.

Therefore, cross-page processing should preserve original column positions and should not remove empty columns too early. When necessary, the parser should use column coordinates, column indexes, identifier patterns, and the previous record state to determine which field a continuation fragment belongs to.

Continuation merging should also depend on the type of text:

* Chinese text fragments can usually be concatenated directly.
* English text fragments usually require an inserted space.
* Multi-value fields, category fields, or remarks may need to preserve line breaks, enumeration marks, or delimiters.
* Numeric fields should avoid accidentally concatenating text fragments.

=== 6. Headers, Notes, and Data Rows Should Be Detected in Stages ===

PDF tables often contain headers, unit descriptions, notes, subtotals, totals, footers, or blank rows. If a parser treats any row containing text as a data row, it can easily produce incorrect records.

A recommended parsing flow is to separate the process into stages:

# Wait for header keywords to appear.
# Detect the header area and column names.
# Determine where data rows begin.
# Process regular data rows.
# Process cross-page continuations.
# Exclude notes, units, subtotals, totals, and footers.
# Output standardized records.

Missing fields may be filled with <code>null</code>. However, if columns have shifted, the parser must not blindly apply the schema based on the order of a compressed array, as this can misalign the entire row.

=== 7. Metadata Should Be Stored at the Record Level ===

When parsing PDF tables, source context should be preserved in addition to the extracted data itself. This metadata is important for debugging, auditing, data traceability, and downstream flattened outputs.

Each record should preferably include at least:

* <code>page</code>
* <code>table_index</code>
* <code>table_type</code>
* <code>section</code>
* <code>subsection</code>
* <code>source_file</code>
* <code>raw_row</code> or original row data
* <code>parse_warning</code> or parsing warning

Writing metadata at the record level helps prevent context loss when JSON is flattened into CSV, imported into a database, or passed around as individual records.

If the document itself contains a year, quarter, period, version, batch, or category information, that information should also be explicitly preserved to avoid mixing data from different batches.

=== 8. Implementation Recommendations ===

A PDF table parser can use a layered design that separates extraction, classification, cleaning, state management, normalization, and validation.

A recommended workflow is:

# Extract text, tables, and coordinate information from the PDF.
# Detect page sections and table blocks.
# Determine <code>table_type</code> based on header keywords.
# Apply the corresponding schema and header alias mapping.
# Identify data rows, parent rows, child rows, and continuation rows.
# Manage cross-page state, parent row state, and other document-level state.
# Convert the data into standardized records.
# Add source metadata.
# Run regression checks and data quality checks.
# Output JSON, CSV, or database-ready records.

This design reduces the risk of coupling individual rules too tightly to a specific PDF layout and makes it easier to adjust only the affected parts when the document format changes.

[[Category: Tool]]

Troubleshooting of HTTP errors

Planetoid — Thu, 11 Jun 2026 08:49:52 GMT

← Older revision		Revision as of 16:49, 11 June 2026
(4 intermediate revisions by the same user not shown)
Line 7:		Line 7:
	__TOC__		__TOC__

	== ~~400 Bad Request~~ ==		== Troubleshooting HTTP Status Errors ==

	~~Root cause of~~ 400 Bad Request~~. HTTP Error 400. The request is badly formed.~~		=== 400 Bad Request ===
	* "the server cannot or will not process the request due to something that is perceived to be a client error (for example, malformed request syntax, invalid request message framing, or deceptive request routing)"

	~~Possible solution~~:		Root cause: The request itself is malformed. According to the spec, this means "the server cannot or will not process the request due to something perceived to be a client error" — such as invalid syntax, incorrect request message framing, or deceptive request routing.
	* Modify the request ~~headers~~

	== 403 Forbidden ~~Error~~ ==		Possible fix:
			* Review and correct the request headers

			=== 403 Forbidden ===

	See: [[How to fix the 403 forbidden error]]		See: [[How to fix the 403 forbidden error]]

	== 404 ~~File~~ Not Found ==		=== 404 Not Found ===
	~~Solution~~: ~~Check if~~ the ~~accessed link~~ is correct, see "404 Not Found ~~\| Possible~~ solutions for pages not found"
			Fix: Verify that the URL is correct. For more details, see
			[[404 Not Found]], possible solutions for pages not found".

			=== 405 Method Not Allowed ===

			Fix: Confirm that the target resource supports the HTTP method you're using. For example, the endpoint may only accept POST requests while you're sending a GET request.

			=== 414 Request-URI Too Large ===

	~~== 405 Method Not Allowed Error ==~~		Fix: Switch from GET to POST so the data is sent in the request body instead of the URL.
	~~Solution~~: ~~Check if~~ the ~~accessed file or resource supports~~ the ~~HTTP protocol being used. For example, if~~ the ~~resource is restricted to POST requests but you're using GET~~.

	== ~~414 Request-URI Too Large~~ ==		=== 415 Unsupported Media Type ===
	~~Solution: Change the request protocol to POST instead of GET~~

	~~== 415 Unsupported Media~~ Type ==		Fix: Explicitly declare the correct Content-Type or Content-Encoding in the request, or access the data directly. For instance, when calling a RESTful API, this error can often be resolved by adding the following header:

	Solution: "Set the Content-Type or Content-Encoding in the request or direct access to the data." For example: When encountering this error with RESTful API, a possible solution is to add to the HTTP Headers:
	<pre>		<pre>
	Content-Type: application/json		Content-Type: application/json
	</pre>		</pre>

	== 429 Too Many Requests ==		=== 429 Too Many Requests ===
	~~Root Cause:~~

	* ~~Accessing~~ website ~~resources~~ or ~~web service~~ API ~~too~~ frequently		Root cause:
			* The client is hitting the website or API more frequently than the service allows.

	~~Solutions~~:		Fixes:
			* '''Throttle your requests''': Add or increase a delay between requests based on your usage pattern and the service's limits (e.g., pause 1 second between calls).
			* '''Check the API rate limits''': Consult the provider's documentation for limits such as Requests Per Minute (RPM) or Requests Per Day (RPD), and find out whether you can request a higher quota.
			* '''Use exponential backoff''': Detect HTTP 429 responses in your
			application, then retry with progressively longer delays (e.g., 2s → 4s → 8s) until the request succeeds or a maximum retry count is reached.

	* '''Adjust the delay time''' based on your usage patterns and the service's limits e.g. Increase the delay time between requests (e.g., add a 1-second pause between each request).		=== 502 Bad Gateway ===
	* If accessing a web service API, Please refer to the documentation to understand the API access rate limits, such as: (1) "Requests Per Minute" (RPM) – the maximum number of API requests you can make per minute, or (2) "Requests Per Day" (RPD) – the maximum number of API requests you can make per day. Check if you can request a higher quota limit from the service provider
	* '''Implement exponential backoff retry mechanism''': Detect rate limit errors (HTTP 429) in your application. Increase the delay time with each failed retry (e.g., 2 seconds, 4 seconds, 8 seconds). Continue retrying until the request succeeds or maximum retry count is reached.

	~~== 502 Bad Gateway ==~~
	Cause:		Cause:
	* ~~Error occurs~~ between network devices~~, users cannot~~ directly ~~handle it~~.		* A failure between upstream network devices/servers — not something the end user can fix directly.

	~~Solutions~~:		Fixes:
	* ~~Bypass browser cache,~~ refresh the page		* Hard-refresh the page to bypass the browser cache
	* ~~Try reconnecting after~~ a ~~while~~		* Wait a moment and try again

	== Error 1020: Access Denied ==		=== Error 1020: Access Denied ===
	* See ~~link for understanding how to resolve~~ Error 1020 Access Denied to ~~get~~ your website ~~back online~~		* See the linked guide on resolving Error 1020 (Access Denied) to restore access to your website.

	~~<pre>~~		== HTTP Cats or Dogs ==
	~~Content-Type: application/json~~
	~~</pre>~~

			<div style="zoom: 0.4;">
	https://http.cat/200.jpg		https://http.cat/200.jpg
	From HTTP Cats		</div>
			From [https://http.cat/ HTTP Cats]

	Related websites:		Related websites:
Line 69:		Line 76:
	== Other possible root causes ==		== Other possible root causes ==
	* CDN (Content delivery network)		* CDN (Content delivery network)

			== Mock HTTP status error page tools ==
			The testing sites that can return 500 and various other HTTP status codes on demand

			* [https://the-internet.herokuapp.com/status_codes The Internet]<ref>[https://stackoverflow.com/questions/24736134/is-there-a-website-that-returns-500-and-other-http-response-codes-for-testing httpresponse - Is there a website that returns 500 (and other) HTTP response codes for testing? - Stack Overflow]</ref>
			* [https://httpstatus.io/ httpstatus.io]: A bulk checker for HTTP status codes, headers, and redirects, which also offers mock endpoints, e.g. [https://mock.httpstatus.io/500 500]
			* [https://www.postman.com/postman/published-postman-templates/documentation/ae2ja6x/postman-echo Postman Echo]: A request/response testing service with status code endpoints, e.g. [https://postman-echo.com/status/500 500]

	== Related pages ==		== Related pages ==
Line 74:		Line 88:
	* [[Troubleshooting of curl errors]]		* [[Troubleshooting of curl errors]]
	* [[Test connectivity for the web service]]		* [[Test connectivity for the web service]]
	* [https://the-internet.herokuapp.com/status_codes The Internet]: The website that returns 500 (and other) HTTP response codes for testing<ref>[https://stackoverflow.com/questions/24736134/is-there-a-website-that-returns-500-and-other-http-response-codes-for-testing httpresponse - Is there a website that returns 500 (and other) HTTP response codes for testing? - Stack Overflow]</ref>

	== References ==		== References ==

Count number of characters

Planetoid — Wed, 10 Jun 2026 07:28:14 GMT

How To test a chatbot

Planetoid — Wed, 10 Jun 2026 02:25:26 GMT

Example questions

← Older revision		Revision as of 10:25, 10 June 2026
Line 9:		Line 9:

	問：明天馬祖天氣怎麼樣？		問：明天馬祖天氣怎麼樣？
	* ~~預期：機器人明天回答馬祖天氣、氣溫等資訊。而不是回答錯誤地點的氣象資訊~~		* 預期：機器人回答明天馬祖天氣、氣溫等資訊。而不是回答錯誤地點的氣象資訊

	問：今天台北天氣怎樣？我要怎麼穿衣服？		問：今天台北天氣怎樣？我要怎麼穿衣服？
Line 17:		Line 17:
	* 預期：機器人可以偵測到異常溫度範圍		* 預期：機器人可以偵測到異常溫度範圍

			問：使用 Python 程式語言寫未來一週天氣預測的機器學習模型
			* 預期：機器人可以偵測到問題超出原始設計的邊界用途

	== Further reading ==		== Further reading ==

How to choose open source solution

Planetoid — Tue, 09 Jun 2026 08:15:27 GMT

方案選擇的提示詞

← Older revision		Revision as of 16:15, 9 June 2026
(One intermediate revision by the same user not shown)
Line 28:		Line 28:
	# 中文議題：可以使用繁體中文、多國語言 (unicode)		# 中文議題：可以使用繁體中文、多國語言 (unicode)
	# (選擇性考慮的問題) 使用新或穩定的技術：例如試用 demo 版本功能、或查看截圖，確認軟體方案使用的技術或是否支援行動裝置。		# (選擇性考慮的問題) 使用新或穩定的技術：例如試用 demo 版本功能、或查看截圖，確認軟體方案使用的技術或是否支援行動裝置。

			== 方案選擇的提示詞 ==
			給 AI 的提示詞

			<pre>
			我的需求是 _________ ，請依照以下指標評估推薦的方案：

			1. 專案活躍度：近期是否有持續更新？是否有人維護？
			2. 授權相容性：是否可用於商業用途？
			3. 社群互動數：提供 GitHub stars, forks 數字
			4. 推薦理由
			</pre>

	== 延伸閱讀 ==		== 延伸閱讀 ==

Speech to text

Planetoid — Mon, 08 Jun 2026 02:18:23 GMT

Speech to text software

← Older revision		Revision as of 10:18, 8 June 2026
Line 45:		Line 45:
	[https://huggingface.co/spaces/Xenova/whisper-web Whisper Web - a Hugging Face Space by Xenova]		[https://huggingface.co/spaces/Xenova/whisper-web Whisper Web - a Hugging Face Space by Xenova]
	* Input file: Audio files		* Input file: Audio files
	* Support Language: English		* Support Language: English {{exclaim}} Even if the audio file contains a mix of two languages (e.g. Mandarin Chinese/English), the final output will only be in English. There is also no prompt available to modify this behavior.
	* Speaker identification: No {{exclaim}}		* Speaker identification: No {{exclaim}}
	* Output file format: TXT or JSON (contains timestamp info.)		* Output file format: TXT or JSON (contains timestamp info.)
Line 97:		Line 97:
	* Price: Free or Pro plan		* Price: Free or Pro plan
	* Output file format: TXT, DOCX, SRT, VTT, JSON and more		* Output file format: TXT, DOCX, SRT, VTT, JSON and more
	* Notes:		* Notes:

	== Speech to text API ==		== Speech to text API ==

AI Prompt Engineering in Mandarin

Planetoid — Sat, 06 Jun 2026 03:51:32 GMT

逐字稿潤稿

@@ Line 718: / Line 718: @@
 <pre>
 請設計一個簡潔的儀表板風格介面，適用於（你的產品名稱），並具備以下三項主要功能：（列出三項主要功能）。
 </pre>

Speech to text

Planetoid — Sat, 06 Jun 2026 03:48:07 GMT

← Older revision		Revision as of 11:48, 6 June 2026
Line 1:		Line 1:
	Comparison of speech to text (transcription) software		Comparison of speech to text (transcription) software

			{{Template:Generative AI Tool}}

	== Speech to text software ==		== Speech to text software ==

Template:Generative AI Tool

Planetoid — Sat, 06 Jun 2026 03:45:58 GMT

← Older revision		Revision as of 11:45, 6 June 2026
Line 1:		Line 1:
	<div class="nav" style="border-bottom:1px solid #CFD5D7; border-right: 1px solid #CFD5D7; padding: 10px; -moz-border-radius: 10px 10px 0 0; background:#E0EDEE">		<div class="nav" style="border-bottom:1px solid #CFD5D7; border-right: 1px solid #CFD5D7; padding: 10px; -moz-border-radius: 10px 10px 0 0; background:#E0EDEE">
	Generative AI Tool: 📁 [[AI Prompt Engineering\|Prompts]] \| 👩🏻‍💻 [[Text to presentation\|Text to presentation]] \| 📢 [[Text to speech\|Text to audio or speech]] \| 🎵 [[Text to music]] \| 🖼️ [[Text to image]] \| 🎥 [[Text to video]] \| 🚀 [[AI assistants in coding \| Coding]] \| 🧭 [[Guiding principles on generative artificial intelligence \| Guideline]] \| 💬 [[LLMs Usage FAQ \| FAQ]]		Generative AI Tool: 📁 [[AI Prompt Engineering\|Prompts]] \| 👩🏻‍💻 [[Text to presentation\|Text to presentation]] \| 📢 [[Text to speech\|Text to audio or speech]], [[Speech to text]] \| 🎵 [[Text to music]] \| 🖼️ [[Text to image]] \| 🎥 [[Text to video]] \| 🚀 [[AI assistants in coding \| Coding]] \| 🧭 [[Guiding principles on generative artificial intelligence \| Guideline]] \| 💬 [[LLMs Usage FAQ \| FAQ]]
	<!-- Ψ 生成工具: 📁 [[ChatGPT prompts\|文字]] \| 🎵 [[Text to speech\|生成音訊、聲音]] \| 🎥 [[Text to video\|生成影片或動畫]] \| 🌈 [[Text to image\|生成圖片]] Ψ -->		<!-- Ψ 生成工具: 📁 [[ChatGPT prompts\|文字]] \| 🎵 [[Text to speech\|生成音訊、聲音]] \| 🎥 [[Text to video\|生成影片或動畫]] \| 🌈 [[Text to image\|生成圖片]] Ψ -->
	</div>		</div>

Speech to text

Planetoid — Sat, 06 Jun 2026 03:44:59 GMT

Show changes

Template:Speech to text

Planetoid — Sat, 06 Jun 2026 02:52:50 GMT

← Older revision		Revision as of 10:52, 6 June 2026
Line 1:		Line 1:
	<div style="background-color: #ffffff; border: 1px dotted #a2a9b1; width: 90%; padding: 0.2em 0.4em;">		<div style="background-color: #ffffff; border: 1px dotted #a2a9b1; width: 90%; padding: 0.2em 0.4em;">
	[[:Category:NLP]] > [[~~Text_to_speech#Speech_to_text_.E5.B7.A5.E5.85.B7 \|~~ Speech to text]] > {{PAGENAME}}		[[:Category:NLP]] > [[Speech to text]] > {{PAGENAME}}
	</div>		</div>

Text to speech

Planetoid — Sat, 06 Jun 2026 02:48:49 GMT

Speech to text 工具

@@ Line 73: / Line 73: @@
 == Speech to text 工具 ==
-{{Gd}} [https://github.com/openai/whisper openai/whisper: Robust Speech Recognition via Large-Scale Weak Supervision]
+[[Speech to text]]
 == Further reading ==

Speech to text

Planetoid — Sat, 06 Jun 2026 02:48:30 GMT

Created page with "== Speech to text 工具 == {{Gd}} [https://github.com/openai/whisper openai/whisper: Robust Speech Recognition via Large-Scale Weak Supervision] * Support Language: 99 languages * Input file: Audio files * Speaker identification: Need to integrate with (1) [https://github.com/m-bain/whisperX m-bain/whisperX: WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)] or (2) [https://github.com/pyannote/pyannote-audio pyannote/pyannote-audio: Neura..."

New page

== Speech to text 工具 ==
{{Gd}} [https://github.com/openai/whisper openai/whisper: Robust Speech Recognition via Large-Scale Weak Supervision]
* Support Language: 99 languages
* Input file: Audio files
* Speaker identification: Need to integrate with (1) [https://github.com/m-bain/whisperX m-bain/whisperX: WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)] or (2) [https://github.com/pyannote/pyannote-audio pyannote/pyannote-audio: Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding]
* Real-Time Subtitles or Translation: Not Available
* Related:
** [https://huggingface.co/spaces/Xenova/whisper-webgpu Whisper WebGPU - a Hugging Face Space by Xenova]
** [https://github.com/aaaddress1/Whisper.py?fbclid=IwAR1rwZH-USj2NIt8pLYRGhIqWvQWUj1FQTx83qpBncno3ANWDUBI_duWr9M aaaddress1/Whisper.py: 白癡喔還要下 pip install 誰會用啦—隨開即用 Windows 版 OpenAI Whisper 逐字稿產生器] on {{Win}} 介紹：[https://www.playpcesor.com/2023/04/whisperdesktop-ai.html WhisperDesktop 語音轉文字免費單機軟體，AI 影片字幕實測比較]
** 🎙️ MacWhisper https://goodsnooze.gumroad.com/l/macwhisper on {{Mac}}

[https://cloud.google.com/speech/?hl=zh-tw Speech API - 語音辨識 | Google Cloud] 「語音轉文字採用機器學習技術」，免費版語音辨識的額度 60 分鐘，詳 [https://cloud.google.com/speech-to-text/pricing 定價 | Cloud Speech API Documentation | Google Cloud]。 {{access | date = 2018-09-04}}
* Input: microphone & audio file (For audio file which longer than 1 minute, upload files to Google cloud storage.
* Language: 120 languages <ref>[https://cloud.google.com/speech-to-text/docs/languages?hl=zh-tw Language Support | Cloud Speech-to-Text API | Google Cloud]</ref>
* Sample code:
* Related: [[Troubleshooting of Google cloud speech to text]])

[https://azure.microsoft.com/zh-tw/services/cognitive-services/speech/ Bing 語音 API - 語音辨識軟體 | Microsoft Azure]
* Input: Audio file. Format: wav & ogg<ref>[https://docs.microsoft.com/zh-tw/azure/cognitive-services/speech-service/rest-speech-to-text 語音轉換文字 API 參考（REST）-語音服務 - Azure Cognitive Services | Microsoft Docs]</ref>
* Language: Traditional Chinese, Simplified Chinese & English and more on the list<ref>[https://docs.microsoft.com/zh-tw/azure/cognitive-services/speech-service/language-support#speech-to-text 語言支援-語音服務 - Azure Cognitive Services | Microsoft Docs]</ref>
* Sample code: [https://github.com/Azure-Samples/SpeechToText-REST Azure-Samples/SpeechToText-REST: REST Samples of Speech To Text API]
* Related:

[https://app.clipchamp.com/ Clipchamp] {{access | date = 2025-04-02}}
* Input: audio or video file
* Support Language: 80+ languages<ref>[https://support.microsoft.com/en-us/topic/how-to-use-autocaptions-in-clipchamp-ccb0520b-38f6-4fa9-aca8-872c2964946a How to use autocaptions in Clipchamp - Microsoft Support]</ref><ref>[https://learn.microsoft.com/zh-tw/azure/ai-services/speech-service/language-support?tabs=stt 語言支援 - 語音服務 - Azure AI services | Microsoft Learn]</ref>
* Comments: The free version seems to have no limitation on video duration, and you can also use AI to convert videos or audio into transcripts for free. However, during testing, the subtitles displayed for each time code were not complete sentences.

[https://ink.dwave.cc/en-US/pricing Meeting Ink - AI notetaker to transcribe and summarize your meetings and recordings.]
* Support Language:
* Input file: Audio files
* Speaker identification: Available {{Gd}}
* Real-Time Subtitles or Translation: Pro plan only ''$''
* Free limit: 30 minutes max

[https://tw.olami.ai/open/website/apiandsolution/api_solution OLAMI 中文語音辨識 API｜歐拉蜜人工智慧開放平台（威盛電子）] {{access | date = 2018-09-05}}
* Input: Audio file. Format: wav & speex <ref>[https://tw.olami.ai/wiki/?mp=api_asr&content=api_asr1.html 文件中心 - OLAMI - 歐拉蜜人工智慧開放平台]</ref>
* Language: Traditional Chinese & Simplified Chinese <ref>[https://github.com/olami-developers/olami-api-quickstart-curl-samples/tree/master/cloud-speech-recognition olami-api-quickstart-curl-samples/cloud-speech-recognition at master · olami-developers/olami-api-quickstart-curl-samples]</ref>
* Sample code: [https://github.com/olami-developers/olami-api-quickstart-curl-samples/tree/master/cloud-speech-recognition olami-developers/olami-api-quickstart-curl-samples]
* Related: [[Troubleshooting of Olami speech to text]]

影片要產生文字，可利用 youtube 的 [https://support.google.com/youtube/answer/6373554?hl=en Use automatic captioning - YouTube Help]，約需要半天時間 {{access | date = 2018-09-04}} 教學: [https://www.techbang.com/posts/2107 YouTube超佛心，自動幫你加入字幕！ | T客邦]
* Input: Video
* Language:
* Sample code:
* Related:

[https://www.xfyun.cn/doccenter/asr 语音识别 - 讯飞开放平台] {{access | date=2018-09-06}}
* Input: speex audio file less than 1 minute <ref>[https://doc.xfyun.cn/rest_api/%E8%AF%AD%E9%9F%B3%E5%90%AC%E5%86%99.html 语音听写 · 科大讯飞REST_API开发指南]</ref>
* Language: 中文（普通话）、英文、中文（粤语）、中文（四川话）
* Sample code:
* Related:

[https://aws.amazon.com/tw/transcribe/ Amazon Transcribe – 自動語音辨識 – AWS] (API documentation: [https://docs.aws.amazon.com/transcribe/latest/dg/what-is-transcribe.html What Is Amazon Transcribe? - Amazon Transcribe]) {{access | date=2018-09-05}}
* Input: Audio file (Stored in S3 bucket). "Valid formats for the audio are mp3, mp4, wav and flac. <ref>[https://docs.aws.amazon.com/transcribe/latest/dg/API_StartTranscriptionJob.html StartTranscriptionJob - Amazon Transcribe] For best results, use a lossless format, such as FLAC or WAV with PCM 16-bit encoding.Your audio input can be sampled at any rate between 8000 and 48000 Hz. We suggest that you use 8000 Hz for low-quality audio and 16000 Hz for high-quality audio.</ref>"
* Language: English, Spanish
* Sample code:
* Related:

[https://pulipulichen.github.io/HTML5-Speech-to-Text/ Web Speech to Text] 教學: [https://www.playpcesor.com/2019/12/Web-Speech-to-Text.html 免費！中文影片語音轉文字字幕，支援超大影片與長時間錄音]
* 物件: 電腦影像、聲音、YouTube 網址
* 語言: 中文、英文、日文、韓文

[https://app.voicetapp.com/ Voicetapp - AI Voice to Text Transcription]
* Language: 中文、英文等多種語言
* Sample code:
* Related:
* Free limit: 5 minutes

[https://github.com/SYSTRAN/faster-whisper?tab=readme-ov-file SYSTRAN/faster-whisper: Faster Whisper transcription with CTranslate2]
* Language: Fork from OpenAI Whisper
* Sample code: [https://colab.research.google.com/drive/1TqmzTY5ZXcYBoBGbwSVBtwxlFajMIcRc?usp=sharing]
* Related:
* Free limit:
* Instruction: [https://gsyan888.blogspot.com/2023/11/faster-whisper.html 雄::gsyan: 以 Faster Whisper 將影音辨識為文字檔案(字幕或逐字稿)]

[https://www.mygoodtape.com/ Good Tape]
* Support Language:
* Input file: Audio files
* Speaker identification: Available {{Gd}}
* Real-Time Subtitles or Translation: Not Available
* Free limit: 20 minutes max

[https://www.larksuite.com/ Lark | Business Chat & Collaboration Tool] ([https://zh.wikipedia.org/wiki/%E9%A3%9E%E4%B9%A6 飞书 - 維基百科，自由的百科全書])
* Language:
* Sample code:
* Related:
* Free limit:

[https://github.com/Const-me/Whisper Const-me/Whisper: High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model] on {{Win}}
* Language:
* Sample code:
* Related:
* Free limit:

[https://web.itranscribe.co/#/homepage iTranscribe: Transcribe Audio & Video to Text]
* Language:
* Sample code:
* Related:
* Free limit:

[https://www.capcut.cn/ 剪映官網-全能易用的桌面端剪輯軟體-輕而易剪上演大幕] 中國軟體 {{exclaim}}
* Language:
* Sample code:
* Related:
* Free limit:

Markdown editors

Planetoid — Sat, 06 Jun 2026 01:32:15 GMT

Free softwares

← Older revision		Revision as of 09:32, 6 June 2026
(2 intermediate revisions by the same user not shown)
Line 116:		Line 116:
	* Draw diagrams: Available. Supports Mermaid syntax via the [https://obsidian.md/plugins?id=mermaid-tools Mermaid plugin]. {{Gd}}		* Draw diagrams: Available. Supports Mermaid syntax via the [https://obsidian.md/plugins?id=mermaid-tools Mermaid plugin]. {{Gd}}

			[https://github.com/craig7351/bookMDViewer craig7351/bookMDViewer: Open-source MD viewer] <ref>https://www.facebook.com/groups/1024463572071191/</ref> Version 1.0.2
			* Supported {{OS}}: Windows, macOS & Linux
			* Price: Free
			* Table of Contents: Yes
			* Software License: [https://github.com/craig7351/bookMDViewer/blob/main/LICENSE MIT]
			* Custom Font: Not supported
			* Export: HTML
			* Syndication: Not supported
			* Diagram Support: Yes, Support Mermaid syntax

	<pre>		<pre>
Line 121:		Line 130:

	title		title
	* Supported {{OS}}:		* Supported {{OS}}: Windows, Mac & Linux
	* Price:		* Price: Free or need to paid
	* Table of content:		* Table of content: Available or not
	* Software license: Proprietary ...		* Software license: Proprietary ...
	* Custom Font:		* Custom Font:
Line 217:		Line 226:
	* {{Gd}} [https://www.tablesgenerator.com/markdown_tables Markdown Tables generator - TablesGenerator.com]		* {{Gd}} [https://www.tablesgenerator.com/markdown_tables Markdown Tables generator - TablesGenerator.com]

	References		== References ==

	<~~References~~ />		<references />

	[[Category:Software]]		[[Category: Software]]

Input method editor

Planetoid — Sat, 06 Jun 2026 01:08:27 GMT

免費輸入法

← Older revision		Revision as of 09:08, 6 June 2026
Line 27:		Line 27:
	* 輸入法：注音		* 輸入法：注音
	* 授權方式：[https://github.com/vChewing/vChewing-macOS/blob/main/LICENSE-CHT.txt MIT-NTL License]		* 授權方式：[https://github.com/vChewing/vChewing-macOS/blob/main/LICENSE-CHT.txt MIT-NTL License]

			[https://www.asus.com/tw/content/smartinput/ 華碩智慧輸入法｜ASUS 台灣]
			* 作業系統：{{Win}}
			* 輸入法：注音
			* 授權方式：著作權所有

	[https://rime.im/ RIME \| 中州韻輸入法引擎] {{access \| date =2025-06-13}}		[https://rime.im/ RIME \| 中州韻輸入法引擎] {{access \| date =2025-06-13}}

Subscribe keyword news

Planetoid — Fri, 05 Jun 2026 04:31:01 GMT

← Older revision		Revision as of 12:31, 5 June 2026
(3 intermediate revisions by the same user not shown)
Line 8:		Line 8:
	* 教學: [http://planetoid.info/weblog/2006/01/03/000530.html 使用Google快訊(Google alert)訂閱國外訊息]		* 教學: [http://planetoid.info/weblog/2006/01/03/000530.html 使用Google快訊(Google alert)訂閱國外訊息]

	== ~~其他訊息通知服務~~ ==		== 其他替代新聞搜尋服務 ==
	''$'' [https://tavily.com/ Tavily]		''$'' [https://tavily.com/ Tavily]
	* 資料類型: 一般網路資源、新聞、財經類新聞。詢問客服 (2025/4) ~~不支援台灣的新聞來源，需要直接列出要搜尋的網域來源清單。~~		* 資料類型: 一般網路資源、新聞、財經類新聞。詢問客服 (2025/4) 不支援台灣的新聞來源，替代方案是直接列出要搜尋的網域來源清單。
	* 傳送頻率:		* 傳送頻率:
	* 傳送方式: API		* 傳送方式: API
	* 教學:		* 教學:


			''$'' 支援網頁搜尋工具 (Web Search Tool) 的 LLMs API

			供應商包含 [https://docs.anthropic.com/en/docs/agents-and-tools/tool-use/web-search-tool Anthropic]、[https://platform.openai.com/docs/guides/tools-web-search OpenAI]、[https://docs.x.ai/docs/guides/live-search xAI Grok]。
			* 資料類型: 一般網路資源、即時資訊、新聞。
			* 傳送方式: API（在請求的 `tools` 陣列中啟用搜尋工具）
			* 共同特色:
			** 模型自行判斷是否需要執行搜尋，無法由開發者強制觸發。
			** 回應自動附帶來源引用。
			** 均支援網域白名單（`allowed_domains`）與黑名單（`blocked_domains`）來限制搜尋範圍。
			** 費用以搜尋次數計費（約 $5–$10 / 1,000 次），另加 token 費用。
			* xAI Grok 額外提供 `x_search` 工具，可搜尋 X/Twitter 平台上的即時貼文與討論。


	[https://www.mediacloud.org/ Media Cloud]		[https://www.mediacloud.org/ Media Cloud]
Line 46:		Line 60:
	* 教學:		* 教學:

	[[Category:PKM]] [[Category:Search]]		[[Category: PKM]]
			[[Category: Search]]
			[[Category: News search]]
			[[Category: Revised with LLMs]]

Troubleshooting of GIT

Planetoid — Thu, 04 Jun 2026 06:39:32 GMT

Created page with " == Troubleshooting of GIT == === Restoring deleted files in Git === Restoring deleted files in Git === SSH Authentication Failed: Permission denied (publickey) === '''Error Message''' After keyin the command <pre>git clone git@github.com:your-org/your-repo.git /opt/your-app</pre>, met the error message <pre> Cloning into '/opt/your-app'... git@github.com: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the..."

New page

== Troubleshooting of GIT ==

=== Restoring deleted files in Git ===
[[Restoring deleted files in Git]]

=== SSH Authentication Failed: Permission denied (publickey) ===

'''Error Message'''

After keyin the command <pre>git clone git@github.com:your-org/your-repo.git /opt/your-app</pre>, met the error message

<pre>
Cloning into '/opt/your-app'...
git@github.com: Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights and the repository exists.
</pre>

'''Cause'''

This error occurs when Git cannot authenticate with GitHub over SSH. This typically means the SSH key on your machine is either missing, not registered with your GitHub account, or not being picked up by the SSH agent.

'''Solutions'''

'''Option 1 — Configure your SSH config file'''

Add an entry to `~/.ssh/config` so Git automatically uses the correct key:

<pre>
Host github.com
HostName github.com
User git
IdentityFile /path/to/.ssh/your_key_name
</pre>

'''Option 2 — Pass the SSH key inline'''

1. Before running `git clone`, test whether the specified SSH key can successfully authenticate with GitHub:

<pre>
ssh -T -i /path/to/.ssh/your_key_name git@github.com
</pre>

If the key is configured correctly, you should see:

<pre>
Hi your-org/your-app! You've successfully authenticated, but GitHub does not provide shell access.
</pre>

`successfully authenticated` confirms the key is correctly linked to your GitHub account and you're good to proceed with `git clone`. The message `GitHub does not provide shell access` is expected — SSH is used for Git operations only, not for interactive shell login.

2. Override the SSH command directly when cloning:

<pre>
sudo GIT_SSH_COMMAND='ssh -i /path/to/.ssh/your_key_name -o IdentitiesOnly=yes' \
git clone git@github.com:your-org/your-repo.git /opt/your-app
</pre>

{{exclaim}} Notice: `-o IdentitiesOnly=yes` prevents SSH from trying other keys loaded in the agent, which can cause unexpected auth failures.

== Further Reading ==

* [https://docs.github.com/en/authentication/connecting-to-github-with-ssh/generating-a-new-ssh-key-and-adding-it-to-the-ssh-agent Generating a new SSH key and adding it to the ssh-agent - GitHub Docs]
* [https://docs.github.com/en/authentication/connecting-to-github-with-ssh/adding-a-new-ssh-key-to-your-github-account Adding a new SSH key to your GitHub account - GitHub Docs]
* [https://docs.github.com/en/authentication/connecting-to-github-with-ssh/testing-your-ssh-connection Testing your SSH connection - GitHub Docs]
* [https://linux.die.net/man/5/ssh_config ssh_config(5): OpenSSH SSH client config files - Linux man page]
* [https://docs.github.com/en/authentication/troubleshooting-ssh Troubleshooting SSH - GitHub Docs]

[[Category: Git]]
[[Category: Revised with LLMs]]

Troubleshooting of HTTP errors

Planetoid — Fri, 29 May 2026 08:38:01 GMT

← Older revision		Revision as of 16:38, 29 May 2026
Line 74:		Line 74:
	* [[Troubleshooting of curl errors]]		* [[Troubleshooting of curl errors]]
	* [[Test connectivity for the web service]]		* [[Test connectivity for the web service]]
			* [https://the-internet.herokuapp.com/status_codes The Internet]: The website that returns 500 (and other) HTTP response codes for testing<ref>[https://stackoverflow.com/questions/24736134/is-there-a-website-that-returns-500-and-other-http-response-codes-for-testing httpresponse - Is there a website that returns 500 (and other) HTTP response codes for testing? - Stack Overflow]</ref>

	== References ==		== References ==

Convert webpage to markdown

Planetoid — Fri, 29 May 2026 04:14:39 GMT

Convert webpage to markdown

← Older revision		Revision as of 12:14, 29 May 2026
Line 3:		Line 3:

	== Convert webpage to markdown ==		== Convert webpage to markdown ==
	* [https://github.com/deathau/markdownload?tab=readme-ov-file deathau/markdownload]: "A Firefox and Google Chrome extension to clip websites and download them into a readable markdown file." {{Gd}} Automatically identify and extract the primary content area of a webpage (integration of [https://github.com/mozilla/readability mozilla/readability.js])		1. [https://github.com/deathau/markdownload?tab=readme-ov-file deathau/markdownload]: "A Firefox and Google Chrome extension to clip websites and download them into a readable markdown file." {{Gd}} Automatically identify and extract the primary content area of a webpage (integration of [https://github.com/mozilla/readability mozilla/readability.js])
	* [https://jina.ai/reader/ Jina Reader API]

			2. [https://jina.ai/reader/ Jina Reader API]

	Bookmarklet		Bookmarklet

	<pre>		<pre>
	javascript:(function(){location.href='https://r.jina.ai/'+location.href})();		javascript:(function(){location.href='https://r.jina.ai/'+location.href})();
	</pre>		</pre>

			3. ''$'' [https://www.firecrawl.dev/ Firecrawl - The API to search, scrape, and interact with the web at scale. 🔥]

			You may define the scrape result format, such as `markdown`, `rawHtml`, or `json`. For example, Firecrawl’s scrape endpoint supports body formats like those documented [https://docs.firecrawl.dev/api-reference/endpoint/scrape#body-formats here].

	[[Category: Tool]]		[[Category: Tool]]

Troubleshooting of Google Vertex AI Search

Planetoid — Tue, 26 May 2026 11:25:17 GMT

Troubleshooting: Vertex AI Discovery Engine: Search Returns No Results

@@ Line 204: / Line 204: @@
 # {collection_name}: `default_collection` (the string after `/collections/`)
 # {datastore_name}: Found on the datastore overview page as "Datastore ID" (e.g., `XXX_1234567890123`) {{exclaim}} Note: The datastore_name is not visible in the engine URL - you need to check the datastore overview page to find the "Datastore ID".
 == Related Pages ==

← Older revision		Revision as of 15:28, 10 June 2026
(2 intermediate revisions by the same user not shown)
Line 1:		Line 1:
	Counting number of characters (or bytes) in different approaches		Counting number of characters (or bytes) in different approaches

			== Character Count vs. Byte Count Comparison ==
	<table border="1" class="wikitable sortable">		<table border="1" class="wikitable sortable">
	<tr>		<tr>
Line 35:		Line 36:
	<td>敏捷的棕毛狐狸從懶狗身上躍過</td>		<td>敏捷的棕毛狐狸從懶狗身上躍過</td>
	<td>14</td>		<td>14</td>
	<td>28</td>		<td>42</td>
	</tr>		</tr>
	</table>		</table>

			: [[Image:Owl icon.jpg]] Each Chinese character is approximately 3 bytes in UTF-8

			Common Chinese characters (CJK Unified Ideographs, U+4E00 ~ U+9FFF) are all 3 bytes — for example, "你", "好", "狐", and "象". Characters beyond U+FFFF (outside the Basic Multilingual Plane, BMP<ref>[https://en.wikipedia.org/wiki/Plane_(Unicode) Plane (Unicode) - Wikipedia]</ref>) take 4 bytes. These are mostly rare characters from CJK Extension B (U+20000 and up)<ref>[https://en.wikipedia.org/wiki/CJK_Unified_Ideographs_Extension_B CJK Unified Ideographs Extension B - Wikipedia]</ref>, such as "[https://www.cns11643.gov.tw/wordView.jsp?ID=993142 𤆬]" (U+241AC) and "[https://www.cns11643.gov.tw/wordView.jsp?ID=402472 𠮷]" (U+20BB7).

	== How to count characters with PHP ==		== How to count characters with PHP ==
Line 170:		Line 175:
	* [https://www.ithome.com.tw/voice/131688 Unicode與JavaScript字串 \| iThome]		* [https://www.ithome.com.tw/voice/131688 Unicode與JavaScript字串 \| iThome]

	[[Category:Software]] [[Category:Programming]] [[Category:Data Science]] [[Category:String manipulation]] [[Category:PHP]] [[Category:MySQL]]		[[Category: Software]]
			[[Category: Programming]]
			[[Category: Data Science]]
			[[Category: String manipulation]]
			[[Category: PHP]]
			[[Category: MySQL]]
			[[Category: Revised with LLMs]]