14,970
edits
How to extract content from websites: Difference between revisions
Jump to navigation
Jump to search
m
no edit summary
mNo edit summary |
|||
| (3 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
== Methods for article extraction == | == Methods for article extraction == | ||
=== Open source solution for article extraction === | |||
{{Gd}} [https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]<ref>[https://videoinu.com/blog/firefox-reader-view-heuristics/ How does Firefox's Reader View work?]</ref> | {{Gd}} [https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]<ref>[https://videoinu.com/blog/firefox-reader-view-heuristics/ How does Firefox's Reader View work?]</ref> | ||
* Demo: | * Demo: | ||
| Line 32: | Line 33: | ||
* License: | * License: | ||
* Container | * Container | ||
[https://totheweb.com/learning_center/tools-convert-html-text-to-plain-text-for-content-review/ Free Tool: Convert Your Webpage to Plain Text » ToTheWeb] | |||
* Demo: | |||
* Requirement: | |||
* License: GPL + Apache License Version 2.0 {{Gd}} | |||
* Container | |||
[https://github.com/crscheid/php-article-extractor crscheid/php-article-extractor: A PHP library to extract article text from web pages] | |||
* Pricing / Free Limit: free | |||
* Source code of client: Available on GitHub | |||
* License: | |||
=== Commercial solution for article extraction === | |||
''$'' [https://www.diffbot.com/products/extract/ Diffbot | Extract Content From Websites Automatically] two weeks free trial | ''$'' [https://www.diffbot.com/products/extract/ Diffbot | Extract Content From Websites Automatically] two weeks free trial | ||
| Line 38: | Line 52: | ||
* Requirement: | * Requirement: | ||
* License: | * License: | ||
* | * Source code of client: [https://www.diffbot.com/dev/docs/libraries/ Diffbot Libraries - Diffbot] | ||
''$'' [https://www.fivefilters.org/full-text-rss/ Full-Text RSS - FiveFilters.org] | ''$'' [https://www.fivefilters.org/full-text-rss/ Full-Text RSS - FiveFilters.org] | ||
| Line 44: | Line 58: | ||
* Requirement: PHP | * Requirement: PHP | ||
* License: | * License: | ||
* Source code of client | * Source code of client: | ||
[https://getpocket.com/developer/docs/v3/article-view Pocket Developer Program: Pocket API: Article View] not available {{exclaim}} | [https://getpocket.com/developer/docs/v3/article-view Pocket Developer Program: Pocket API: Article View] not available {{exclaim}} | ||
| Line 61: | Line 64: | ||
* Source code of client: n/a | * Source code of client: n/a | ||
* License: | * License: | ||
''$'' [https://newsblur.com/ NewsBlur] > [https://newsblur.com/api The NewsBlur API] > GET /rss_feeds/original_story | |||
* Pricing: | |||
* License: | |||
* Source code of client: | |||
''$'' [https://feedbin.com/ Feedbin] > API > [https://github.com/feedbin/feedbin-api/blob/master/content/extract-full-content.md Extracting Full Content] | |||
* Pricing: | |||
* License: | |||
* Source code of client: | |||
== References == | == References == | ||
| Line 69: | Line 82: | ||
== Related pages == | == Related pages == | ||
* [[Named entity recognition tools]] | * [[Named entity recognition tools]] | ||
* ''$'' [https://www.producthunt.com/products/diffbot/alternatives Best Diffbot Alternatives - 2024 | Product Hunt] | |||
{{Template:Data factory flow}} | |||
[[Category:Tool]] | [[Category:Tool]] | ||