How to extract content from websites: Difference between revisions

Jump to navigation Jump to search
m
no edit summary
mNo edit summary
Line 2: Line 2:


== Methods for article extraction ==
== Methods for article extraction ==
=== Open source solution for article extraction ===
{{Gd}} [https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]<ref>[https://videoinu.com/blog/firefox-reader-view-heuristics/ How does Firefox's Reader View work?]</ref>
{{Gd}} [https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]<ref>[https://videoinu.com/blog/firefox-reader-view-heuristics/ How does Firefox's Reader View work?]</ref>
* Demo:
* Demo:
Line 32: Line 33:
* License:
* License:
* Container
* Container
[https://totheweb.com/learning_center/tools-convert-html-text-to-plain-text-for-content-review/ Free Tool: Convert Your Webpage to Plain Text » ToTheWeb]
* Demo:
* Requirement:
* License: GPL + Apache License Version 2.0 {{Gd}}
* Container
[https://github.com/crscheid/php-article-extractor crscheid/php-article-extractor: A PHP library to extract article text from web pages]
* Pricing / Free Limit: free
* Source code of client: Available on GitHub
* License:
=== Commercial solution for article extraction ===


''$'' [https://www.diffbot.com/products/extract/ Diffbot | Extract Content From Websites Automatically] two weeks free trial
''$'' [https://www.diffbot.com/products/extract/ Diffbot | Extract Content From Websites Automatically] two weeks free trial
Line 45: Line 59:
* License:  
* License:  
* Source code of client: [https://www.diffbot.com/dev/docs/libraries/ Diffbot Libraries - Diffbot]
* Source code of client: [https://www.diffbot.com/dev/docs/libraries/ Diffbot Libraries - Diffbot]
[https://totheweb.com/learning_center/tools-convert-html-text-to-plain-text-for-content-review/ Free Tool: Convert Your Webpage to Plain Text » ToTheWeb]
* Demo:
* Requirement:
* License: GPL + Apache License Version 2.0 {{Gd}}
* Container
[https://github.com/crscheid/php-article-extractor crscheid/php-article-extractor: A PHP library to extract article text from web pages]
* Pricing / Free Limit: free
* Source code of client: Available on GitHub
* License:


[https://getpocket.com/developer/docs/v3/article-view Pocket Developer Program: Pocket API: Article View] not available {{exclaim}}
[https://getpocket.com/developer/docs/v3/article-view Pocket Developer Program: Pocket API: Article View] not available {{exclaim}}
Line 61: Line 64:
* Source code of client: n/a
* Source code of client: n/a
* License:
* License:


== References ==
== References ==
Anonymous user

Navigation menu