How to extract content from websites: Difference between revisions

Jump to navigation Jump to search
Line 2: Line 2:


== Methods for article extraction ==
== Methods for article extraction ==
[https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]
[https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]<ref>[https://videoinu.com/blog/firefox-reader-view-heuristics/ How does Firefox's Reader View work?]</ref>
* Demo:
* Demo:
* Pricing / Free Limit: free
* Requirement: Node.js  
* Requirement: Node.js  
* License: Apache License, Version 2.0 {{Gd}}
* License: Apache License, Version 2.0 {{Gd}}
* Container: [https://hub.docker.com/r/phpdockerio/readability-js-server phpdockerio/readability-js-server - Docker Image | Docker Hub]
* Source code of client: Available on GitHub & Container: [https://hub.docker.com/r/phpdockerio/readability-js-server phpdockerio/readability-js-server - Docker Image | Docker Hub]


[https://github.com/timothytylee/full-text-rss timothytylee/full-text-rss: Fork of Full-Text RSS to improve handling of non UTF-8 sites]
[https://github.com/timothytylee/full-text-rss timothytylee/full-text-rss: Fork of Full-Text RSS to improve handling of non UTF-8 sites]
Line 34: Line 35:
''$'' [https://www.diffbot.com/products/extract/ Diffbot | Extract Content From Websites Automatically] two weeks free trial
''$'' [https://www.diffbot.com/products/extract/ Diffbot | Extract Content From Websites Automatically] two weeks free trial
* Demo:  
* Demo:  
* Pricing / Free Limit: 14 days free trial
* Requirement:  
* Requirement:  
* License:
* License:
Line 42: Line 44:
* Requirement: PHP
* Requirement: PHP
* License:  
* License:  
* Container
* Source code of client: [https://www.diffbot.com/dev/docs/libraries/ Diffbot Libraries - Diffbot]


[https://totheweb.com/learning_center/tools-convert-html-text-to-plain-text-for-content-review/ Free Tool: Convert Your Webpage to Plain Text » ToTheWeb]
[https://totheweb.com/learning_center/tools-convert-html-text-to-plain-text-for-content-review/ Free Tool: Convert Your Webpage to Plain Text » ToTheWeb]
Line 49: Line 51:
* License: GPL + Apache License Version 2.0 {{Gd}}
* License: GPL + Apache License Version 2.0 {{Gd}}
* Container
* Container
[https://github.com/crscheid/php-article-extractor crscheid/php-article-extractor: A PHP library to extract article text from web pages]
* Pricing / Free Limit: free
* Source code of client: Available on GitHub
* License:
[https://getpocket.com/developer/docs/v3/article-view Pocket Developer Program: Pocket API: Article View] not available {{exclaim}}
* Pricing / Free Limit:
* Source code of client: n/a
* License:
== References ==
<references />
[[Category:Tool]]


== Related pages ==
== Related pages ==
Anonymous user

Navigation menu