How to extract content from websites: Difference between revisions

Jump to navigation Jump to search
m
Line 2: Line 2:


== Methods for article extraction ==
== Methods for article extraction ==
[https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]<ref>[https://videoinu.com/blog/firefox-reader-view-heuristics/ How does Firefox's Reader View work?]</ref>
{{Gd}} [https://github.com/mozilla/readability mozilla/readability: A standalone version of the readability lib]<ref>[https://videoinu.com/blog/firefox-reader-view-heuristics/ How does Firefox's Reader View work?]</ref>
* Demo:
* Demo:
* Pricing / Free Limit: free
* Pricing / Free Limit: free
Line 8: Line 8:
* License: Apache License, Version 2.0 {{Gd}}
* License: Apache License, Version 2.0 {{Gd}}
* Source code of client: Available on GitHub & Container: [https://hub.docker.com/r/phpdockerio/readability-js-server phpdockerio/readability-js-server - Docker Image | Docker Hub]
* Source code of client: Available on GitHub & Container: [https://hub.docker.com/r/phpdockerio/readability-js-server phpdockerio/readability-js-server - Docker Image | Docker Hub]
{{Gd}} [https://github.com/postlight/parser postlight/parser: 📜 Extract meaningful content from the chaos of a web page] (Replacement of [https://github.com/postlight/mercury-parser postlight/mercury-parser])
* Demo:
* Requirement: Node.js
* License: Apache License, Version 2.0 or MIT license {{Gd}}
* Container


[https://github.com/timothytylee/full-text-rss timothytylee/full-text-rss: Fork of Full-Text RSS to improve handling of non UTF-8 sites]
[https://github.com/timothytylee/full-text-rss timothytylee/full-text-rss: Fork of Full-Text RSS to improve handling of non UTF-8 sites]
Line 13: Line 19:
* Requirement: PHP
* Requirement: PHP
* License: GNU Affero General Public License v3.0 {{Gd}}
* License: GNU Affero General Public License v3.0 {{Gd}}
* Container
[https://github.com/postlight/mercury-parser postlight/mercury-parser: 📜 Extract meaningful content from the chaos of a web page]
* Demo:
* Requirement: Node.js
* License: Apache License, Version 2.0 or MIT license {{Gd}}
* Container
* Container


Anonymous user

Navigation menu