Web scrape troubleshooting: Difference between revisions
Jump to navigation
Jump to search
m
→Before start to writing the scirpt of web scraping (crawler)
Tags: Mobile edit Mobile web edit |
|||
| Line 57: | Line 57: | ||
* Is the website offer [https://en.wikipedia.org/wiki/Application_programming_interface API] (Application programming interface)? | * Is the website offer [https://en.wikipedia.org/wiki/Application_programming_interface API] (Application programming interface)? | ||
=== Search keyword strategy === | |||
'''How to find the unofficial (3rd-party) web crawler?''' Search keyword strategy suggested as follows: | '''How to find the unofficial (3rd-party) web crawler?''' Search keyword strategy suggested as follows: | ||
* ''target website'' + crawler site:github.com | * ''target website'' + crawler site:github.com | ||
* ''target website'' + bot site:github.com | * ''target website'' + bot site:github.com | ||
* ''target website'' + download / downloader site:github.com | * ''target website'' + download / downloader site:github.com | ||
* ''target website'' + browser client site:github.com | |||
== Further reading == | == Further reading == | ||