Web scrape troubleshooting: Difference between revisions
Jump to navigation
Jump to search
→Before start to web scrpae
mNo edit summary |
|||
| Line 48: | Line 48: | ||
== Before start to web scrpae == | == Before start to web scrpae == | ||
* Are they offer datasets? | * Are they offer datasets? e.g. open data | ||
* Are they offer [https://en.wikipedia.org/wiki/Application_programming_interface API] (Application programming interface)? | * Are they offer [https://en.wikipedia.org/wiki/Application_programming_interface API] (Application programming interface)? | ||
How to find the unofficial (3rd-party) web crawler? Search keyword strategy suggested as follows: | |||
* ''target website'' + crawler | |||
* ''target website'' + bot | |||
* ''target website'' + download | |||
== Further reading == | == Further reading == | ||