Web scrape troubleshooting: Difference between revisions
Jump to navigation
Jump to search
→Before start to writing the scirpt of web scraping (crawler)
| Line 53: | Line 53: | ||
== Before start to writing the scirpt of web scraping (crawler) == | == Before start to writing the scirpt of web scraping (crawler) == | ||
* | * Is the website offer datasets or files? e.g. open data | ||
* | * Is the website offer [https://en.wikipedia.org/wiki/Application_programming_interface API] (Application programming interface)? | ||
'''How to find the unofficial (3rd-party) web crawler?''' Search keyword strategy suggested as follows: | '''How to find the unofficial (3rd-party) web crawler?''' Search keyword strategy suggested as follows: | ||