Web scrape troubleshooting: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
list of technical issues | list of technical issues | ||
# website revision | # website revision | ||
#* Multiple sources of same column | #* Multiple sources of same column such as different HTML DOM but have the same column value. | ||
#* Backup the HTML text of parent DOM | #* Backup the HTML text of parent DOM element | ||
#* (optional) complete HTML file backup | #* (optional) complete HTML file backup | ||
# server ip ban | |||
#* setting the temporization (sleep time) between pages ex: [http://php.net/manual/en/function.sleep.php PHP: sleep - Manual] | |||
# CATCHA | # CATCHA | ||
# AJAX | # AJAX | ||
Revision as of 22:28, 19 October 2015
list of technical issues
- website revision
- Multiple sources of same column such as different HTML DOM but have the same column value.
- Backup the HTML text of parent DOM element
- (optional) complete HTML file backup
- server ip ban
- setting the temporization (sleep time) between pages ex: PHP: sleep - Manual
- CATCHA
- AJAX