Web scrape troubleshooting

From LemonWiki共筆
Jump to: navigation, search

list of technical issues

  1. website revision: expected web content (of DOM element) was empty
    • Multiple sources of same column such as different HTML DOM but have the same column value.
    • Backup the HTML text of parent DOM element
    • (optional) complete HTML file backup
  2. server ip ban
  3. CATCHA
  4. AJAX

Further reading