Bummer! This is just a preview. You need to be signed in with an account to view the entire instruction.

Scraping Data From the Web

Well done!

You have completed Scraping Data From the Web!

Sign up for Treehouse Back to Library
Instruction

Common Issues with Data Scraping

Challenges in Data Scraping

We've discussed a few of the challenges already. Topics such as bot access and legal crawling can pose hurdles to scraping data.

Other things to watch out for that can pose hurdles or outright walls to your data scraping include:

  • User Authentication & Captchas
  • Honeypots
  • Structural site changes
  • IP blocking
  • Latency
  • We've seen that JavaScript p...