Reading-Notes
Code Fellows Python 401
Read: 17 - Web Scraping
Web Scrape with Python in 4 minutes
- web scraping - automatically access and extract large amounts of information from a website
Keep in mind:
- comercial use of data is usually prohibited
- downloading data too fast will break the site and cause you to be blocked
What is Web Scraping?
Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites.
How to scrape websites without getting blocked
- Web Crawlers can retrieve data much quicker, in greater depth than humans
- under-powered server would have a hard time keeping up with requests from multiple crawlers