Web scraping with Python : collecting more data from the modern web Cover Image

Book

Web scraping with Python : collecting more data from the modern web / Ryan Mitchell.

Summary:

If programming is magic then web scraping is surely a form of wizardry. By writing a simple automated program, you can query web servers, request data, and parse it to extract the information you need. The expanded edition of this practical book not only introduces you web scraping, but also serves as a comprehensive guide to scraping almost every type of data from the modern web. Part I focuses on web scraping mechanics: using Python to request information from a web server, performing basic handling of the server's response, and interacting with sites in an automated fashion. Part II explores a variety of more specific tools and applications to fit any web scraping scenario you're likely to encounter.

Record details

ISBN: 9781491985571
ISBN: 1491985577
Physical Description: xv, 288 pages : illustrations, 24 cm
Edition: Second edition.
Publisher: Sebastopol, CA : O'Reilly Media, 2018.
Copyright: ©2018

Content descriptions

General Note:

Includes index.

Formatted Contents Note:

Part I. Building scrapers: Your first web scraper -- Advanced HTML parsing -- Writing web crawlers -- Web crawling models -- Scrapy -- Storing data. Part II. Advanced scraping: Reading documents -- Cleaning your dirty data -- Reading and writing natural languages -- Crawling through forms and logins -- Scraping JavaScript -- Crawling through APIs -- Image processing and text recognition -- Avoiding scraping traps -- Testing your website with scrapers -- Web crawling in parallel -- Scraping remotely -- The legalities and ethics of web scraping -- Index.