Skill

Web Scraping

Web Development

Web scraping is the automated extraction of data from websites, typically done using tools and libraries like Python's BeautifulSoup, Scrapy, or Selenium to parse HTML and pull structured information such as prices, listings, or contact details. It's used by researchers, marketers, and developers to gather data for analysis, price comparison, or lead generation, though it raises legal and ethical considerations around a site's terms of service. Many scraping projects also involve handling rate limits, CAPTCHAs, and dynamic JavaScript-rendered content.

Open roles requiring Web Scraping (1)

Data Reporter, Texas

The New York Times Company

Full-time · Texas · $113,271 – $150,000

The New York Times is hiring a data journalist to report from Texas, combining traditional reporting with data analysis to investigate significant stories. This role suits someone with strong programming skills, knowledge of Texas, and experience mining public datasets for newsworthy insights.

Listed on The New York Times Company’s careers site · Apply there ↗

• Selenium
• Scrapy
• Python
• Data Mining
• XPath
• Puppeteer
• Data Collection