Data acquisition

Learn how an antidetect browser helps with using several accounts for various digital initiatives.

Find out what is a headless browser, what software engineers use it for, and what browsers are most popular in a headless environment. What limitations do headless browsers have? We cover it here, too.

Read this article and discover the best platforms to learn web scraping online.

Follow this tutorial and learn how to build a Wayfair price tracking system with Python and web scraping.

To detect bot traffic, websites have created various bot detection techniques. Learn how websites detect and block bot traffic, and how it can affect businesses.

See a detailed yet straightforward tutorial on bypassing CAPTCHA with Selenium & Python and learn how to use Oxylabs’ Web Unblocker for increased scalability.

If CAPTCHAs keep on interrupting your day-to-day scraping tasks, read this article presenting solutions that can help you go around them successfully.

Find out which is the best for you by reading this in-depth overview of top website testing tools and how they differ in usability and pricing.

Follow this in-depth tutorial for scraping dynamic websites with proxies and Scrapy Playwright.

This free white paper provides a general overview of competitive intelligence processes, application scenarios, and their impact on business development.

Learn more about website change monitoring and discover the top 14 free and paid website change monitoring tools in 2024.

Learn how to easily scrape YouTube videos and collect public video data, such as titles, descriptions, total subscribers, comments, and search results.

Learn how to retrieve publicly available data from Wikipedia pages with Python and Web Scraper API.

Learn about PerimeterX, how it works, and why bot traffic is still able to evade its defenses.

Dynamic web pages like Google SERPs with continuous scroll require advanced web scraping solutions such as Oxylabs SERP Scraper API.

Check out this straightforward, step-by-step guide on how to scrape Google News.

Discover how your real estate business can benefit from web scraping and learn how to build your own property data monitoring architecture.

Delve deeper into the differences between Scrapy vs. Beautiful Soup and discover which one you need for your scraping project.

Find the ideal web scraping tool for your project by exploring the unique features and differences of Scrapy and Selenium.

Learn what sitemaps are and discover effective solutions for creating them.

Queue-it systems are popular among numerous websites that deal with high traffic. Interestingly, some people try and bypass Queue-it, and we'll discuss why in this article.

Web scraping can get difficult but it doesn’t have to be with these no-code and low code web scrapers. Check out these no-code tools that could streamline your operations.

Web scraping presents plenty of challenges. Thankfully, solutions are abundant with various data extraction libraries, proxies, custom approaches, and all-inclusive third-party services.

In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.

See this extensive guide on how to scrape Google Maps with an Oxylabs solution.

Read this article to learn sending simple cURL GET requests or with parameters effortlessly. Find out how to retrieve JSON data and the main request arguments.

An action chain of processes and solutions for public web data collection in the travel industry.

This guide covers various aspects of sending and receiving HTTP headers using cURL. The content discloses tips for use cases and discusses troubleshooting cURL header issues.

Follow this detailed tutorial and learn how to combine cURL with Python for effective data transfer processes.

Learn what Data as a Service (DaaS) is, how it works, what role it plays in business development, and what to consider when choosing your own DaaS provider.

An extensive Scrapy Splash tutorial on scraping public web data from JavaScript-rendered websites.

Discover the essentials of Web Unblocker and learn how to get started with it.

This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.

Web Crawler allows you to explore and collect data quickly and efficiently using our maintenance-free infrastructure.

Learn all about static vs. rotating proxies, sticky IP addresses, and proxy implications in product information scraping at large scale in this blog post.

This white paper provides a comprehensive overview of how AI and its subfield, machine learning, shape the current trends in web scraping.

Find out about the critical features of HTTPX, Requests, and AIOHTTP and how they differ from each other.

Dive deeper into the features, benefits, and drawbacks of Puppeteer and Selenium to make an informed decision on which tool fits you best.

Follow this tutorial to scrape and parse the HTML of a desired website. Learn about the PyQuery library, how to use it in Python, and how it differs from Beautiful Soup.

Find out how Playwright and Puppeteer stack up against each other in particular scenarios, including web scraping.

Let's discuss Playwright vs Selenium, their relevance to web scraping, and what to remember when picking one for your scraping task.

Go is becoming increasingly popular due to its many strengths, but how does it compare to Python, the most common and widely used language in programming?

Find out the numerous features of proxies and how they improve security.

Scraping Experts share invaluable advice on collecting fresh, robust, and verifiable real estate data.

Check this step-by-step tutorial to learn how to scrape data from websites into Excel. Find out Excel's capabilities of extracting information from various websites.

In this guide, you will learn how to scrape websites using Google Sheets, and you will find out about the functions in use and how to fix common errors.

ETL stands for extract, transform, and load. It’s an independent three-stage process that moves data from one source(s) to a database and is crucial for modern day anlysis.

Find out what screen scraping is and how it works. Learn the difference between web scraping and screen scraping.

Planning a project on web scraping and don’t know where to start? Learn how proxies come into play when project planning for web scraping in our most recent article.

As part of the combined efforts of Oxylabs and OTA Insight to shed light on the developments in the web scraping industry, we sat down with Glen De Cauwsemaeker, the Lead Crawler Engineer at OTA Insight, to talk about the challenges when scaling data acquisition solutions.