Octoparse review
Octoparse is a new modern visual web data extraction software. It provides users a point-&-click UI to develop extraction patterns, so that scrapers can apply these patterns to structured...
View ArticleDexi Pipes: multi-threaded web scraping of site aggregators
Today I want to share my experience with Dexi Pipes. Pipes is a new kind of robot introduced by Dexi.io to integrate web data extraction and web data processing into a single seamless workflow. The...
View ArticleOctoparse – March 2017 Release
Octoparse is a new, modern, visual web data extraction software. It has always committed itself to providing users with a more professional data scraping service and to becoming one of the most...
View ArticleDexi.io – how to improve performance
Intro Some may argue that extracting 3 records per minute is not fast enough for an automated scraper (see my last post on Dexi multi-threaded jobs). However, you should realize that Dexi extractor...
View ArticleHotel: scrape prices, Q&A
Question I want to extract the hotel name and the current room price of some hotels daily from...
View ArticleOctoparse 7.0 – a free web scraping tool for non-developers
Octoparse has recently launched a brand new version 7.0, which has turned out to be the most revolutionary upgrade in the past two years, with not only a more user-friendly UI, but also some of the...
View ArticleDexi.io addon functionality (images & geocoding)
The Dexi.io web scraping service has remade its functionality by adding [paid plan] addons. Through addons, more features are made available to customers, e.g. more step types/pipe actions. Those...
View ArticleScraping HTML graphic elements: possibilities and limits
Question: “How do I set up a daily automatic scraping of www.pollen.com data into a Google sheet?” (link) Answer: Originally I doubted if svg HTML elements are scrapable. After some trial and error...
View ArticleA revolutionary web scraping software to boost your business
If you were an Amazon seller, would you want to know the listing price of a product of all competitors? Since you don’t have direct access to the Amazon database, you are out of luck and have to...
View ArticleThe present trends in web scraping tools
Recently I got a question from one of the blog readers. After I replied to it, I decided to share it with a wider audience. Question: Hi, I found your scraping.pro site and found it very helpful, then...
View Article