Инструменты для захвата и конвертирования Интернета

Делаем веб-скребок GrabzIt более доступным

04 декабря 2017
Web Scraping before the improvements

Наш веб-скребок is a very powerful tool however, it can be difficult for non-technical users to use. As you can see in this how-to video from 2016.

Чтобы решить эту проблему, мы теперь скрываем необработанные инструкции по очистке, если это явно не запрошено, а на вкладке «Инструкции по очистке» теперь по умолчанию отображаются инструкции по очистке на простом английском языке. Фактически, инструкции по очистке теперь можно полностью добавлять и удалять без написания кода.

We have also simplified and made our web scraper wizard more intuitive by merging four independent wizards into one. The new wizard now can perform multiple actions, with each action only showing when applicable for a web page. It is also designed to give the user more intuitive options based on the web page that is being scraped.

But what do you do if you are writing a scrape for several different types of web page? To solve this we created a new система шаблонов that allows you to define what scrape instructions should be executed for what web pages and actions and all of this new functionality is available without writing manual scrape instructions.

Web Scraping after the improvements

Another common complaint was that it was difficult to tell if a scrape was working as expected or not, to solve this scrape results and logs are now also available in real time. So you know if a scrape is working before it ends giving you the option to abort the scrape early, if required.

All of these changes have resulted in a much more user friendly experience as shown in the latest scraping tutorial on the left.

However we haven’t finished improving the usability of our web scraper with these changes, so if anyone has any ideas on how it can be improved further please Контакты!

Просмотр последних сообщений в блоге