Website Scraping / Spidering Service
Onefeed offers a scraping / spidering service for merchants who struggle to build a feed with all their product data populated. It is common for merchants to have several databases of their products data. Often it's difficult to extract all of this data to form their datafeeds. Often the process of building the datafeed and the costs involved are prohibitive. In these cases we offer a feed scraping service which grabs all the merchants product data in a format that we can use to build all their other products feeds. In most cases the feed created is better than the one that the merchant can exprt for their database. Site scrapes can be done multiple times per day to ensure the freshest content.
Site Scraping is not an easy process to setup and is always liable to failure when changes are made to the html of the site. Scraping works by looking for html markers such as <div> or <span> markers. If these change or get removed then the scrape will fail. We monitor the site scrapes dailly and make changes where necessary.
Site scrape setup prices vary depending on the number of products, the number of category pages, the difficulty in scraping the site and the frequency of feed updates required. Site scraping can start from as little as £150.
Site Scraping Key Points
- Site Scraping is an opportunity to create a feed where there was no other way of creating a product feed
- Scraping involves setting a spider to go onto your site and build a datafeed of your product data.
- Generally everything you can see on a product page can be scraped.
- Scraping is not an easy process to setup and will be affected by any site changes made to the html.
- Scraping will only work effectively when there are specific product landing pages. If you currently have big lists of products then scraping will usually not be possible.
