Website Scraping - Using python or preferably Scrapy

  • Posted:
  • Proposals: 17
  • Remote
  • #2029589
  • Awarded
Kumail R.
Ammar I.
Yaroslav D.Rashid A.Jatin L. + 12 others have already sent a proposal.
  • 10

Description

Experience Level: Expert
Estimated project duration: 1 day or less
Hi,

We need someone to help us scrape a few sites. We currently use scrapy, hosted on our own server and would like to add a few more sites to our inventory. We want the scrapy scripts and not just the data.

1. koshermeat.co.za - everything under the Shop navigation
2. clicks.co.za - all categories

Secondly, we have a script that is written for another site, it works perfectly, however, we keep getting blocked after a certain number of requests so we would like to add maybe Tor functionality so that it can change identity every so many calls it makes. Alternatively if we cant use Tor, we are open to going the proxy route.



New Proposal

Create an account now and send a proposal now to get this project.

Sign up

Clarification Board Ask a Question

    There are no clarification messages.