
I need someone to write for me a crawler in Scrapy
- or -
Post a project like this2587
$$
- Posted:
- Proposals: 10
- Remote
- #2219888
- Awarded
Virtual Assistant, Web Scraping, Data Mining, Python Bot creation, Data Entry, Photoshop
Full Stack Dot Net Developer | LinkedIn Lead Expert| Senior Web Developer |Python | API Expert |WordPress Developer | Angular | SQL | MS AZURE

AI & Data Science Engineer | Nodejs | Ruby On Rails | AWS | GCP | Python | React | Angular |

1973411211494713554371235423244836112859192415916238303710886812311461
Description
Experience Level: Intermediate
Hello,
I need an experienced coder working in scrapy to write some spiders for some websites. I have a working crawler however I want something more scalable. The sites are real estate sites, the output fields will be predefined and the project will be split into two phases.
Phase 1:
The phase 1 of the project is a generic spider to handle scrap sites using CSS selectors which will get the inputs from a csv file and a spiders for two sites (immobilienscout24.de, https://www.spiti24.gr/en) that will inherit from the Master and each of the site will have a separate csv file for the inputs. A part in the code (e.g. a function) that will be reserved for specific needs of each website and if needed front end rendering this will be included in the specific spider. The deliverables will be two working spiders with two input csv files, which both of then will inherit from the Master spider. Well written code with comments is a requirement. The quote for this part should be for the whole phase.
Phase 2:
Using the master spider, you will provide working spiders and related csv input files for an additional 8-10 sites. Expected quote for this phase should be per spider.
Thanks,
Spyros
I need an experienced coder working in scrapy to write some spiders for some websites. I have a working crawler however I want something more scalable. The sites are real estate sites, the output fields will be predefined and the project will be split into two phases.
Phase 1:
The phase 1 of the project is a generic spider to handle scrap sites using CSS selectors which will get the inputs from a csv file and a spiders for two sites (immobilienscout24.de, https://www.spiti24.gr/en) that will inherit from the Master and each of the site will have a separate csv file for the inputs. A part in the code (e.g. a function) that will be reserved for specific needs of each website and if needed front end rendering this will be included in the specific spider. The deliverables will be two working spiders with two input csv files, which both of then will inherit from the Master spider. Well written code with comments is a requirement. The quote for this part should be for the whole phase.
Phase 2:
Using the master spider, you will provide working spiders and related csv input files for an additional 8-10 sites. Expected quote for this phase should be per spider.
Thanks,
Spyros
Spyridon S.
100% (20)Projects Completed
17
Freelancers worked with
17
Projects awarded
50%
Last project
21 Jan 2020
Luxembourg
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies