Data scraping project
- or -
Post a project like this$6.0k
- Posted:
- Proposals: 12
- Remote
- #1803097
- PRE-FUNDED
- Expired
Web-scraping,Data-scraping,Scrapy, Python Experts,Magento, Wordpress Experts, Javascript, PHP, CSS, Experts!!!!!!!!!!!!!
Bay Minette
18 years expert in PHP, MySQL, HTML, CSS, JavaScript, jQuery, Ajax, Bootstrap, Chrome Extension, VB, VBA, AutIT Programming & Website Data Scraping
Ambala
Data Entry, Data Scraping & Mining, Virtual Assistant, Product Lister
Peyrat-le-Chateau
AI & Data Science Engineer | Nodejs | Ruby On Rails | AWS | GCP | Python | React | Angular |
Auckland
LinkedIn Lead Expert, Web Scraping, Data Entry, Data mining, Web Crawling, Data extraction and Email Lists
London
56679320674323247652412187996288416490701410886811285919129357419537761966635
Description
Experience Level: Expert
Description of analysis:
Hi,
This project is a 1-year project at an initial budget of 1000USD with a potential of 1-year contract worth up to 4000USD.
This project is a project consists of 2 phases.
The 1st Phase of the project (1000USD Worth) has requirement written below.
(1) Develop Scraper to pull data from 4 out of these 8 websites below.
(We’ll do the selection of 4 websites before you start working)
a. Zara (TH)
b. Zara (UK)
c. H&M (TH)
d. H&M (UK)
e. Boohoo
f. Style Nanda
g. Love Bonito
h. Editor's Market
We want the scraper developed in PHP and we’ll have different scripts for different website.
The Scraper will need to be able to feed/access the data in our MySQL DB on AWS server and also upload picture to our Amazon S3 server.
URL Here - https://drive.google.com/drive/folders/0B2DwsQmwoHMENjBrTURkaWtoN0E?usp=sharing
contains information regarding
• How Data should get scraped in different website (Refer to Google Doc)
• How Data should be calculated/attributed to get desired result Refer to (refer to “database explanation” Google Sheet)
• How the format of the data to feed into our database should look like (refer to “database” Google Sheet)
At the end of development, the scraper will need to be sent to us.
The timeline of the 1st phase is 2 weeks after I’ve accepted the proposal. However, we need at least 1 scraper to be done within 7 days.
For each scraper done, I’ll need to see the sample of the result in a csv format to approve the correctness of the result.
I am looking to hire a total of 2 developers. Both will be developing 4 scrapers each. Once the development is done. I’ll select one developer to move this project to Phase 2.
Before the beginning of phase 1, I'll set up a call between 2 developers to agree on the framework we should use to develop the script.
Also, before the beginning of phase 2, I'll set up a call between each developer so that the hand-over of the code can be done smoothly.
The 2nd Phase of the project (4000USD Worth) has requirement written as below.
(1) Run all the finished 8 scrapers and feed the result to our Database twice a day.
(2) Should any problem occur, i.e. Website changes and scraper result is not usable, we'll be in contact in PPH which you need to response within 3 working day and get the problem fixed within reasonable timeline.
The payment will be split into two part
(1) At the end of development and the scraper result is approved by us, we’ll pay you 1000 USD
(2) At the end of contract, 1 year after the agreement to start on the 2nd Phase, we’ll pay the rest in full.
Please let me know if you have any concern for our request or not. ( The cost, the PHP)
I am more than happy to have a call to go through all detail I provided with you.
Looking forward to working with you.
Regards,
Stock
Extra notes: URL Here - https://drive.google.com/drive/folders/0B2DwsQmwoHMENjBrTURkaWtoN0E?usp=sharing
contains information regarding
Hi,
This project is a 1-year project at an initial budget of 1000USD with a potential of 1-year contract worth up to 4000USD.
This project is a project consists of 2 phases.
The 1st Phase of the project (1000USD Worth) has requirement written below.
(1) Develop Scraper to pull data from 4 out of these 8 websites below.
(We’ll do the selection of 4 websites before you start working)
a. Zara (TH)
b. Zara (UK)
c. H&M (TH)
d. H&M (UK)
e. Boohoo
f. Style Nanda
g. Love Bonito
h. Editor's Market
We want the scraper developed in PHP and we’ll have different scripts for different website.
The Scraper will need to be able to feed/access the data in our MySQL DB on AWS server and also upload picture to our Amazon S3 server.
URL Here - https://drive.google.com/drive/folders/0B2DwsQmwoHMENjBrTURkaWtoN0E?usp=sharing
contains information regarding
• How Data should get scraped in different website (Refer to Google Doc)
• How Data should be calculated/attributed to get desired result Refer to (refer to “database explanation” Google Sheet)
• How the format of the data to feed into our database should look like (refer to “database” Google Sheet)
At the end of development, the scraper will need to be sent to us.
The timeline of the 1st phase is 2 weeks after I’ve accepted the proposal. However, we need at least 1 scraper to be done within 7 days.
For each scraper done, I’ll need to see the sample of the result in a csv format to approve the correctness of the result.
I am looking to hire a total of 2 developers. Both will be developing 4 scrapers each. Once the development is done. I’ll select one developer to move this project to Phase 2.
Before the beginning of phase 1, I'll set up a call between 2 developers to agree on the framework we should use to develop the script.
Also, before the beginning of phase 2, I'll set up a call between each developer so that the hand-over of the code can be done smoothly.
The 2nd Phase of the project (4000USD Worth) has requirement written as below.
(1) Run all the finished 8 scrapers and feed the result to our Database twice a day.
(2) Should any problem occur, i.e. Website changes and scraper result is not usable, we'll be in contact in PPH which you need to response within 3 working day and get the problem fixed within reasonable timeline.
The payment will be split into two part
(1) At the end of development and the scraper result is approved by us, we’ll pay you 1000 USD
(2) At the end of contract, 1 year after the agreement to start on the 2nd Phase, we’ll pay the rest in full.
Please let me know if you have any concern for our request or not. ( The cost, the PHP)
I am more than happy to have a call to go through all detail I provided with you.
Looking forward to working with you.
Regards,
Stock
Extra notes: URL Here - https://drive.google.com/drive/folders/0B2DwsQmwoHMENjBrTURkaWtoN0E?usp=sharing
contains information regarding
Bunasit S.
100% (1)Projects Completed
1
Freelancers worked with
1
Projects awarded
33%
Last project
4 Feb 2018
Thailand
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies