Website Scraping App (Using off the shelf scraper)
- or -
Post a project like this908
£25/hr(approx. $31/hr)
- Posted:
- Proposals: 9
- Remote
- #3184495
- Awarded
PPH #1 Service Provider in Development & IT : Wordpress|Magento|React Native|Mobile App Development|Angular|Node.js



Web Development, Application Development, Mobile app development, Video Streaming Platform
7423831283422748827284115131525313422443416912644362525118471





Description
Experience Level: Expert
I need to scrape a website nightly and store the contents, including PDF files hosted on the site. One minor complication is a login area but most scrapers accept a username and password or a cookie with the correct authentication.
This can be achieved with httrack, scrapy, spatie crawler, or similar.
I am looking for someone to set this up with one of the above. I will provide hosting.
The ideal would be for the resulting files to be dropped into an S3 bucket.
At some point I would like to put a UI in front so that I can browse back to old versions of the site but this can be quoted out as a second phase.
This can be achieved with httrack, scrapy, spatie crawler, or similar.
I am looking for someone to set this up with one of the above. I will provide hosting.
The ideal would be for the resulting files to be dropped into an S3 bucket.
At some point I would like to put a UI in front so that I can browse back to old versions of the site but this can be quoted out as a second phase.

Sam B.
99% (90)Projects Completed
145
Freelancers worked with
124
Projects awarded
34%
Last project
31 Aug 2023
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies