Phoenix - Your AI AssistantLinux service to automate web scrapes
- Posted:
- Proposals: 4
- Remote
- #48092
- Archived
have already sent a proposal. Description
Experience Level: Expert
Development of a Linux based application that will automate the browsing of a given URL and store the resultant HTML.
A web service (already written) will provide a URL to be scraped by the application/service running on a Linux machine. The Linux machine will need to use a recognised web browser rendering engine (such as Gecko or WebKit) to browse the URL to ensure it downloads all parts of the page correctly.
The web service will provide a simple list of parts of the HTML document to be replaced by shortened tags. (ie <body> might be replaced with #1#).
Finally the html document needs to be zipped, before sending it back to the web service to be stored.
The web scrapper should run unattended on a linux machine and be able to run 24/7.
A web service (already written) will provide a URL to be scraped by the application/service running on a Linux machine. The Linux machine will need to use a recognised web browser rendering engine (such as Gecko or WebKit) to browse the URL to ensure it downloads all parts of the page correctly.
The web service will provide a simple list of parts of the HTML document to be replaced by shortened tags. (ie <body> might be replaced with #1#).
Finally the html document needs to be zipped, before sending it back to the web service to be stored.
The web scrapper should run unattended on a linux machine and be able to run 24/7.
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.