Scrapping data from web, load to database and visualization via tableau or other BI.
- or -
Post a project like this- Posted:
- Proposals: 4
- Remote
- #2089420
- OPPORTUNITY
- Awarded
Description
- A scheduler should be in place to periodically scrap data at regular intervals, say every 2 hours.
- Upload data to MySQL (can use free hosting servers for now)
- Optimization algorithms for some data-points are required before uploading to other tables in MySQL. (Constraints to be specified after project is awarded)
- Extraction of data from MySQL to build a dashboard using Tableau or equivalent.
- Code should be in python 3 and above.
- Code should be written in modules to allow for future enhancement.
- A mapping file (excel) should be utilized to draw key information such as website address and for easy maintenance.
Raymond G.
100% (3)New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
Dear Raymond,
I applied but have not get response yet. -
Hi Raymond G.,
I saw that you sent me invitation. Is this job is still actual for you?
Thanks.Raymond G.31 Jul 2018Hi, this job is still open for proposal. If you are interested and have the necessary skills, please consider sending in your proposal. Thank you.
Ivan P.01 Aug 2018Hi Raymond G.,
I accepted your invitation. We can discuss everything related to the project. Don't afraid about the cost - we can evaluate this after our conversation and after analyzing the project details.
Please, answer me in privat message in proposal.
Thanks. -
Hello Raymond,
Only Python, do not you want to use PHP for this job?Raymond G.28 Jul 2018Hi, yes. in this case only python.
SoftLike29 Jul 2018Thanks