Node.js ETL Application
- or -
Post a project like this2807
£250(approx. $313)
- Posted:
- Proposals: 6
- Remote
- #1223045
- PRE-FUNDED
- Awarded
Mobile & Web Application - Full Stack Development & Designing / DevOps Specialist
Ahmedabad
43366661995284531898761410792051316518
Description
Experience Level: Intermediate
General information for the business:
Hotel Reservation Management Company - this project relates to our invoicing system
Kind of development: New program from scratch
Description of every module:
This project is effectively a proof of concept study to demonstrate the ability to load data for our new invoicing system.
Upon successful completion of this initial phase there is scope for additional development work on this project.
The system will run on two, separate Linux machines
these machine will be provided - Turnkey LAMP Servers https://www.turnkeylinux.org/lampstack
System 1 - Data Extraction
The purpose of this machine is to:
Receive data reports by e-mail.
Extract the data from an XML report.
Have the flexibility to carry pre-determined translations on the imported data.
Load the data into a MySQL database running on the second machine.
System 2 - Database
The purpose of this machine is to run the pre-staging and reporting database for our new invoicing system.
Description of requirements/functionality:
System 1
The reports will be delivered to this machine by e-mail.
The system must to be set up to receive these e-mails.
E-mail can either be periodically polled using POP3 or similar or "pushed" using procmail or similar.
The extraction script must perform type checking.
The system must handle international character sets.
The system must file copies of processed reports for reference.
The system should write a summary to syslog for each report processed.
The system should write a more detailed log file for each report processed.
System 2
This is a skeleton database at this stage. It will consist of two tables:
Table One will contain the raw data as imported from the report files.
There may be multiple records for a reservation (Confirmed, Modified, Cancelled)
Table Two will contain the live state of each reservation.
This will reflect the state according to the most recent report record.
This table will be updated periodically based on the data in Table One
Each system should be managed using GIT.
Specific technologies required: node.js, MySQL, GIT, POP3, mail, (angular2 for future work)
OS requirements: Linux
Hotel Reservation Management Company - this project relates to our invoicing system
Kind of development: New program from scratch
Description of every module:
This project is effectively a proof of concept study to demonstrate the ability to load data for our new invoicing system.
Upon successful completion of this initial phase there is scope for additional development work on this project.
The system will run on two, separate Linux machines
these machine will be provided - Turnkey LAMP Servers https://www.turnkeylinux.org/lampstack
System 1 - Data Extraction
The purpose of this machine is to:
Receive data reports by e-mail.
Extract the data from an XML report.
Have the flexibility to carry pre-determined translations on the imported data.
Load the data into a MySQL database running on the second machine.
System 2 - Database
The purpose of this machine is to run the pre-staging and reporting database for our new invoicing system.
Description of requirements/functionality:
System 1
The reports will be delivered to this machine by e-mail.
The system must to be set up to receive these e-mails.
E-mail can either be periodically polled using POP3 or similar or "pushed" using procmail or similar.
The extraction script must perform type checking.
The system must handle international character sets.
The system must file copies of processed reports for reference.
The system should write a summary to syslog for each report processed.
The system should write a more detailed log file for each report processed.
System 2
This is a skeleton database at this stage. It will consist of two tables:
Table One will contain the raw data as imported from the report files.
There may be multiple records for a reservation (Confirmed, Modified, Cancelled)
Table Two will contain the live state of each reservation.
This will reflect the state according to the most recent report record.
This table will be updated periodically based on the data in Table One
Each system should be managed using GIT.
Specific technologies required: node.js, MySQL, GIT, POP3, mail, (angular2 for future work)
OS requirements: Linux
Jim S.
100% (1)Projects Completed
1
Freelancers worked with
1
Projects awarded
50%
Last project
11 Aug 2016
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
Can I see the XML reports and the email reports that needs to be converted/parsed?
-
Hello Jim,
I am available for 20hrs/ week. Would that be fine for this job? -
Jim
Email >> XML>> MySQL
Data receive on email is in xml format?
Lost about the xml
Regards -
Hello Jim
Can you please share some details because from your details it's clear what exactly need to be done from my side.
Thanks.
68299679076782667737
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies