Remove duplicate data from an xml feed
- or -
Post a project like this4049
£100(approx. $127)
- Posted:
- Proposals: 3
- Remote
- #206385
- Completed
Description
Experience Level: Intermediate
My web app is written in php using the yii framework and is connected to a mysql database.
There are two xml feeds sent to the web app (about 1gb each) that are processed using a sax parser (simpleXML is not capable of processing these feeds).
The current system processes the feeds in a way that;
-existing DB rows are updated (if same ID is in the new feed)
-new entries are created in the DB new IDs exist in the feed and not the DB
-DB rows that exist in the DB but do not appear in the updated feed are removed
As I mentioned, there are two xml feeds with about 30% of duplicated data. Currently, the duplicates are not detected and written to the DB.
I'm looking for somebody that can tweak the existing code to detect the duplicates and basically not write them to the DB.
There are two xml feeds sent to the web app (about 1gb each) that are processed using a sax parser (simpleXML is not capable of processing these feeds).
The current system processes the feeds in a way that;
-existing DB rows are updated (if same ID is in the new feed)
-new entries are created in the DB new IDs exist in the feed and not the DB
-DB rows that exist in the DB but do not appear in the updated feed are removed
As I mentioned, there are two xml feeds with about 30% of duplicated data. Currently, the duplicates are not detected and written to the DB.
I'm looking for somebody that can tweak the existing code to detect the duplicates and basically not write them to the DB.
Henri C.
100% (1)Projects Completed
2
Freelancers worked with
2
Projects awarded
50%
Last project
8 Mar 2017
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies