Script to import XML data into MySQL database
- or -
Post a project like this2287
$$
- Posted:
- Proposals: 15
- Remote
- #1838928
- Awarded
18 years expert in PHP, MySQL, HTML, CSS, JavaScript, jQuery, Ajax, Bootstrap, Chrome Extension, VB, VBA, AutIT Programming & Website Data Scraping
Ambala
Expert PHP | Joomla | WordPress | Opencart | E-commerce | jQuery | HTML Developer
Ahmedabad
151796944040194316232476473174934953141709715373551632760183931918684361873352
Description
Experience Level: Intermediate
General information for the website: private project
Description of every page/module: Two tasks are needed
1. There are approximately 16-17 zipped xml files that need a one time import into mysql database, the largest file being approximately 30mb. A database table and appropriate columns need to be created for the import.
2. There is an xml file that contains "modified data", scripts are needed to check for changes and then import the data into mysql to perform an update if there are changes.
Description of requirements/features: I dont mind how in terms of scripting language. Website is based on Apache/PHP/MySQL, which ever languages are best performance.
The second task is intended to become a CRON job.
I do not require any changes to the existing website, no UI work etc, I only need the database table setup and XML data to mysql import functionality at this time.
Extra notes: Attached is
1. XML schema file.
2. Sample XML data file
3. Sample 'Modified' Data XML file (used for updates)
file to check for changes https://static.nvd.nist.gov/feeds/xml/cve/2.0/nvdcve-2.0-modified.meta
UPDATE: Based on feedback, it looks like we wont need the 'modified data' xml to perform updates. Each of the 16 data files (xml) has its own meta file which shows if it has changed. based on this, I think it would be easier to simply create a table for each file then check for changes via the corresponding meta file and if it has updated, 'drop' existing table and import the new xml data file.
Description of every page/module: Two tasks are needed
1. There are approximately 16-17 zipped xml files that need a one time import into mysql database, the largest file being approximately 30mb. A database table and appropriate columns need to be created for the import.
2. There is an xml file that contains "modified data", scripts are needed to check for changes and then import the data into mysql to perform an update if there are changes.
Description of requirements/features: I dont mind how in terms of scripting language. Website is based on Apache/PHP/MySQL, which ever languages are best performance.
The second task is intended to become a CRON job.
I do not require any changes to the existing website, no UI work etc, I only need the database table setup and XML data to mysql import functionality at this time.
Extra notes: Attached is
1. XML schema file.
2. Sample XML data file
3. Sample 'Modified' Data XML file (used for updates)
file to check for changes https://static.nvd.nist.gov/feeds/xml/cve/2.0/nvdcve-2.0-modified.meta
UPDATE: Based on feedback, it looks like we wont need the 'modified data' xml to perform updates. Each of the 16 data files (xml) has its own meta file which shows if it has changed. based on this, I think it would be easier to simply create a table for each file then check for changes via the corresponding meta file and if it has updated, 'drop' existing table and import the new xml data file.
Timur M.
100% (45)Projects Completed
49
Freelancers worked with
44
Projects awarded
40%
Last project
24 Jan 2024
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
Shall the DB columns contain the data as text? It looks like some entries (e.g. vulnerable-software-list, base_metrics) are enumerations so it makes more sense to have multiple tables.
Timur M.30 Dec 2017the primary use of the data will be to query vendors (text), but its possible at a later date we may want to query vendor and metrics for more detailed results. other than updating data, we wont be writing to the database, only reading.
562796
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies