Large JSON file convert and import into mongodb
- or -
Post a project like this1685
£50(approx. $63)
- Posted:
- Proposals: 9
- Remote
- #2513580
- PRE-FUNDED
- Awarded
Python | React| WordPress | Shopify | Laravel | Mongo Atlas | MySQL | Angular | AWS (Lambda, S3 Bucket, EC2, SES, DynamoDB) | React | Node JS | Banner Design | SEO | Digital Marketing
Kolkata
237857717186261881624260137726695912750244275737927753713036514
Description
Experience Level: Entry
I have a requirement to import data in JSON file into a mongdb.
the challenge is that the files when unzipped exceed the 16mb limit set by mongodb. I do not want to split the files as there are approximately 20 source json files above this limit.
I need a script that can convert the json file into either a BSON or CSV (or other if developer recommends something else more suitable for the task) and use the mongo client to perform the import process e.g. mongoimport or mongorestore.
The script will be used regularly as part of a cron so should be suitable on linux host e,g, debian.
you can obtain a source json file here;
https://nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-2019.json.zip
file size is approx 4mb zipped - 120mb unzipped.
the challenge is that the files when unzipped exceed the 16mb limit set by mongodb. I do not want to split the files as there are approximately 20 source json files above this limit.
I need a script that can convert the json file into either a BSON or CSV (or other if developer recommends something else more suitable for the task) and use the mongo client to perform the import process e.g. mongoimport or mongorestore.
The script will be used regularly as part of a cron so should be suitable on linux host e,g, debian.
you can obtain a source json file here;
https://nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-2019.json.zip
file size is approx 4mb zipped - 120mb unzipped.
Timur M.
100% (45)Projects Completed
49
Freelancers worked with
44
Projects awarded
40%
Last project
24 Jan 2024
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
There are no clarification messages.
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies