
Advanced MySQL configuration to import huge SQL files
- or -
Post a project like this2112
$150
- Posted:
- Proposals: 8
- Remote
- #2753722
- Awarded
WordPress Expert✮Shopify Expert✮Graphic Designer✮AutoCAD 2D & 3D✮CV Writer & Designer✮Fullstack developer

Full stack developer. Data Mining | Web Scraping | LinkedIn Scraping | Chrome extension developer |
29244293636573350756338528791537355335175329300802841151
Description
Experience Level: Entry
Our nonprofit, WiderNet, provides off-line access to thousands of Web sites for people who lack Internet connectivity. (www.widernet.org ) Over 2,000 universities, schools, health care sites, and libraries in the developing world have adopted this solution, providing a bounty of educational information to millions of users.
We receive large SQL files (100GB+) that we need to import into our Windows-based MySQL server. It's a standalone server dedicated just to this process, with 24GB of RAM and a 2TB NVMe drive.
By addressing obvious hardware and software configuration issues, we've trimmed the import time from days to hours, but need someone with SIGNIFICANT MySQL server setup experience to advise us on our current configuration and suggest how we might improve the process.
We do not have control over how the files are dumped, so we need to everything in our power to speed things up.
More critically, once imported, we need to compress the tables to save space. They will be read-only in production.
Please, only bid if you have advanced experience with this rare environment. (Windows, MySQL, optimization...)
We receive large SQL files (100GB+) that we need to import into our Windows-based MySQL server. It's a standalone server dedicated just to this process, with 24GB of RAM and a 2TB NVMe drive.
By addressing obvious hardware and software configuration issues, we've trimmed the import time from days to hours, but need someone with SIGNIFICANT MySQL server setup experience to advise us on our current configuration and suggest how we might improve the process.
We do not have control over how the files are dumped, so we need to everything in our power to speed things up.
More critically, once imported, we need to compress the tables to save space. They will be read-only in production.
Please, only bid if you have advanced experience with this rare environment. (Windows, MySQL, optimization...)
Cliff M.
99% (35)Projects Completed
34
Freelancers worked with
28
Projects awarded
43%
Last project
25 Feb 2022
United States
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-

Hello there, what process do you use to import the data ?
900475
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies