Optimizing Large-Scale Data Ingestion into...

Eons ago I had a requirement to ingest large sets of data into our relational database (MySQL). This is how I approached the problem and optimized the solution, thought about sharing it in case someone needs something similiar. **There are plenty of tools which do a much better job at loading data. Case Study - Optimizing Large-Scale MySQL Data Ingestion Ingest (Text/CSV)encrypted data file 18 MB to 100 MB large (around 80K to 1200K lines of data set) from a SFTP Server. The data format was pred