BJ Data Tech Solution

Specialized on Data processing, Data management Implementation plan, Data Collection tools - electronic and paper base, Data cleaning specifications, Data extraction, Data transformation, Data load, Analytical Datasets, and Data analysis. BJ Data Tech Solutions teaches on design and developing Electronic Data Collection Tools using CSPro, and STATA commands for data manipulation. Setting up Data Management systems using modern data technologies such as Relational Databases, C#, PHP and Android.

Saturday, May 22, 2021

How to load HUGE file that exceeds physical memory - Max_Memory not working.

I am using Stata 16.1 on Windows server 2012 with 256GB of memory. Trying to import 400GB MySQL database table with 280 million record. Set max_memory to 80GB so other can use server and during load Stata was at 130GB when server reached 98% so I killed file import.

How do I load a HUGE file that exceeds physical memory while also limiting impact on server so other can use it?

BJ Data Tech Solution

Saturday, May 22, 2021

How to load HUGE file that exceeds physical memory - Max_Memory not working.

No comments:

Post a Comment