Just a comment since you asked for comments.
I don’t know exactly what you are doing because I haven’t done something similar, but if you need to load large prolog data files fast then use the Quick Load File.
Here are real stats from a few weeks ago on large files. Notice the time of the 2.30 GB load went from 11 minutes to 24 seconds.