Don't have a thread doing line by line file reads, just to have it in memory. There is a piece of software optimized for tasks like this, the OS.
Just mmap your file and start processing.