Implement chunking #2
Description
Currently, the lookup table is created for the entire search file (which can be long in some cases). It takes roughly 30Gb of RAM to create the lookup array for the master search table, so if we would split it into four chunks, we could come under 8Gb of RAM requirement. We only need to run the search for each chunk and then concatenate the results.