App stalls on long line that causes OutOfMemoryException

[troyhunt]

I'm currently processing >1TB of stealer logs and unfortunately hit this after more than a day and a half of running:

Digging deeper, I'd had problems reading the same file it had stalled on with another console app that extracts domain and email pairs from stealer logs. In that app, it was throwing OutOfMemoryException on one particular line which is exceedingly long. I don't know how long, as nothing seems to want to read it! In that app, I ended up emitting a warning to the console, calling ReadLine() so I didn't miss it, then proceeding to the next file.

This is an exceedingly rare scenario so I don't mind losing the rest of the file, either that or if anyone can figure out how to just skip that line and move onto the next one, that'd be great.