ahcore prediction doesn't end properly

[AjeyPaiK]

Describe the bug
I submitted a job to the compute cluster last week to run some segmentation inference. While the inference successfully completed, the job was never terminated. It was terminated after the walltime I requested ran out (check below). So, the process was idle for more than 3 days!

To Reproduce
run segmentation inference using the top branch of ahcore.

Expected behavior
The main process during segmentation inference should terminate once everything is finalised.

Environment
dlup version: 0.4.0
How installed: pip
Python version: 3.11.0
Operating System: Linux

Additional context
N/A