Multi-Process Parallelization with ProcessPoolExecutor#276

Open

BuffMcBigHuge wants to merge 55 commits intolivepeer:mainfrom

BuffMcBigHuge:marco/multiprocess-clean

Commits on Mar 18, 2025

Preliminary work for ComfyUI native API integration.
BuffMcBigHuge
committed

Commits on Mar 25, 2025

Commits on Apr 8, 2025

Rebuilt get_available_nodes using native ComfyUI api for retrofit to the ui, cleanup of tensor code.
BuffMcBigHuge
committed
Modified base64 processing to use torchvision instead of numpy intermediate step, moved prompt execution strategy to `execution_start` event, moved buffer to self variable to avoid reinitalization.
BuffMcBigHuge
committed

Commits on Apr 16, 2025

Commits on Apr 22, 2025

Commits on Apr 23, 2025

Better error handling for Comfy instances via spawn, reorganization of app, pipeline and config files.
BuffMcBigHuge
committed

Commits on Apr 24, 2025

Fix to linux subprocess command.
BuffMcBigHuge
committed

Commits on Apr 25, 2025

Added spawned comfy specific logging, modified client logging, modifications to spawning instances, better handling of misconfigured workspace.
BuffMcBigHuge
committed

Commits on Apr 29, 2025

Commits on May 2, 2025

Added optional ROOT_DIR environment variable to help with build_trt script.
BuffMcBigHuge
committed

Commits on May 6, 2025

Code cleanup, modification to frame timing mechanism, added frame logging utility.
BuffMcBigHuge
committed

Commits on May 7, 2025

Commits on May 8, 2025

Commits on May 14, 2025

Merge branch 'main' into marco/logging-updates
BuffMcBigHuge
committed

Commits on May 20, 2025

Commits on May 21, 2025

Simplify video input, small fix.
BuffMcBigHuge
committed

Commits on May 26, 2025

Restructure of distribution logic, added pipeline/tensor_cache logging, attempt to fix tensor_rt directory retrieval in comfyui.
BuffMcBigHuge
committed

Commits on May 27, 2025

Commits on May 28, 2025

Commits on May 29, 2025

Commits on Jun 24, 2025

Merge branch 'main' into marco/multiprocess-clean
BuffMcBigHuge
committed

Commits on Jun 25, 2025