[WIP] Manage Porter threads and backpressure better

[derekpierre]

Type of PR:

• Bugfix
• Feature
• Documentation
• Other

Required reviews:

• 1
• 2
• 3

What this does:

• Depends on changes in [WIP] Additional safety valves when using NetworkRequestClient for making threshold requests nucypher#3722

• Use a global concurrent requests semaphore for absorbing some back-pressure from too many requests; if the semaphore can't be acquired after a timeout then return 429. Reduce Hendrix max threads since it can overwhelm the server.

  • Add in flight caps for server requests that require communication with multiple nodes in a cohort; we don't limit /get_ursulas and /bucket_sampling since those can be used for health checks.

• Configure max worker threads used per request, and allow overwriting via env variable

Issues fixed/closed:

• Fixes #...

Why it's needed:

Explain how this PR fits in the greater context of the NuCypher Network.
E.g., if this PR addresses a nucypher/productdev issue, let reviewers know!

Notes for reviewers:

What should reviewers focus on?
Is there a particular commit/function/section of your PR that requires more attention from reviewers?

[Copilot]

Pull request overview

Adds request-level backpressure to Porter’s Flask/Hendrix web controller by limiting concurrent in-flight requests, while exempting health-check style endpoints.

Changes:

• Introduces a global in-flight request semaphore with an acquire timeout and 429 on overload.
• Exempts /get_ursulas and /bucket_sampling from the in-flight cap.
• Lowers Hendrix deployer default max threadpool size.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.

File	Description
porter/main.py	Defines the non-capped health-check paths and passes them into the WebController.
porter/controllers.py	Implements the in-flight semaphore gating in Flask request hooks and adjusts deployer defaults.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.19%. Comparing base (bc1aee7) to head (6b9ee68).

Additional details and impacted files

@@               Coverage Diff               @@
##           development     #106      +/-   ##
===============================================
+ Coverage        90.91%   91.19%   +0.27%     
===============================================
  Files               18       18              
  Lines              969      999      +30     
===============================================
+ Hits               881      911      +30     
  Misses              88       88              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.