Feat: Add Procedures HLI

[d-perl]

closes #681

To test procedures locally you can start the BEC server with: bec-server start --use-in-process-proc-worker, this will avoid the use of podman.

Introduces a high level interface in the BEC client to manage procedures, with a convenience function to run a loaded macro

Also starts the procedure runner as part of the scan server

You can operate it from bec.proc, e.g.:

• default@bec [1/1] ❯❯ st = bec.proc.request_new("sleep", ((),{"time_s":5}))

• default@bec [2/1] ❯❯ st
Out[2]: ProcedureStatus for sleep: Scheduled

• default@bec [3/1] ❯❯ st
Out[3]: ProcedureStatus for sleep: Running

• default@bec [4/1] ❯❯ st
Out[4]: ProcedureStatus for sleep: Finished

• default@bec [5/1] ❯❯ st = bec.proc.request_new("doesn't exist")

• default@bec [6/1] ❯❯ st
Out[6]:
ProcedureStatus for doesn't exist: Rejected
ERROR:
Procedure doesn't exist not known to the server. Available: ['log execution message args', 'run scan', 'sleep', 'run_script', 'run_macro']

• default@bec [7/1] ❯❯ st = bec.proc.run_macro("macro_test", 2, 3)

and get a list of available procedures like:

• default@bec [1/1] ❯❯ bec.proc.available_procedures()

Available procedures and their signatures:
------------------------------------------

'log execution message args':
    (*args, **kwargs)

'run scan':
    (scan_name: str, args: tuple, parameters: dict)

'sleep':
    (time_s: float)

'run_script':
    (script_id: str)

'run_macro':
    (macro_name: str, params: tuple[tuple, dict] | None = None)

[codecov]

Codecov Report

❌ Patch coverage is 84.55056% with 55 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
bec_lib/bec_lib/procedures/helper.py	75.86%	19 Missing and 16 partials ⚠️
bec_lib/bec_lib/procedures/hli.py	66.66%	5 Missing ⚠️
...ver/bec_server/bec_server_utils/service_handler.py	54.54%	2 Missing and 3 partials ⚠️
...r/bec_server/bec_server_utils/subprocess_launch.py	70.00%	3 Missing ⚠️
bec_server/bec_server/procedures/manager.py	90.62%	1 Missing and 2 partials ⚠️
bec_server/bec_server/scan_server/scan_server.py	70.00%	3 Missing ⚠️
...c_server/bec_server/procedures/container_worker.py	95.45%	1 Missing ⚠️

📢 Thoughts on this report? Let us know!

[cappel89]

Nice! A couple of minor comments. For me it worked good, although I was unable to start a procedure with "run_scan" through the CLI. Maybe we can check that briefly together tomorrow.

[wakonig]

as far as I understood from @d-perl, this PR would anyway soon be followed up with another PR to implement the multiprocess worker, replacing the inprocess one. If @cappel89 thinks his comments have been addressed, we should merge it

[d-perl]

@wakonig that's right, I already started drafting it, I just didn't want to pile more stuff on this PR