Skip to content

Improve error reporting for when requests are dropped because of saturation. #1082

Open
@ahg-g

Description

@ahg-g

For sheddable requests, we currently return a blank error code and message that the request was dropped due to "system saturated": https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/pkg/epp/requestcontrol/director.go#L170

This doesn't distinguish between the case where we don't have any endpoints to select from (no ready pods) and the case where we do, but are saturated.

/assign @LukeAVanDrie

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions