Skip to content

Add integration tests on error cases #325

Open
@liu-cong

Description

@liu-cong

Hermetic test is a fast way to verify functionality e2e without requiring a real cluster.

Add the following cases to make sure the EPP can correctly handle the errors.

  • Test when requested model is not found in InferenceModel
  • Test InferenceModel has a different InferencePool than the poolName flag passed to EPP - this should be the same as the InferenceModel doesn't exist
  • Test when no backend pods are available
  • Test invalid request payload (e.g., doesn't contain "model")
  • Test backend server error, client should receive an error with an appropriate error code

Metadata

Metadata

Assignees

Labels

help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.kind/cleanupCategorizes issue or PR as related to cleaning up code, process, or technical debt.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions