Skip to content

Prometheus /metrics endpoint for Grafana/Datadog export #4

@smigolsmigol

Description

@smigolsmigol

Expose a /metrics endpoint on the proxy that returns cost, token count, and request volume data in Prometheus exposition format. Teams already running Grafana or Datadog shouldn't need the dashboard to monitor LLMKit - they should be able to scrape the proxy directly. Scope it to per-key and per-model breakdowns.

Metadata

Metadata

Assignees

No one assigned

    Labels

    f3d1Assigned to f3d1featureNew feature

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions