Grafana

​

Overview

• Query Prometheus metrics via Grafana
• Access dashboard data
• Retrieve alert status
• Reference annotations

​

Prerequisites

• Grafana instance (Cloud or self-hosted)
• API key with Viewer permissions
• Data sources configured in Grafana

​

Configuration

​

Step 1: Generate API Key

1. Log in to Grafana
2. Go to Administration > Users and access > Service accounts
3. Create a new service account with Viewer role
4. Generate a token for the service account

​

Step 2: Add to IncidentFox

{
  "tools": {
    "grafana": {
      "enabled": true,
      "url": "https://grafana.company.com",
      "api_key": "vault://secrets/grafana-api-key",
      "default_datasource": "Prometheus"
    }
  }
}

​

Available Tools

​

grafana_query_prometheus

@incidentfox query prometheus for request_latency_seconds by service

• query - PromQL query
• time_range - Time range
• step - Query step

​

grafana_get_dashboard

@incidentfox get the production overview dashboard from Grafana

​

grafana_get_alerts

@incidentfox show firing Grafana alerts

​

Next Steps