Telemetry

Prover Node monitoring through metrics exports.

Prover Nodes are required to run their nodes alongside a "sidecar" Docker container to export useful metrics about the node. These metrics are aggregated and are visible in a public Grafana dashboard.

1. Please reach out through our channels to get your Grafana API key.

2. Run the following command, replacing API_KEY with the provided one:

BASE_URL=https://storage.googleapis.com/fermah-releases
SCRIPT=telemetry.sh
API_KEY=yourapikey

curl $BASE_URL/$SCRIPT | bash -s -- $API_KEY

SHA256: 478c7f9865f990ef5f7fb1d0b2db7194a38f4236b1a84f9ee3a4d42ddc31e7d7

GPG verification available, check GPG.

---

OpenTelemetry

All Operators can enable and export metrics using OTL protocol through Grafana Alloy using a provided API key. Operators can customize their Grafana Alloy configuration to export to additional OpenTelemetry collectors.

Currently, the node exports the following:

• Logs

• Tracing Spans (Instrumentation)

• Metrics (e.g. Gauges, Counters)

Configuration

Please refer to the Grafana Alloy documentation when modifying the provided config.alloy file. Additionally, there is a basic configuration that can be modified under:

~/.fermah/config/net/telemetry.otlp.json

Example

{
  "name": "otlp",
  "description": "OTLP telemetry with export capabilities.",
  "network": "testnet",
  "type": "telemetry",
  "config": {
    "export": {
      "endpoint": "http://localhost:4317",
      "timeoutSecs": 3
    },
    "filter": "info"
  }
}

By default, we export all logs that match INFO level.