Privacy-safe canonical OpenTelemetry token metrics for Hermes Agent
Find a file
HoroTW b913b904b4 Merge pull request #3: keep private Friends setup outside repository
Public repository retains generic documentation only.
2026-07-10 08:56:18 +00:00
tests feat: publish canonical Hermes OTEL usage plugin 2026-07-10 09:49:18 +02:00
.gitignore feat: publish canonical Hermes OTEL usage plugin 2026-07-10 09:49:18 +02:00
__init__.py feat: publish canonical Hermes OTEL usage plugin 2026-07-10 09:49:18 +02:00
LICENSE feat: publish canonical Hermes OTEL usage plugin 2026-07-10 09:49:18 +02:00
plugin.yaml feat: publish canonical Hermes OTEL usage plugin 2026-07-10 09:49:18 +02:00
README.md docs: keep private Friends setup outside repository 2026-07-10 10:55:59 +02:00
requirements.txt feat: publish canonical Hermes OTEL usage plugin 2026-07-10 09:49:18 +02:00
SECURITY.md feat: publish canonical Hermes OTEL usage plugin 2026-07-10 09:49:18 +02:00

Hermes OTEL Usage

Privacy-safe, metrics-only OpenTelemetry plugin for Hermes Agent. It exports aggregate token counters from Hermes' sanitized post_api_request hook.

Metric contract

  • OTLP/HTTP metrics endpoint: configured per installation
  • metric: hermes.tokens.total
  • temporality: cumulative, monotonic counter
  • attributes:
    • provider
    • model (canonical model ID)
    • platform
    • type: exactly cache_read, input, output, or reasoning

It does not export prompts, responses, conversation history, tool arguments/results, traces, or logs. It does not calculate or attach pricing.

Install

hermes plugins install https://forgejo.horotw.dev/HoroTW/hermes-otel-usage.git --enable

Then configure plugins.entries.otel_usage in ~/.hermes/config.yaml and provide any OTLP authorization header through standard OpenTelemetry environment variables. Keep credentials outside the repository.

Avoid duplicate accounting

Run only one Hermes token exporter for a given call stream. Disable hermes_otel or any exporter producing hermes_llm_*_tokens unless the receiving rollup has explicit deduplication semantics.

Development

python3 -m venv .venv
. .venv/bin/activate
pip install -r requirements.txt pytest
pytest -q

License

MIT