contextjet-ai/awesome-llm-observability

agent-skills via skillsdirectory-com

Upstream: github.com/contextjet-ai/awesome-llm-observability
Version: 1.1.0

Source details

Revision: v1.1.0 tag
Hash: sha256-F9Od0WnJzTwhRGwLrJVkNl8gRX683eJl6/cSzVc5i8k=
Snapshot: data/agent-skills/github.com/contextjet-ai/awesome-llm-observability.json · latest JSON

26 packages

add-llm-evals

1.1.0 · skills/add-llm-evals

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.add-llm-evals

Install with home-manager

programs.claude-code.skills.add-llm-evals = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.add-llm-evals;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.add-llm-evals'

add-llm-fallbacks

1.1.0 · skills/add-llm-fallbacks

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.add-llm-fallbacks

Install with home-manager

programs.claude-code.skills.add-llm-fallbacks = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.add-llm-fallbacks;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.add-llm-fallbacks'

add-llm-guardrails

1.1.0 · skills/add-llm-guardrails

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.add-llm-guardrails

Install with home-manager

programs.claude-code.skills.add-llm-guardrails = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.add-llm-guardrails;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.add-llm-guardrails'

annotate-traces-for-review

1.1.0 · skills/annotate-traces-for-review

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.annotate-traces-for-review

Install with home-manager

programs.claude-code.skills.annotate-traces-for-review = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.annotate-traces-for-review;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.annotate-traces-for-review'

build-eval-dataset

1.1.0 · skills/build-eval-dataset

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.build-eval-dataset

Install with home-manager

programs.claude-code.skills.build-eval-dataset = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.build-eval-dataset;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.build-eval-dataset'

check-answer-consistency

1.1.0 · skills/check-answer-consistency

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.check-answer-consistency

Install with home-manager

programs.claude-code.skills.check-answer-consistency = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.check-answer-consistency;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.check-answer-consistency'

choose-observability-stack

1.1.0 · skills/choose-observability-stack

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.choose-observability-stack

Install with home-manager

programs.claude-code.skills.choose-observability-stack = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.choose-observability-stack;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.choose-observability-stack'

collect-user-feedback

1.1.0 · skills/collect-user-feedback

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.collect-user-feedback

Install with home-manager

programs.claude-code.skills.collect-user-feedback = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.collect-user-feedback;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.collect-user-feedback'

compare-llm-models

1.1.0 · skills/compare-llm-models

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.compare-llm-models

Install with home-manager

programs.claude-code.skills.compare-llm-models = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.compare-llm-models;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.compare-llm-models'

debug-agent-from-traces

1.1.0 · skills/debug-agent-from-traces

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.debug-agent-from-traces

Install with home-manager

programs.claude-code.skills.debug-agent-from-traces = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.debug-agent-from-traces;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.debug-agent-from-traces'

detect-hallucinations

1.1.0 · skills/detect-hallucinations

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.detect-hallucinations

Install with home-manager

programs.claude-code.skills.detect-hallucinations = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.detect-hallucinations;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.detect-hallucinations'

estimate-llm-cost

1.1.0 · skills/estimate-llm-cost

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.estimate-llm-cost

Install with home-manager

programs.claude-code.skills.estimate-llm-cost = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.estimate-llm-cost;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.estimate-llm-cost'

eval-driven-development

1.1.0 · skills/eval-driven-development

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.eval-driven-development

Install with home-manager

programs.claude-code.skills.eval-driven-development = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.eval-driven-development;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.eval-driven-development'

instrument-llm-observability

1.1.0 · skills/instrument-llm-observability

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.instrument-llm-observability

Install with home-manager

programs.claude-code.skills.instrument-llm-observability = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.instrument-llm-observability;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.instrument-llm-observability'

measure-agent-task-success

1.1.0 · skills/measure-agent-task-success

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.measure-agent-task-success

Install with home-manager

programs.claude-code.skills.measure-agent-task-success = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.measure-agent-task-success;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.measure-agent-task-success'

monitor-rag-quality

1.1.0 · skills/monitor-rag-quality

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.monitor-rag-quality

Install with home-manager

programs.claude-code.skills.monitor-rag-quality = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.monitor-rag-quality;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.monitor-rag-quality'

optimize-prompts

1.1.0 · skills/optimize-prompts

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.optimize-prompts

Install with home-manager

programs.claude-code.skills.optimize-prompts = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.optimize-prompts;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.optimize-prompts'

red-team-llm-app

1.1.0 · skills/red-team-llm-app

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.red-team-llm-app

Install with home-manager

programs.claude-code.skills.red-team-llm-app = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.red-team-llm-app;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.red-team-llm-app'

redact-pii-for-tracing

1.1.0 · skills/redact-pii-for-tracing

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.redact-pii-for-tracing

Install with home-manager

programs.claude-code.skills.redact-pii-for-tracing = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.redact-pii-for-tracing;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.redact-pii-for-tracing'

reduce-llm-cost

1.1.0 · skills/reduce-llm-cost

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.reduce-llm-cost

Install with home-manager

programs.claude-code.skills.reduce-llm-cost = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.reduce-llm-cost;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.reduce-llm-cost'

scrub-pii-from-text

1.1.0 · skills/scrub-pii-from-text

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.scrub-pii-from-text

Install with home-manager

programs.claude-code.skills.scrub-pii-from-text = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.scrub-pii-from-text;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.scrub-pii-from-text'

set-up-ab-testing

1.1.0 · skills/set-up-ab-testing

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.set-up-ab-testing

Install with home-manager

programs.claude-code.skills.set-up-ab-testing = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.set-up-ab-testing;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.set-up-ab-testing'

set-up-drift-alerts

1.1.0 · skills/set-up-drift-alerts

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.set-up-drift-alerts

Install with home-manager

programs.claude-code.skills.set-up-drift-alerts = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.set-up-drift-alerts;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.set-up-drift-alerts'

trace-based-testing

1.1.0 · skills/trace-based-testing

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.trace-based-testing

Install with home-manager

programs.claude-code.skills.trace-based-testing = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.trace-based-testing;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.trace-based-testing'

trace-multi-agent-system

1.1.0 · skills/trace-multi-agent-system

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.trace-multi-agent-system

Install with home-manager

programs.claude-code.skills.trace-multi-agent-system = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.trace-multi-agent-system;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.trace-multi-agent-system'

validate-genai-spans

1.1.0 · skills/validate-genai-spans

pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.validate-genai-spans

Install with home-manager

programs.claude-code.skills.validate-genai-spans = pkgs.agent-skills.github.contextjet-ai.awesome-llm-observability.validate-genai-spans;

Build without the overlay

nix build 'github:sudosubin/agents.nix#agent-skills.aarch64-darwin.github.contextjet-ai.awesome-llm-observability.validate-genai-spans'

The build command uses aarch64-darwin; aarch64-linux and x86_64-linux work too. Any agent that reads a skills directory can use these packages; see the usage guide for installation.