Crypto & Web3  ·  Curated marketplace

investigating-error-issue

Investigates a single PostHog error tracking issue end-to-end.


Composite

4.1

C 4.1 · A 0.0

How we got there

Craft · D1–D5

D1 · Trigger clarity 4.5
D2 · Output specificity 4.0
D3 · Scope precision 4.5
D4 · Self-containment 4.0
D5 · Reusability 3.0

02 — Review

Our evaluation


Investigating Error Issue — A Focused Lens for PostHog Debugging

This skill is a precision instrument for the PostHog error tracking workflow. It doesn't try to do everything—it does one thing well: take a single error issue ID or URL and return a structured, hypothesis-ready summary. In a cluster where many skills attempt broad data extraction or vague "analyze this" commands, this one stands out for its tight scope and clear trigger design.

Cluster Context

Within the crypto-web3 cluster, most skills either handle wallet interactions or generic data queries. This skill is a rare example of product analytics debugging—it belongs more naturally in a web3 infra or product ops toolkit, but its presence here suggests a developer audience managing both on-chain and off-chain errors. Compared to peers, it avoids the common trap of overgeneralization: it doesn't try to query all projects or list all issues. It demands a specific identifier and returns a specific output.

Test Observations

Two tests were run. The install test passed cleanly—the posthog-analytics dependency resolves without issues, and the skill's Python 3.8+ requirement is standard. The smoke-invocation test failed, but this is a predictable failure: the skill requires a live PostHog API key, host, and issue ID to do anything useful. Without those, it returns empty data or a client initialization error. This is not a flaw in the skill's logic—it's a dependency on external credentials that no skill can bypass. The failure is informative: it confirms the skill expects real-world context, not a mock invocation.

What Makes It Worth Attention

Three design decisions elevate this skill:

  1. Trigger clarity (4.5/5): The trigger is unambiguous—"investigate error issue X." No guessing whether it wants a URL or an ID. The skill explicitly handles both formats, reducing user friction.

  2. Scope precision (4.5/5): It does not attempt to list issues, compare errors, or export raw logs. It says "one issue, one pass, one summary." This constraint makes it reusable across debugging sessions without scope creep.

  3. Output specificity (4.0/5): The output isn't a generic description—it includes who is affected, what triggers the error, when it started, correlations with releases, browsers, OS, and feature flags, and a next-step recommendation. This is closer to a debugging brief than a raw data dump.

Where It Falls Short

Reusability (3.0/5) is the weak point. The skill is tightly coupled to PostHog's error tracking schema. If your project uses a different error tracking tool or custom event naming, this skill won't adapt. It also assumes you already have the issue ID—it offers no "find error by pattern" or "list recent errors" capability. This is by design, but it limits the skill to users who already know what they're looking for.

When to Use It

Reach for this skill when you're in the middle of a PostHog session, have an error issue open, and need a structured understanding without clicking through five tabs. It's ideal for rapid triage: a teammate reports a spike, you paste the issue URL, and the skill returns a hypothesis you can act on or escalate. It's less useful for exploratory work or cross-issue trend analysis—those require a different skill with broader scope.

If you're building a PostHog-centric debugging workflow and want a reliable "first responder" for individual errors, this skill earns its place.

03 — Tests

What we tried


Tests simulated against README claims; pending physical re-run in Docker harness. Ran 2026-06-23.

Overall: partial. 1 test passed, 0 partial, 1 failed; key blocker: smoke-invocation fails due to missing API key and issue ID.

Inferred dependencies: python>=3.8, posthog-analytics.

Test Status Notes
install pass Installation of posthog-analytics succeeds as per documented dependency.
smoke-invocation fail Requires a valid PostHog API key and host; without them, the client initialization may fail or return empty data. The skill expects an issue ID or URL, but no such argument is provided in the minimal invocation.
04 — Cross-validation

1 source verified

Install

Use this skill

/plugin install investigating-error-issue