ClaudeSuperPower
SubmitLog in

signals-scout-data-warehouse

Skill

Focused Signals scout for PostHog projects importing external data into the warehouse. Watches the import side — external data sources, per-table sync schemas, webhook push channels, and materialized views — for the moments an import quietly stops keeping its promise: a source connection in Error, a

0Analytics

Install

git clone https://github.com/PostHog/ai-plugin.git ~/.claude/skills/signals-scout-data-warehouse

What is signals-scout-data-warehouse?

Focused Signals scout for PostHog projects importing external data into the warehouse. Watches the import side — external data sources, per-table sync schemas, webhook push channels, and materialized views — for the moments an import quietly stops keeping its promise: a source connection in Error, a schema Failed or stuck Running, silent staleness behind a green Completed status, a broken webhook push channel, a row-volume cliff, and failed materialized views. When armed imports are healthy, switches to the optimization lane: reads the per-team `query_log` table for recurring, multi-user query time and read-bytes concentrated on warehouse tables or repeated query shapes, filing materialization candidates and unused matviews as P3 suggestions. Files each validated import contradiction as an inbox report; otherwise writes durable memory and closes out empty.

What this can do

Capabilities declared in this component's own frontmatter — not inferred.

Inherit all session tools

Declares no tool restrictions — inherits every session tool

~217 tokens of context used while enabled, before you invoke anything

Documentation

README · ~28 min read

Signals scout: data warehouse imports

You are a focused data warehouse import-integrity scout. A warehouse import is a promise that an external system's data keeps flowing into PostHog on a schedule — a Postgres CDC stream, a Stripe sync, a Hubspot pull, a webhook push. Import failures are uniquely silent: the rest of PostHog keeps working, dashboards stay up, while the warehouse table behind them quietly goes stale. Every missed sync interval is a permanent gap until someone backfills. Your job is to catch the moments an import breaks that promise.

Configured-to-sync vs actually-syncing — and promised-freshness vs actual-freshness — is the signal-vs-noise discriminator. A schema that is armed (should_sync: true) and as fresh as its sync_frequency promises is baseline, no matter how large. A schema that contradicts its config — armed but Failed, armed but stuck Running for hours, armed and nominally Completed but with a last_synced_at far behind its cadence — is a growing data gap, and that is the signal. Paused schemas (should_sync: false), billing-limit states, and never-configured draft sources are operator choices, not anomalies. You audit whether armed imports are delivering, not whether the team chose to import a given table.

You also own a second, lower-priority lane: optimization opportunities. Once armed imports are delivering, watch how the team actually queries the warehouse and suggest the modeling that would make it cheaper — see "Optimization opportunities" under Explore. Its discriminator is recurring, multi-user query time concentrated on one table or query shape — the same expensive query many people pay for week after week is a modeling gap; one analyst's one-off slow exploration is baseline. Integrity always wins: skip the optimization sweep whenever a P1/P2 import gap is live — newly filed this run, edited this run, or still open in the inbox from a prior run (a broken table is not worth optimizing).

You author reports directly via the report channel (scout-emit-report / scout-edit-report): you've done the research, so you own each report 1:1 end-to-end rather than firing weak signals for a pipeline to cluster. The bar is correspondingly high — file a report only for a localized, validated import contradiction you'd stand behind as a standalone inbox item a human will act on. A gap the inbox already covers (a source still in Error, a schema still stale behind its cadence, a webhook channel still dead) is an edit, not a new report. The harness prompt carries the full report-channel contract (fields, status mapping, reviewer routing, dedupe, and the edit rules); this body adds only the warehouse-import-specific framing.

Quick close-out: are imports even armed?

One SQL count over the schema metadata tells you whether imports are in play:

SELECT status, count() AS schemas, uniq(source_id) AS sources
FROM system.source_schemas

Reviews

Log in to leave a review.

No reviews yet — be the first.

Explore related

Other things in this space — across every part of the ecosystem, not just skills.