We grade the public web on permit accuracy.
Most homeowner permit answers on the web are written once and never updated. Cities change rules; ranked sources don't follow. We scan the top-ranked Google results for 10 seed queries across King, Pierce, and Snohomish County, compare each to our verified data, and surface what's out of date — with the exact quote, the source URL, and the date we last checked.
Last scan: 2026-04-27. Sources scanned to date: 7. AI-flagged for review: 3. Publicly confirmed stale: 0.
Methodology
For each tracked query (e.g., "Seattle deck permit"), we:
- Pull the top organic results — via Google's search API (Serper.dev). When the API is unavailable, we fall back to a manually curated list of the top sources currently ranking. The seed list is in
server/features/permit/stale-source-detector/seed-sources.ts; anyone can audit it. - Fetch each result and extract the page text. User-agent identifies as a normal browser; we respect
robots.txtand rate-limit our requests to no faster than 4/second per host. - Classify each source against our verified Kolmo answer using Gemini 2.5 Flash with a constrained JSON schema. The classifier is given strict guardrails: be conservative, only flag clear factual conflicts, never flag for stylistic differences.
- Human review before public flagging. A flag from the AI classifier is not a public accusation. It enters a queue (the "Pending review" list below) until a Kolmo team member confirms or rejects it. Only confirmed-stale sources are publicly named.
What "stale" means
A source is stale when:
- It reports a permit threshold, fee, review timeline, or code reference that contradicts the live published rule from the issuing jurisdiction.
- It quotes a fee from a year that no longer applies and the actual fee changed.
- It cites a code cycle that has been superseded.
A source is not stale when:
- It differs from our answer in framing, formatting, or scope of detail.
- It quotes a different but valid related rule (e.g., commercial vs residential).
- It has older publication dates but the underlying numbers still match the current rule.
How we handle disputes
If you publish a flagged source and disagree with our verdict, email [email protected] with the URL and your reasoning. We take down a public flag while we re-review. Our standard turnaround on disputes is 5 business days.
What we don't do
- We don't flag sources for being a competitor. Conflict of interest matters; we name the source, not the author.
- We don't run hidden affiliate links. We're a Seattle GC; we'd rather you call us, but we don't gate the data behind a lead form.
- We don't paywall the dataset. Every classification, including our verified Kolmo answer for each query, is on this page.
Confirmed stale
0 source(s)Reviewed and confirmed stale by the Kolmo team. Public-facing leaderboard.
Pending team review
3 source(s)AI-flagged by our classifier. Source URLs are listed here for transparency but they are not yet publicly named as stale — the Kolmo team must verify each before promotion to the confirmed list. Each row shows the model's reasoning and confidence.
Coverage
Where we've scanned, broken down by jurisdiction and project type.
By jurisdiction
- seattle6 scanned · 3 flagged
- tacoma1 scanned · 0 flagged
By project type
- deck3 scanned · 1 flagged
- adu2 scanned · 1 flagged
- kitchen1 scanned · 0 flagged
- fence1 scanned · 1 flagged
Recently scanned
The 30 most recently classified sources, regardless of verdict.
| Verdict | Domain | Query | Last seen |
|---|---|---|---|
| ok | houzz.com | do I need a permit to remodel my kitchen Seattle | 2026-04-27 |
| ok | cityoftacoma.org | Tacoma deck permit | 2026-04-27 |
| flagged | seattle.gov | Seattle fence permit | 2026-04-27 |
| ok | aduniverse-seattlecitygis.hub.arcgis.com | Seattle ADU permit requirements | 2026-04-27 |
| flagged | seattle.gov | Seattle ADU permit requirements | 2026-04-27 |
| ok | houzz.com | Seattle deck permit | 2026-04-27 |
| flagged | seattle.gov | Seattle deck permit | 2026-04-27 |
