Shannon Lowder
  • Home
  • About

Replacing Stored Procedures in Databricks: The Right Way to Think About It

Shannon Lowder

Shannon Lowder

06 Sep 2018
Share

Read more

33 scheduled jobs, and not one of them consumed a queue

Give every state in your workflow a named consumer on a schedule. That is the first rule I hold for an agent-run software factory, and it is the first of four I tightened in September. The short answer is that agents are very good at creating work, and nothing

By Shannon Lowder 07 Oct 2026

A job that fails is loud. A job that stops running is silent.

Alert on the presence of expected output, not on job failure. That one inversion is the cheapest monitoring upgrade I know, and I now build it into every scheduled thing I own — because a job that fails is already screaming at you, and a job that quietly stops being scheduled

By Shannon Lowder 30 Sep 2026

Your SSO can't authorize your agent, and disabling the user won't stop it

Give every agent its own identity, mint it locally, scope it to write and never admin, and test the kill switch before you need it. That is the whole rail, and I install it before a new agent gets anywhere near a repository. The reason it looks like that — rather

By Shannon Lowder 23 Sep 2026

A per-PR concurrency group cannot throttle a job whose output is a new PR

Go find your CI kill switch before you need it, and confirm it is reversible. Mine is a single repository setting that disables Actions entirely, and I know it works because I have exercised it: last week my own estate started minting pull requests faster than anyone could read them,

By Shannon Lowder 16 Sep 2026
Shannon Lowder
Powered by Ghost