rubric-dashboard

Notes

  • 2026-11-04: rubric.unlikely.systems and sb.unlikely.systems went down with expired Let’s Encrypt certs (Chrome + Bitdefender warnings). The weekly lego renewal (root cron Mon 03:20, /opt/scripts/lego-renew-unlikely-systems.sh) had failed every run since Oct 5: lego’s propagation check used the local systemd-resolved stub, which negative-cached NXDOMAIN for _acme-challenge, and set -e skipped rubric after sb failed. Fixed in scripts fb644c2: —dns.propagation.disable-rns (authoritative check only), per-domain continue, failure posts to ops tagging Dustin. Both certs renewed by hand, Caddy reloaded, new expiry 2027-02-02. The only prior monitor was the RUBRIC dashboard’s own TLS canary, on the site that was down.