dnssec-tools.org DNSSEC Outage:
2018-03-11 to 2018-03-27
Updated: March 27, 2018
Overview
This page gives some details on the dnssec-tools.org DNSSEC outage from March 11, to March 27, 2018.
Timeline / DNSViz
- 2018-03-11 01:31:06 UTC — RRSIGs expire
- 2018-03-11 01:34:08 UTC — expired RRSIGs
- 2018-03-14 20:01:00 UTC — expired RRSIGs
- 2018-03-19 03:32:08 UTC — expired RRSIGs
- 2018-03-26 04:25:48 UTC — expired RRSIGs
- 2018-03-26 15:30:02 UTC — last personally observed DNSSEC failure
DNSSEC Debugger
Unlike DNSViz, Verisign's DNSSEC Debugger doesn't archive results, so here's a screenshot of my web browser's output from March 11, 2018:
Google Public DNS: with and without DNSSEC
DNSSEC can be disabled in queries via the CD (checking disabled) bit. Let's compare DNS queries with and without DNSSEC.
With DNSSEC, DNS queries fail:
$ dig +dnssec a dnssec-tools.org. @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +dnssec a dnssec-tools.org. @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 52817
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags: do; udp: 512
;; QUESTION SECTION:
;dnssec-tools.org. IN A
;; Query time: 107 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Sun Mar 11 01:32:53 2018
;; MSG SIZE rcvd: 45
You have to disable DNSSEC to make DNS queries work:
$ dig +cd a dnssec-tools.org. @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +cd a dnssec-tools.org. @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 32345
;; flags: qr rd ra cd; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;dnssec-tools.org. IN A
;; ANSWER SECTION:
dnssec-tools.org. 299 IN A 64.90.35.104
;; Query time: 75 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Sun Mar 11 01:32:53 2018
;; MSG SIZE rcvd: 50
drill trace
Since DNSSEC contains so much garbage, I put the complete drill trace into its own file with the relevant portion below (emphasis added):
;; Domain: dnssec-tools.org.
[B] dnssec-tools.org. 300 IN DNSKEY 256 3 5 ;{id = 19221 (zsk), size = 1024b}
dnssec-tools.org. 300 IN DNSKEY 257 3 5 ;{id = 34816 (ksk), size = 4096b}
dnssec-tools.org. 300 IN DNSKEY 256 3 5 ;{id = 3147 (zsk), size = 1024b}
[B] dnssec-tools.org. 300 IN A 64.90.35.104
;; Error: No keys with the keytag and algorithm from the RRSIG found
;;[S] self sig OK; [B] bogus; [T] trusted
Logfile examples
- [1520731969] unbound[63272:0] info: validation failure <dnssec-tools.org. A IN>: signature expired from 199.101.97.233 for key dnssec-tools.org. while building chain of trust
- [1520732306] unbound[63272:0] info: validation failure <www.dnssec-tools.org. A IN>: signature expired from 208.79.240.3 for key dnssec-tools.org. while building chain of trust
- [1520808878] unbound[63272:0] info: validation failure <dnssec-tools.org. MX IN>: signature expired from 75.101.48.145 for key dnssec-tools.org. while building chain of trust
- [1522078202] unbound[19921:0] info: validation failure <dnssec-tools.org. A IN>: signature expired from 199.101.97.233 for key dnssec-tools.org. while building chain of trust