opendnssec.org DNSSEC Outage: 2016-10-02 to 2016-10-03
Updated: October 3, 2016
Overview
This page gives some details on the opendnssec.org DNSSEC outage from October 2 to October 3, 2016. OpenDNSSEC is used by many DNSSEC users to sign their zones. This is not the first opendnssec.org DNSSEC outage.
Timeline / DNSViz
- 2016-10-02 18:07:38 UTC — bogus RRSIGs
- 2016-10-02 18:12:21 UTC — bogus RRSIGs
- 2016-10-03 01:47:44 UTC — bogus RRSIGs
- 2016-10-03 02:47:16 UTC — bogus RRSIGs
- 2016-10-03 06:43:26 UTC — bogus RRSIGs
- 2016-10-03 10:03:48 UTC — last personally observed DNSSEC failure
- 2016-10-03 10:08:20 UTC — DNSSEC outage over
DNSSEC Debugger
Unlike DNSViz, Verisign's DNSSEC Debugger doesn't archive results, so here's a screenshot of my web browser's output from October 2, 2016:

OpenDNS & Google Public DNS
OpenDNS does not support DNSSEC, instead supporting DNSCurve. Google Public DNS currently supports only DNSSEC, and thus, Google's users saw SERVFAIL for queries under opendnssec.org during this outage.
$ dig www.opendnssec.org @resolver1.opendns.com.
; <<>> DiG 9.4.2-P2 <<>> www.opendnssec.org @resolver1.opendns.com.
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 37853
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;www.opendnssec.org. IN A
;; ANSWER SECTION:
www.opendnssec.org. 86400 IN A 185.49.141.14
;; Query time: 144 msec
;; SERVER: 208.67.222.222#53(208.67.222.222)
;; WHEN: Sun Oct 2 18:11:04 2016
;; MSG SIZE rcvd: 52
With Google Public DNS, because of DNSSEC, queries fail:
$ dig +dnssec www.opendnssec.org @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +dnssec www.opendnssec.org @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 37334
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags: do; udp: 512
;; QUESTION SECTION:
;www.opendnssec.org. IN A
;; Query time: 313 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Sun Oct 2 18:11:04 2016
;; MSG SIZE rcvd: 47
dnscheck
- dnscheck.labs.nic.cz shows "Not enough valid signatures over SOA RRset found for opendnssec.org." (requires javascript).
- dnscheck.iis.se shows "Not enough valid signatures over SOA RRset found for opendnssec.org." (requires javascript).
Zonemaster
Note: Zonemaster only checks delegation status. For instance, a check for www.opendnssec.org will result in a skipped test. Nevertheless:
- zonemaster.net archived NSEC problems.
- zonemaster.fr archived NSEC problems.
Logfile examples
- [1475434333] unbound[16814:0] info: validation failure <www.opendnssec.org. A IN>: signatures from unknown keys from 91.206.174.4
- [1475434428] unbound[28485:0] info: validation failure <eating-your-own-dogfood.opendnssec.org. A IN>: no signatures from 192.36.115.53 for <opendnssec.org. SOA IN>