opendnssec.org DNSSEC Outage: 2016-07-04 to 2016-07-05
Updated: July 6, 2016
Overview
This page gives some details on the opendnssec.org DNSSEC outage from July 4 to July 5, 2016. OpenDNSSEC is used by many DNSSEC users to sign their zones. This is not the first opendnssec.org DNSSEC outage.
Timeline / DNSViz
- 2016-07-04 18:44:05 UTC — bogus RRSIGs
- 2016-07-05 01:09:15 UTC — bogus RRSIGs
- 2016-07-05 05:44:22 UTC — bogus RRSIGs
- 2016-07-05 08:08:09 UTC — bogus RRSIGs
- 2016-07-05 08:42:37 UTC — DNSSEC outage over
DNSSEC Debugger
Unlike DNSViz, Verisign's DNSSEC Debugger doesn't archive results, so here's a screenshot of my web browser's output from July 5, 2016:

OpenDNS & Google Public DNS
OpenDNS does not support DNSSEC, instead supporting DNSCurve. Google Public DNS currently supports only DNSSEC, and thus, Google's users saw SERVFAIL for queries under opendnssec.org during this outage.
$ dig www.opendnssec.org. @resolver1.opendns.com.
; <<>> DiG 9.4.2-P2 <<>> www.opendnssec.org. @resolver1.opendns.com.
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 52009
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;www.opendnssec.org. IN A
;; ANSWER SECTION:
www.opendnssec.org. 86400 IN A 185.49.141.14
;; Query time: 378 msec
;; SERVER: 208.67.222.222#53(208.67.222.222)
;; WHEN: Tue Jul 5 02:51:15 2016
;; MSG SIZE rcvd: 52
With Google Public DNS, because of DNSSEC, queries fail:
$ dig +dnssec www.opendnssec.org. @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +dnssec www.opendnssec.org. @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 18580
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags: do; udp: 512
;; QUESTION SECTION:
;www.opendnssec.org. IN A
;; Query time: 322 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Tue Jul 5 02:53:23 2016
;; MSG SIZE rcvd: 47
dnscheck
dnscheck.labs.nic.cz shows bogus RRSIGs (requires javascript).
dnscheck.iis.se shows bogus RRSIGs (requires javascript).
Zonemaster
zonemaster.net archived various DNSSEC problems. In particular see "No RRSIG correctly signed the SOA RRset" and "No signature correctly signed the NSEC RRset."
zonemaster.fr archived various DNSSEC problems. In particular see "No RRSIG correctly signed the SOA RRset" and "No signature correctly signed the NSEC RRset."
Logfile examples
- [1467687564] unbound[28945:0] info: validation failure <www.opendnssec.org. A IN>: signatures from unknown keys from 91.123.201.115
- [1467687718] unbound[28945:0] info: validation failure <opendnssec.org. MX IN>: signatures from unknown keys from 91.123.201.115
- [1467687770] unbound[28945:0] info: validation failure <dnssec-reliability.opendnssec.org. TXT IN>: signatures from unknown keys from 91.206.174.4 for <opendnssec.org. SOA IN>
- [1467707411] unbound[2576:0] info: validation failure <www.opendnssec.org. A IN>: signatures from unknown keys from 91.123.201.115