usfj.mil DNSSEC Outage: 2016-09-09 to 2016-09-18

Updated: September 19, 2016

Overview

This page gives some details on the usfj.mil DNSSEC outage from September 9 to September 18, 2016.

Timeline / DNSViz

• 2016-09-09 03:27:21 UTC — RRSIGs expire
• 2016-09-09 03:27:55 UTC — expired RRSIGs
• 2016-09-10 04:13:46 UTC — expired RRSIGs
• 2016-09-11 06:45:52 UTC — expired RRSIGs
• 2016-09-12 06:45:51 UTC — expired RRSIGs
• 2016-09-13 06:46:15 UTC — expired RRSIGs
• 2016-09-14 06:45:41 UTC — expired RRSIGs
• 2016-09-15 06:45:47 UTC — expired RRSIGs
• 2016-09-16 06:45:52 UTC — expired RRSIGs
• 2016-09-17 06:46:02 UTC — expired RRSIGs
• 2016-09-18 06:46:40 UTC — expired RRSIGs
• 2016-09-18 14:46:31 UTC — expired RRSIGs
• 2016-09-18 22:43:03 UTC — last personally observed DNSSEC failure
• 2016-09-18 22:45:54 UTC — DNSSEC outage over

OpenDNS and Google Public DNS

OpenDNS does not support DNSSEC, instead supporting DNSCurve. Google Public DNS currently supports only DNSSEC, and thus, Google's users saw SERVFAIL for queries under usfj.mil during this outage.

With OpenDNS, queries succeed:

$ dig www.usfj.mil @resolver1.opendns.com.

; <<>> DiG 9.4.2-P2 <<>> www.usfj.mil @resolver1.opendns.com.
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 16515
;; flags: qr rd ra; QUERY: 1, ANSWER: 4, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;www.usfj.mil. IN A

;; ANSWER SECTION:
www.usfj.mil. 2713 IN CNAME www.dodpw.defense.gov.edgesuite.net.
www.dodpw.defense.gov.edgesuite.net. 300 IN CNAME a1603.dscb.akamai.net.
a1603.dscb.akamai.net. 20 IN A 23.59.190.105
a1603.dscb.akamai.net. 20 IN A 23.59.190.136

;; Query time: 471 msec
;; SERVER: 208.67.222.222#53(208.67.222.222)
;; WHEN: Fri Sep 9 03:28:03 2016
;; MSG SIZE rcvd: 143

---

With Google Public DNS, because of DNSSEC, queries fail:

$ dig +dnssec www.usfj.mil @8.8.8.8

; <<>> DiG 9.4.2-P2 <<>> +dnssec www.usfj.mil @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 51226
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags: do; udp: 512
;; QUESTION SECTION:
;www.usfj.mil. IN A

;; Query time: 368 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Fri Sep 9 03:28:03 2016
;; MSG SIZE rcvd: 41

dnscheck

• dnscheck.labs.nic.cz archived expired RRSIGs (requires javascript).
• dnscheck.iis.se archived expired RRSIGs (requires javascript).

Zonemaster

• zonemaster.net archived this usfj.mil DNSSEC outage.
• zonemaster.fr archived this usfj.mil DNSSEC outage.

Logfile examples

• [1473392013] unbound[10507:0] info: validation failure <www.usfj.mil. A IN>: signature expired from 215.1.46.29 for key usfj.mil. while building chain of trust
• [1474238583] unbound[11969:0] info: validation failure <usfj.mil. A IN>: signature expired from 199.211.150.66 for <usfj.mil. SOA IN>