.xn--3hcrj9c TLD DNSSEC Outage: 2020-01-01 to 2020-01-08
Start Date: January 1, 2020
Overview
This page gives some details on the .xn--3hcrj9c TLD DNSSEC outage from January 1 to January 8, 2020. This is an IDN TLD for India.
Timeline / DNSViz
(At the time of this writing, DNSViz historical archives have been down for about a year. DNSSEC makes its users think downtime doesn't matter.)
- 2020-01-01 23:15:53 UTC — first personally observed xn--3hcrj9c DNSSEC failure
- 2020-01-08 02:31:23 UTC — last personally observed xn--3hcrj9c DNSSEC failure
Thankfully, archive.is made a copy of the DNSViz output.
DNSSEC Debugger
Here's a screenshot of my web browser's output from January 2, 2020:
There's an archive of the DNSSEC Debugger output provided by archive.is.
Google DNS: with and without DNSSEC
DNSSEC can be disabled in queries via the CD (checking disabled) bit. Let's compare DNS queries with and without DNSSEC.
$ dig +dnssec ns xn--3hcrj9c. @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +dnssec ns xn--3hcrj9c. @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 43823
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags: do; udp: 512
;; QUESTION SECTION:
;xn--3hcrj9c. IN NS
;; Query time: 34 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Wed Jan 1 23:15:58 2020
;; MSG SIZE rcvd: 40
You have to disable DNSSEC to make DNS queries work:
$ dig +cd ns xn--3hcrj9c. @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +cd ns xn--3hcrj9c. @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 13584
;; flags: qr rd ra cd; QUERY: 1, ANSWER: 6, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;xn--3hcrj9c. IN NS
;; ANSWER SECTION:
xn--3hcrj9c. 21599 IN NS ns1.registry.in.
xn--3hcrj9c. 21599 IN NS ns6.registry.in.
xn--3hcrj9c. 21599 IN NS ns2.registry.in.
xn--3hcrj9c. 21599 IN NS ns5.registry.in.
xn--3hcrj9c. 21599 IN NS ns4.registry.in.
xn--3hcrj9c. 21599 IN NS ns3.registry.in.
;; Query time: 26 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Wed Jan 1 23:15:58 2020
;; MSG SIZE rcvd: 148
Zonemaster
- zonemaster.iis.se saved a report on this DNSSEC outage. There's a copy provided by archive.is.
- zonemaster.net also saved a report, while again archive.is saved a copy.
dns.google.com
dns.google.com is related to but seperate from Google Public DNS. During this DNSSEC outage, dns.google.com showed the following for xn--3hcrj9c:
This outage was archived by both archive.is and archive.org.
drill trace
Since DNSSEC contains so much garbage, I put the complete drill trace into its own file, with the relevant portion below (emphasis added):
;; Domain: xn--3hcrj9c.
[B] xn--3hcrj9c. 900 IN DNSKEY 256 3 7 ;{id = 58832 (zsk), size = 1024b}
xn--3hcrj9c. 900 IN DNSKEY 257 3 7 ;{id = 16281 (ksk), size = 2048b}
xn--3hcrj9c. 900 IN DNSKEY 256 3 7 ;{id = 33374 (zsk), size = 1280b}
xn--3hcrj9c. 900 IN DNSKEY 257 3 7 ;{id = 20205 (ksk), size = 2048b}
[B] Error verifying denial of existence for xn--3hcrj9c. type A: No keys with the keytag and algorithm from the RRSIG found
;;[S] self sig OK; [B] bogus; [T] trusted
Logfile examples
These Unbound log entries come from different Unbound instances, each on different servers in different geographical regions.
- [1577920553] unbound[98382:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 156.154.100.20 for key xn--3hcrj9c. while building chain of trust
- [1577920732] unbound[25771:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 156.154.101.20 for key xn--3hcrj9c. while building chain of trust
- [1577920768] unbound[98382:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 37.209.194.12 for key xn--3hcrj9c. while building chain of trust
- [1578449362] unbound[98382:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 37.209.192.12 for key xn--3hcrj9c. while building chain of trust
- [1578449566] unbound[98382:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 37.209.196.12 for key xn--3hcrj9c. while building chain of trust
- [1578450009] unbound[98382:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 37.209.198.12 for key xn--3hcrj9c. while building chain of trust
- [1578450643] unbound[98382:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 37.209.194.12 for key xn--3hcrj9c. while building chain of trust
- [1578450683] unbound[25771:0] info: validation failure <xn--3hcrj9c. NS IN>: signature expired from 156.154.100.20 for key xn--3hcrj9c. while building chain of trust