.mg TLD DNSSEC Outage: 2019-04-27 to 2019-04-28
Date: April 28, 2019
Overview
This page gives some details on the .mg (Madagascar) TLD DNSSEC outage from April 27 to April 28, 2019. This is at least the 23rd DNSSEC outage for Madagascar.
Timeline / DNSViz
(At the time of this writing, DNSViz has been having a multi-week outage. DNSSEC makes its users think downtime doesn't matter.)
- 2019-04-27 21:27:00 UTC — first personally observed DNSSEC failure
- 2019-04-28 01:41:09 UTC — last personally observed DNSSEC failure
- 2019-04-28 01:42:25 UTC — RRSIGs become valid
DNSSEC Debugger
Unlike DNSViz, Verisign's DNSSEC Debugger doesn't archive results, so here's a screenshot of my web browser's output from April 27, 2019:
drill trace
Since DNSSEC contains so much garbage, I put the complete drill trace into its own file, with the relevant portion below (emphasis added):
;; Domain: mg.
[B] mg. 3600 IN DNSKEY 257 3 5 ;{id = 59263 (ksk), size = 2048b}
mg. 3600 IN DNSKEY 256 3 5 ;{id = 4530 (zsk), size = 1024b}
mg. 3600 IN DNSKEY 257 3 5 ;{id = 64652 (ksk), size = 2048b}
[B] Error verifying denial of existence for mg. type A: No keys with the keytag and algorithm from the RRSIG found
;;[S] self sig OK; [B] bogus; [T] trusted
Google DNS: with and without DNSSEC
DNSSEC can be disabled in queries via the CD (checking disabled) bit. Let's compare DNS queries with and without DNSSEC.
With DNSSEC, DNS queries fail:
$ dig +dnssec ns mg. @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +dnssec ns mg. @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 44929
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1
;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags: do; udp: 512
;; QUESTION SECTION:
;mg. IN NS
;; Query time: 39 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Sun Apr 28 01:09:57 2019
;; MSG SIZE rcvd: 31
You have to disable DNSSEC to make DNS queries work:
$ dig +cd ns mg. @8.8.8.8
; <<>> DiG 9.4.2-P2 <<>> +cd ns mg. @8.8.8.8
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 47190
;; flags: qr rd ra cd; QUERY: 1, ANSWER: 5, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;mg. IN NS
;; ANSWER SECTION:
mg. 7199 IN NS censvrns0001.ird.fr.
mg. 7199 IN NS ns-mg.malagasy.com.
mg. 7199 IN NS ns.nic.mg.
mg. 7199 IN NS pch.nic.mg.
mg. 7199 IN NS ns.dts.mg.
;; Query time: 31 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Sun Apr 28 01:09:57 2019
;; MSG SIZE rcvd: 145
Logfile examples
These Unbound log entries come from three different Unbound instances, each on different servers in different geographical regions.
- [1556400420] unbound[414:0] info: validation failure <tm.mg. NS IN>: signature before inception date from 91.203.32.147 for <mg. SOA IN>
- [1556413996] unbound[48850:0] info: validation failure <org.mg. NS IN>: signature before inception date from 196.192.32.2 for key mg. while building chain of trust
- [1556415069] unbound[48850:0] info: validation failure <gov.mg. NS IN>: signature before inception date from 204.61.216.121 for key mg. while building chain of trust
- [1556415643] unbound[414:0] info: validation failure <mg. NS IN>: signature before inception date from 91.203.32.147 for key mg. while building chain of trust
- [1556415669] unbound[11104:0] info: validation failure <mg. NS IN>: signature before inception date from 91.203.32.147 for key mg. while building chain of trust