illumos gate

I have just started to see this same issue on opensolaris 134; Here is what is logged around the event..

Apr  9 12:09:24 opensolaris mountd[527]: [ID 589989 daemon.error] Could not find DNS entry for tcp
Apr  9 12:55:15 opensolaris nfssrv: [ID 939466 kern.warning] WARNING: nfsauth: mountd has not established door
Apr  9 12:55:16 opensolaris mountd[895]: [ID 589989 daemon.error] Could not find DNS entry for tcp
Apr  9 12:55:48 opensolaris mDNSResponder: [ID 702911 daemon.error] ERROR: getOptRdata - unknown opt 4
Apr  9 12:56:02 opensolaris last message repeated 23 times
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from 4500 to  120 for    9 mbp_13._net-assistant._udp.local. (47) RDLen 9: .w
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from 4500 to  120 for    9 GrowlServer._nssocketport._tcp.local. (47) RDLen 9: ..
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from 4500 to  120 for    9 mbp_13._growl._tcp.local. (47) RDLen 9: ..
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from 4500 to  120 for    9 40-37-71-72 mbp_13._sleep-proxy._udp.local. (47) RDLen 9: .l
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from 4500 to  120 for    9 mbp_13._servermgr._tcp.local. (47) RDLen 9: ..
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from 4500 to  120 for    7 mbp_13._servermgr._tcp.local. (47) RDLen 7: ..
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] ERROR: getOptRdata - unknown opt 4
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from  120 to 4500 for    7 mbp_13._servermgr._tcp.local. (47) RDLen 7: ..
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from  120 to 4500 for    9 mbp_13._servermgr._tcp.local. (47) RDLen 9: ..
Apr  9 12:56:02 opensolaris mDNSResponder: [ID 702911 daemon.error] ERROR: getOptRdata - unknown opt 4
Apr  9 13:43:45 opensolaris mountd[915]: [ID 589989 daemon.error] Could not find DNS entry for tcp
Apr  9 13:49:23 opensolaris mDNSResponder: [ID 702911 daemon.error] ERROR: getOptRdata - unknown opt 4
Apr  9 13:49:37 opensolaris last message repeated 22 times
Apr  9 13:49:37 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from 4500 to  120 for    9 mbp_13._net-assistant._udp.local. (47) RDLen 9: .w
Apr  9 13:49:39 opensolaris mDNSResponder: [ID 702911 daemon.error] ERROR: getOptRdata - unknown opt 4
Apr  9 13:49:39 opensolaris mDNSResponder: [ID 702911 daemon.error] Correcting TTL from  120 to 4500 for    9 mbp_13._net-assistant._udp.local. (47) RDLen 9: ..
Apr  9 13:49:39 opensolaris mDNSResponder: [ID 702911 daemon.error] ERROR: getOptRdata - unknown opt 4

work-a-round: Turn off mdns in /etc/nsswitch.conf

Fixed patch: http://cr.illumos.org/view/bm9forx6

Problem is in:

_get_hostserv_inetnetdir_byname() can wrongly return success but
   without any result because nss_search() doesn't always care about
   opaque arg.

_get_hostserv_inetnetdir_byname() can wrongly return success but
without any result because nss_search() doesn't always care about
opaque arg.

Fix is: check nss_search's return value and detect error.

Another crash:

libc_hwcap1.so.1`_lwp_kill+0x15
   libc_hwcap1.so.1`raise+0x22
   libc_hwcap1.so.1`abort+0xf2
   libc_hwcap1.so.1`_assert+0x82
   getclientsnames_common+0x69
   getclientsnames_lazy+0x28
   do_logging_queue+0x3b
   logging_svc+0x52
   libc_hwcap1.so.1`_thrp_setup+0x9b
   libc_hwcap1.so.1`_lwp_start

Related code:

getclientsnames_common(struct netconfig *nconf, struct netbuf **nbuf,
       struct nd_hostservlist **serv)
{
    if (__netdir_getbyaddr_nosrv(nconf, serv, *nbuf) != 0) {

^^^^^
  This function returned 0, but without set *serv.

...
        *serv = anon_client(host);
        if (*serv == NULL)
            return (ENOMEM);
        }

assert(*serv != NULL);

^^^
      Was this ASSERT

}

Here is code that caused returning 0:

_get_hostserv_inetnetdir_byaddr() {
        ...
      if ((tmphe = DOOR_GETIPNODEBYADDR_R((char *)&v4mapbuf,
            16, AF_INET6, ndbuf4host->result,
            ndbuf4host->buffer,
            ndbuf4host->buflen, &h_errnop)) != NULL)
            he = __mappedtov4(tmphe, &h_errnop);

if (!he) {
            /* Failover case, try hosts db for v4 address */
            he = DOOR_GETHOSTBYADDR_R((char *)
                &(sa->sin_addr.s_addr), 4,
                sa->sin_family, ndbuf4host->result,
                ndbuf4host->buffer, ndbuf4host->buflen,
                &h_errnop);
                            ^^^^
      h_errnop was set to 0, that is a bug.
            if (!he) {
                NSS_XbyY_FREE(&ndbuf4host);
                if (ndbuf4serv)
                    NSS_XbyY_FREE(&ndbuf4serv);
                _nderror = __herrno2netdir(h_errnop);
                return (_nderror);
            }