illumos gate

BMC stays up and happy if bnx isn't loaded.

bnx from Broadcom (6.0.3 versus the 6.0.1 distributed with oi_151a) won't load with the following:
/kernel/drv/amd64/bnx: undefined symbol 'mac_resource_add'

Hm.

Stops working as soon as bnx0 plumb is issued (where bnx0 is the interface with the BMC sharing it); bnx1 plumb works fine. As soon as you modunload bnx (not unplumb all instances of bnx!), the BMC begins responding again.

I lied, it works again eventually after an unplumb, it just takes almost a minute to come back.

bnx from SmartOS seems to resolve this problem...

They have a module that's labeled version 6.0.3, loads on stock OI 151a4, and functions with a functioning BMC at the same time.

I've found that the same issue affects the iDRAC on a Dell T610 server. The iDRAC integrated management controller is inaccessible after boot. The same solution (using bnx from SmartOS) also resolves my issue, so it is probably the same bug.

AFAICS there's not been any changes other than a rename to the blob since it was committed.

https://github.com/joyent/smartos-live/tree/master/overlay/generic/kernel/drv/amd64/bnx

But it is a blob - AFAIK the bnx driver is closed, so I don't know how the redistribution of that works here...

I'll try version 7.4.1 from Broadcom tomorrow on one of my machines. If that fixes the issue, I suggest we close this.

Last I tried it, the blob from Broadcom directly panics/fails to load (I forget which) on Illumos because of some symbol differences or s/t.

Works for me:

# uname -a
SunOS ott-encoder5 5.11 oi_151a4 i86pc i386 i86pc Solaris

# prtdiag -v | grep System
System Configuration: Dell Inc. PowerEdge R410

# modinfo  | grep bnx
174 fffffffff80d2000  636c8 197   1  bnx (Broadcom NXII GbE 7.4.1)

$ ping 172.17.227.214  # This is the on-board iDRAC6 BMC
PING 172.17.227.214 (172.17.227.214) 56(84) bytes of data.
64 bytes from 172.17.227.214: icmp_req=1 ttl=58 time=9.31 ms
64 bytes from 172.17.227.214: icmp_req=2 ttl=58 time=9.13 ms
^C
--- 172.17.227.214 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 9.135/9.223/9.312/0.130 ms