Bug #2582
open
hermon: missing IB device
0%
Description
prtconf:
...
ib, instance #0
System properties:
name='class' type=string items=1
value='root'
name='port-svc-list' type=string items=1
value='ipib'
name='vppa-svc-list' type=string items=1
value='nfs'
name='hca-svc-list' type=string items=1
value=''
Driver properties:
name='pm-want-child-notification?' type=boolean dev=none
Device Minor Nodes:
dev=(202,0)
dev_path=/ib:fabric
spectype=chr type=minor
dev_link=/dev/cfg/ib
dev_path=/ib:2C9030010E904
spectype=chr type=minor
dev_link=/dev/cfg/hca:2C9030010E904
dev_path=/ib:devctl
spectype=chr type=minor
sdpib, instance #0
Hardware properties:
name='client-guid' type=string items=1
value='sdpib,0'
Paths from multipath bus adapters:
Path 1: /pci@79,0/pci10de,376@f/pci15b3,36@0/sdpib@sdpib,0
hermon#0 (online)
Device Minor Nodes:
dev=(317,0)
dev_path=/ib/sdpib@0:sdpib
spectype=chr type=minor
Device Minor Layered Under:
mod=sdp accesstype=chr
dev_path=/pseudo/sdp@0
daplt, instance #0
Hardware properties:
name='client-guid' type=string items=1
value='daplt,0'
Paths from multipath bus adapters:
Path 2: /pci@79,0/pci10de,376@f/pci15b3,36@0/daplt@daplt,0
hermon#0 (online)
Device Minor Nodes:
dev=(316,0)
dev_path=/ib/daplt@0:daplt
spectype=chr type=minor
dev_link=/dev/daplt
rdsv3, instance #0
System software properties:
name='ddi-forceattach' type=int items=1
value=00000001
Hardware properties:
name='client-guid' type=string items=1
value='rdsv3,0'
Paths from multipath bus adapters:
Path 3: /pci@79,0/pci10de,376@f/pci15b3,36@0/rdsv3@rdsv3,0
hermon#0 (online)
Device Minor Nodes:
dev=(315,0)
dev_path=/ib/rdsv3@0:rdsv3
spectype=chr type=minor
eibnx, instance #0
Hardware properties:
name='client-guid' type=string items=1
value='eibnx,0'
Paths from multipath bus adapters:
Path 4: /pci@79,0/pci10de,376@f/pci15b3,36@0/eibnx@eibnx,0
sol_uverbs, instance #0
Hardware properties:
name='client-guid' type=string items=1
value='sol_uverbs,0'
Paths from multipath bus adapters:
Path 5: /pci@79,0/pci10de,376@f/pci15b3,36@0/sol_uverbs@sol_uverbs,0
hermon#0 (online)
Device Minor Nodes:
dev=(309,0)
dev_path=/ib/sol_uverbs@0:uverbs0
spectype=chr type=minor
Minor properties:
name='device-id' type=int items=1 dev=(309,0)
value=0000673c
name='vendor-id' type=int items=1 dev=(309,0)
value=000015b3
name='guid' type=int64 items=1 dev=(309,0)
value=0002c9030010e904
name='abi-version' type=int items=1 dev=(309,0)
value=00000006
dev=(309,16)
dev_path=/ib/sol_uverbs@0:ucma
spectype=chr type=minor
dev=(309,17)
dev_path=/ib/sol_uverbs@0:event
spectype=chr type=minor
sol_umad, instance #0
Driver properties:
name='abi_version' type=int items=1 dev=none
value=00000005
Hardware properties:
name='client-guid' type=string items=1
value='sol_umad,0'
Paths from multipath bus adapters:
Path 6: /pci@79,0/pci10de,376@f/pci15b3,36@0/sol_umad@sol_umad,0
hermon#0 (online)
Device Minor Nodes:
dev=(308,0)
dev_path=/ib/sol_umad@0:umad0
spectype=chr type=minor
Minor properties:
name='port' type=int items=1 dev=(308,0)
value=00000001
name='hca-instance' type=int items=1 dev=(308,0)
value=00000000
name='device-id' type=int items=1 dev=(308,0)
value=0000673c
name='vendor-id' type=int items=1 dev=(308,0)
value=000015b3
dev=(308,32768)
dev_path=/ib/sol_umad@0:issm0
spectype=chr type=minor
Minor properties:
name='port' type=int items=1 dev=(308,32768)
value=00000001
name='hca-instance' type=int items=1 dev=(308,32768)
value=00000000
name='device-id' type=int items=1 dev=(308,32768)
value=0000673c
name='vendor-id' type=int items=1 dev=(308,32768)
value=000015b3
dev=(308,1)
dev_path=/ib/sol_umad@0:umad1
spectype=chr type=minor
Minor properties:
name='port' type=int items=1 dev=(308,1)
value=00000002
name='hca-instance' type=int items=1 dev=(308,1)
value=00000000
name='device-id' type=int items=1 dev=(308,1)
value=0000673c
name='vendor-id' type=int items=1 dev=(308,1)
value=000015b3
dev=(308,32769)
dev_path=/ib/sol_umad@0:issm1
spectype=chr type=minor
Minor properties:
name='port' type=int items=1 dev=(308,32769)
value=00000002
name='hca-instance' type=int items=1 dev=(308,32769)
value=00000000
name='device-id' type=int items=1 dev=(308,32769)
value=0000673c
name='vendor-id' type=int items=1 dev=(308,32769)
value=000015b3
rdsib, instance #0
Hardware properties:
name='client-guid' type=string items=1
value='rdsib,0'
Paths from multipath bus adapters:
Path 7: /pci@79,0/pci10de,376@f/pci15b3,36@0/rdsib@rdsib,0
hermon#0 (online)
Device Minor Nodes:
dev=(306,0)
dev_path=/ib/rdsib@0:rdsib
spectype=chr type=minor
rpcib, instance #0
Driver properties:
name='ddi-no-autodetach' type=int items=1 dev=none
value=00000001
Hardware properties:
name='client-guid' type=string items=1
value='rpcib,0'
Paths from multipath bus adapters:
Path 8: /pci@79,0/pci10de,376@f/pci15b3,36@0/rpcib@rpcib,0
hermon#0 (online)
Device Minor Nodes:
dev=(302,0)
dev_path=/ib/rpcib@0:rpcib
spectype=chr type=minor
srpt, instance #0
Hardware properties:
name='client-guid' type=string items=1
value='srpt,0'
Paths from multipath bus adapters:
Path 9: /pci@79,0/pci10de,376@f/pci15b3,36@0/srpt@srpt,0
hermon#0 (online)
Device Minor Nodes:
dev=(293,0)
dev_path=/ib/srpt@0:srpt
spectype=chr type=minor
iser, instance #0
Hardware properties:
name='client-guid' type=string items=1
value='iser,0'
Paths from multipath bus adapters:
Path 10: /pci@79,0/pci10de,376@f/pci15b3,36@0/iser@iser,0
hermon#0 (online)
Device Minor Nodes:
dev=(28,0)
dev_path=/ib/iser@0:iser
spectype=chr type=minor
Updated by Udo Grabowski about 11 years ago
Accidently hit the send button too early...
prtconf -v for the ConnectX-2 VPI is seen above.
/etc/driver_aliases:
hermon "pciex15b3,6340"
hermon "pciex15b3,634a"
hermon "pciex15b3,6732"
hermon "pciex15b3,673c" <=== ConnectX
hermon "pciex15b3,6746" <=== ConnectX-2
hermon "pciex15b3,36"
See also <http://pci-ids.ucw.cz/read/PC/15b3>
Here is missing information:
Two PCI numbers are missing from the /etc/driver_aliases file:
The Mellanox ConnectX-2 VPI dual port QSFP, IB 40 Gb/s PCIe2.0x8 5 GT/s MHQH29C-XTR, which is compatible to
the older ConnectX VPI below this entry and detected as
such if the missing PCI numbers are added to
/etc/driver_aliases:
ddu:
node name: pci15b3,36
Vendor: Mellanox Technologies
Device: MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]
Sub-Vendor: Mellanox Technologies
binding name: pciex15b3,673c
devfs path: /pci@79,0/pci10de,376@f/pci15b3,36@0
bus addr: 0
pci path: 83,0,0
compatible name: (pciex15b3,673c.15b3.36.b0)(pciex15b3,673c.15b3.36)(pciex15b3,673c.b0)(pciex15b3,673c)(pciexclass,0c0600)(pciexclass,0c06)(pci15b3,673c.15b3.36.b0)(pci15b3,673c.15b3.36)(pci15b3,36)(pci15b3,673c.b0)(pci15b3,673c)(pciclass,0c0600)(pciclass,0c06)
driver name: hermon
instance: 0
driver state: Attached
fm-ereport-capable: TRUE
fm-accchk-capable: TRUE
ddi-forceattach: 1
active-dma-flush: 1
ddi-vhci-class: ib
pci-msix-capid-pointer: 9c
assigned-addresses: 83830010
reg: 830000
compatible: pciex15b3,673c.15b3.36.b0
model: InfiniBand
power-consumption: 1
devsel-speed: 0
interrupts: 1
subsystem-vendor-id: 15b3
subsystem-id: 36
unit-address: 0
class-code: c0600
revision-id: b0
vendor-id: 15b3
device-id: 673c
and the onboard, original ConnectX VPI of a Sun X6275 (M1)
Blade, which has nearly the same entries as above:
ddu:
node name: pci15b3,673c
Vendor: Mellanox Technologies
Device: MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]
Sub-Vendor: Mellanox Technologies
binding name: pciex15b3,673c
devfs path: /pci@0,0/pci8086,3410@9/pci15b3,673c@0
bus addr: 0
pci path: 2,0,0
compatible name: (pciex15b3,673c.15b3.673c.a0)(pciex15b3,673c.15b3.673c)(pciex15b3,673c.a0)(pciex15b3,673c)(pciexclass,0c0600)(pciexclass,0c06)(pci15b3,673c.15b3.673c.a0)(pci15b3,673c.15b3.673c)(pci15b3,673c)(pci15b3,673c.a0)(pci15b3,673c)(pciclass,0c0600)(pciclass,0c06)
driver name: hermon
instance: 0
driver state: Attached
fm-ereport-capable: TRUE
fm-accchk-capable: TRUE
ddi-forceattach: 1
active-dma-flush: 1
ddi-vhci-class: ib
pci-msix-capid-pointer: 9c
assigned-addresses: 83020010
reg: 20000
compatible: pciex15b3,673c.15b3.673c.a0
model: InfiniBand
power-consumption: 1
devsel-speed: 0
interrupts: 1
subsystem-vendor-id: 15b3
subsystem-id: 673c
unit-address: 0
class-code: c0600
revision-id: a0
vendor-id: 15b3
device-id: 673c
The hermon driver seems to work with only the missing
numbers added to /etc/driver_aliases, don't know if
there's also something to add in the driver itself.
Updated by Udo Grabowski about 11 years ago
Oops, ConnectX-2 is pciex15b3,36 (but the pciex15b3,6746 is missing, too).
Updated by Jon Strabala about 11 years ago
Hi Udo,
Refer to https://www.illumos.org/issues/1023 for some notes concerning /etc/driver_aliases (for a different issue) but instructions for a hand edit to /etc/driver_aliases and update in your case "update_drv hermon", and reboot, "init 6", are given.
You might also ask for a RTI or better yet make own webrev (to save the core developers time) and then do your own RTI (Request to Integrate) ask for help on IRC - I use http://webchat.freenode.net/ channel #illumos or refer to information in both http://wiki.illumos.org/display/illumos/How+To+Contribute and http://wiki.illumos.org/display/illumos/RTI+Advocacy once done submit by emailing developer@lists.illumos.org