illumos gate

oi_148a has a new way on setting-up an IniniBand network
http://arc.opensolaris.org/caselog/PSARC/2010/085/mail

Quoting Garrett - he was 100% correct:

It looks like the administration of IPoIB has changed quite a bit:
You may need to explicitly create an IB partition first.

Creating an IB partition made my network well but it's not documented.

Specificity dladm(1M) does not mention:

• create-part
• delete-part
• show-ib
• show-part

I'm pretty sure dladm(1M) need to be updated.

Also you may what to put the following on the System Administration wiki:

Here is what it takes to get IP over Inifniband on oi_148a:

The default pkey is 0xffff

To verify I used an existing Linux box to lookup the PKEY like this:

cat /sys/class/net/ib1/pkey

On OpenIndiana:

dladm create-part -l ibp1 -P 0xffff pfff.ibp1

ifconfig pffff.ibp1 plumb 192.168.3.233 up
svcadm disable nwam