illumos gate

Is it possible to add a serial console to virtualbox and/or inject an NMI. If you add a serial console, you should be able to get kmdb to function where as the VGA/keyboard is going to be tricky given what's going on in early boot.

Sorry, I missed the update here. I forgot that the illumos default wasn't to drop into kmdb. Is it easy to edit the /etc/system on that if you disable xhci initially? If so, you should set the following in /etc/system:

set pcplusmp:apic_kmdb_on_nmi=1
set apix:apic_kmdb_on_nmi=1

Then you should be able to boot and add a -k option to the bootloader. When we then nmi, we should be able to drop into kmdb. At which point you'd want to run something like:

::stacks -m xhci

Hmm, interesting. So in this case we have a thread in the USB stack stuck waiting for the xhci driver to do something it seems like. I wonder if we lost some notification. If you look at the stack output, you'll see this entry:

ffffff000536ec40 SLEEP    CV                      1
                 swtch+0x141
                 cv_wait+0x70
                 delay_common+0xb8
                 delay+0x30
                 usba`usba_drain_cbs+0xd5
                 usba`usba_pipe_sync_stop_intr_polling+0xc4
                 usba`usba_pipe_setup_func_call+0xf7
                 usba`usb_pipe_stop_intr_polling+0xbb
                 usba`hubd_stop_polling+0x3f
                 usba`hubd_hotplug_thread+0x12f
                 taskq_d_thread+0xb7
                 thread_start+8

So, there are a few questions I have. If you get it into this state, could you run the following items?

::cpuinfo -v
::ptree
::stacks -m usba

For each stack that comes out of the last command, could you grab the address at the top of the stack and run:

addr::findstack -v

I'm going to go see if I can vbox set up somewhere and test out as well.

It's still the case with OpenIndiana 2017.10 with illumos from 20171229 on VirtualBox 5.2 with appropriate xHCI from extension pack: https://openqa.oi.mnowak.cz/tests/2364#step/bootloader_textmode/7. Just the warning is now gone.