Project

General

Profile

Bug #13054

Ilumos based distros failed to install on FreeBSD's Bhyve

Added by gh origin 2 months ago. Updated 2 months ago.

Status:
New
Priority:
High
Assignee:
-
Category:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:
Medium
Tags:
Gerrit CR:

Description

I have reported everything in details on the FreeBSD forums thread here:

https://forums.freebsd.org/threads/bhyve-illumos.76602/

p/s: Please pardon my ignorant. I don't know what is the suitable category for this so I left that field empty.

#1

Updated by Jason King 2 months ago

What sort of disks are you providing to the VM (since it looks like the problem is with the disks)? virtio-blk devices should work on any relatively recent versions of any illumos distro (you can also use the diskinfo command to see what drives are visible to the instance (you may need to run it twice in a row for reasons that are uninteresting).

#2

Updated by gh origin 2 months ago

Jason King wrote:

What sort of disks are you providing to the VM (since it looks like the problem is with the disks)? virtio-blk devices should work on any relatively recent versions of any illumos distro (you can also use the diskinfo command to see what drives are visible to the instance (you may need to run it twice in a row for reasons that are uninteresting).

First, I tried to use virtio-blk, the iostat -Er command reports the disk information right. But the format utility not happy with it. The installation failed. So I tried to use ahci-hd, now both iostat -Er and format are happy, but the installation still failed. On Tribblix (now using ahci-hd), I set the ashift value manually on sd.conf as my posts on the FreeBSD forums mentioned. It could get into extracting package but finally the installation still fails. I checked with zfs list and zpool list and it reports that there is no datasets or zpools available. But install to UFS on Tribblix success even though the installed system can't boot due to it doesn't support UEFI.

So: it seemed to be a problem with ZFS. I think it failed to create the pool. Install to UFS (read/write to UFS) is fine. So I think the problem is not of the disk.

#3

Updated by gh origin 2 months ago

Jason King wrote:

What sort of disks are you providing to the VM (since it looks like the problem is with the disks)? virtio-blk devices should work on any relatively recent versions of any illumos distro (you can also use the diskinfo command to see what drives are visible to the instance (you may need to run it twice in a row for reasons that are uninteresting).

More information: OmniOS installed fine but the installed system can't boot with the UEFI firmware even though the installation is said to support UEFI. Only OpenIndiana and Tribblix failed to install (to ZFS). And DilOS iso not boot at all with Bhyve's UEFI firmware so I don't know if it could install successfully or not.

#4

Updated by Igor Kozhukhov 2 months ago

DilOS 2.0.2.48 iso contain GRUB1 and it's not boot on UEFI.
i'll prepare new ISO with loader and it'll possible to boot on UEFI.
also we have fix for bhyve on DilOS where we can specify phys block to VM - it'll use correct block size for blkdev.
https://bitbucket.org/dilos/dilos-illumos/commits/9c0b38ca3ab2309e62d5c26a08bd940f75ac5c57
it is commit what we are using a long time without issues and can specify block size to vm as additional property:

-s 3:3,virtio-blk,/vms/dilos-evacuation/disk11.data,sectorsize=512/4096

#5

Updated by gh origin 2 months ago

Igor Kozhukhov wrote:

DilOS 2.0.2.48 iso contain GRUB1 and it's not boot on UEFI.
i'll prepare new ISO with loader and it'll possible to boot on UEFI.
also we have fix for bhyve on DilOS where we can specify phys block to VM - it'll use correct block size for blkdev.
https://bitbucket.org/dilos/dilos-illumos/commits/9c0b38ca3ab2309e62d5c26a08bd940f75ac5c57
it is commit what we are using a long time without issues and can specify block size to vm as additional property:
[...]

Thank you. But I think you misunderstood me. My host is FreeBSD 11.4-p2. I'm using Bhyve via the vm-bhyve frontend and attempted to install the Illumos distros as guests. I'm not using Bhyve on Illumos host.

#6

Updated by gh origin 2 months ago

Igor Kozhukhov wrote:

also we have fix for bhyve on DilOS where we can specify phys block to VM - it'll use correct block size for blkdev.
https://bitbucket.org/dilos/dilos-illumos/commits/9c0b38ca3ab2309e62d5c26a08bd940f75ac5c57
it is commit what we are using a long time without issues and can specify block size to vm as additional property:
[...]

Sorry. I misread your comment. Setting sector size is indeed is the solution. Bhyve on FreeBSD has this option, too.

For vm-bhyve users like me, just add this line to the VM's config file is enough:

disk0_opts="sectorsize=4096/4096"

#7

Updated by gh origin 2 months ago

The issue is resolved. Please close it. Thanks.

Also available in: Atom PDF