Project

General

Profile

Bug #12268

panic: cmd is active, task = ffffff08c74b2800

Added by Prasad Krishnamurthy 6 months ago.

Status:
New
Priority:
High
Assignee:
-
Category:
comstar - iSCSI/FC/SAS target
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:
Medium
Tags:
Gerrit CR:

Description

This issue is comming up in latest OmniOS

OmniOS ZFS Storage(FC Target) FC Volume is connected Hitachi HUS-VM for Storage Replication. While replicating, at the end of replication, OmniOS panics and reboots.

Here is the detail:

@# cat /etc/release
OmniOS v11 r151030ah
Copyright 2017 OmniTI Computer Consulting, Inc. All rights reserved.
Copyright 2017-2019 OmniOS Community Edition (OmniOSce) Association.
All rights reserved. Use is subject to licence terms.

system message:
Jan 30 10:24:44 filerz07 savecore: [ID 570001 auth.error] reboot after panic: cmd is active, task = ffffff08c74b2800
Jan 30 11:00:19 filerz07 unix: [ID 836849 kern.notice]
Jan 30 11:00:19 filerz07 ^Mpanic[cpu2]/thread=fffffe016edffc20:
Jan 30 11:00:19 filerz07 genunix: [ID 960941 kern.notice] cmd is active, task = ffffff08c294f000
Jan 30 11:00:19 filerz07 unix: [ID 100000 kern.notice]
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edff9c0 genunix:cmn_err+66 ()
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edff9f0 stmf_sbd:sbd_task_free+4e ()
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edffa50 stmf:stmf_task_lu_check_freelist+9f ()
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edffa70 stmf:stmf_check_freetask+8a ()
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edffad0 stmf:stmf_svc_timeout+1c5 ()
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edffb40 stmf:stmf_svc+1c0 ()
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edffc00 genunix:taskq_thread+2d0 ()
Jan 30 11:00:20 filerz07 genunix: [ID 655072 kern.notice] fffffe016edffc10 unix:thread_start+8 ()
Jan 30 11:00:21 filerz07 unix: [ID 100000 kern.notice]
Jan 30 11:00:21 filerz07 genunix: [ID 111219 kern.notice] dumping to /dev/zvol/dsk/rpool1/dump, offset 65536, content: kernel + curproc
Jan 30 11:01:31 filerz07 genunix: [ID 100000 kern.notice]
Jan 30 11:01:31 filerz07 genunix: [ID 665016 kern.notice] ^M100% done: 2653328 pages dumped,
Jan 30 11:01:31 filerz07 genunix: [ID 851671 kern.notice] dump succeeded

  1. fmdump -Vp -u ca1bd850-15a5-651f-a6db-e0e1fdc64911
    TIME UUID SUNW-MSG-ID
    Jan 30 2020 11:11:13.480027000 ca1bd850-15a5-651f-a6db-e0e1fdc64911 SUNOS-8000-KL

    TIME CLASS ENA
    Jan 30 11:08:27.8530 ireport.os.sunos.panic.dump_available 0x0000000000000000
    Jan 30 11:08:10.8575 ireport.os.sunos.panic.dump_pending_on_device 0x0000000000000000

nvlist version: 0
version = 0x0
class = list.suspect
uuid = ca1bd850-15a5-651f-a6db-e0e1fdc64911
code = SUNOS-8000-KL
diag-time = 1580362873 476166
de = fmd:///module/software-diagnosis
fault-list-sz = 0x1
fault-list = (array of embedded nvlists)
(start fault-list0)
nvlist version: 0
version = 0x0
class = defect.sunos.kernel.panic
certainty = 0x64
asru = sw:///:path=/var/crash//.ca1bd850-15a5-651f-a6db-e0e1fdc64911
resource = sw:///:path=/var/crash//.ca1bd850-15a5-651f-a6db-e0e1fdc64911
savecore-succcess = 1
dump-dir = /var/crash/
dump-files = vmdump.2
os-instance-uuid = ca1bd850-15a5-651f-a6db-e0e1fdc64911
panicstr = cmd is active, task = ffffff08c294f000
panicstack = genunix:cmn_err+66 () | stmf_sbd:sbd_task_free+4e () | stmf:stmf_task_lu_check_freelist+9f () | stmf:stmf_check_freetask+8a () | stmf:stmf_svc_timeout+1c5 () | stmf:stmf_svc+1c0 () | genunix:taskq_thread+2d0 () | unix:thread_start+8 () |
crashtime = 1580362221
panic-time = Thu Jan 30 11:00:21 2020 IST
(end fault-list0)

fault-status = 0x1
severity = Major
__ttl = 0x1
__tod = 0x5e326c79 0x1c9ca178
  1. mdb -k 2

::status

debugging crash dump vmcore.2 (64-bit) from filerz07
operating system: 5.11 omnios-r151030-521a1fc4d1 (i86pc)
image uuid: ca1bd850-15a5-651f-a6db-e0e1fdc64911
panic message: cmd is active, task = ffffff08c294f000
dump content: kernel pages only
(curproc requested, but a kernel thread panicked)

::stack

vpanic()
cmn_err+0x66(3, fffffffff7e40230)
sbd_task_free+0x4e(ffffff08c294f000)
stmf_task_lu_check_freelist+0x9f(ffffff0878afa950)
stmf_check_freetask+0x8a()
stmf_svc_timeout+0x1c5(fffffe016edffae0)
stmf_svc+0x1c0(0)
taskq_thread+0x2d0(ffffff0874aeb938)
thread_start+8()

::system

set noexec_user_stack=0x1 [0t1]
set noexec_user_stack_log=0x1 [0t1]
set rlim_fd_cur=0x10000 [0t65536]
set idle_cpu_no_deep_c=0x1 [0t1]
set ip:ip_squeue_fanout=0x1 [0t1]
set pcplusmp:apic_panic_on_nmi=0x1 [0t1]
set apix:apic_panic_on_nmi=0x1 [0t1]
set dump_metrics_on=0x1 [0t1]
set dump_plat_mincpu=0x0 [0t0]
set dump_bzip2_level=0x1 [0t1]
set pcplusmp:apic_timer_preferred_mode=0x0 [0t0]
set apix:apic_timer_preferred_mode=0x0 [0t0]
set sata:sata_auto_online=0x1 [0t1]
set sd:sd_io_time=0xa [0t10]
set hires_tick=0x1 [0t1]
set zfs:zfs_arc_max=0x2800000000 [0t171798691840]

$C

fffffe016edff930 vpanic()
fffffe016edff9c0 cmn_err+0x66(3, fffffffff7e40230)
fffffe016edff9f0 sbd_task_free+0x4e(ffffff08c294f000)
fffffe016edffa50 stmf_task_lu_check_freelist+0x9f(ffffff0878afa950)
fffffe016edffa70 stmf_check_freetask+0x8a()
fffffe016edffad0 stmf_svc_timeout+0x1c5(fffffe016edffae0)
fffffe016edffb40 stmf_svc+0x1c0(0)
fffffe016edffc00 taskq_thread+0x2d0(ffffff0874aeb938)
fffffe016edffc10 thread_start+8()
@

Also available in: Atom PDF