Bug #13094
closedsystems have more kmem caches than they used to
100%
Description
The kmem_taskq
is used for various house keeping functions within the kernel memory allocator. One of the most important tasks it can perform is kmem_reap()
, where a task is dispatched for each kmem cache that exists on the system.
The taskq_dispatch_ent()
routine, which allows the use of a taskq entry embedded within a larger structure, did not yet exist (as far as I know) when this facility was designed. As such, the kmem taskq is using TASKQ_PREPOPULATE
with 300 entries that get allocated at system boot and are always available. Over time, we have increased the number of kmem caches in the system. Looking at a current illumos system which has undergone a reap, we can see that the maximum queue depth has been as high as 485:
> ::taskq -n kmem ADDR NAME ACT/THDS Q'ED MAXQ INST fffffe2ce0619d88 kmem_move_taskq 0/ 1 0 211820 0 fffffe2ce0619c68 kmem_taskq 0/ 1 0 485 0
Reaping is most critical to complete when the system is almost out of memory. Unfortunately, it seems that this means we might at times not be able to allocate taskq entries for at least a hundred kmem caches that exist.
The lowest risk change here seems to be to bump the prepopulation count to something like 600 entries. At 56 bytes a piece, this is only another 16KB or so. A more invasive change would move to using taskq entries that are included within the kmem_cache_t
itself, but for now simply bumping the count seems expedient.
Updated by Joshua M. Clulow over 1 year ago
Testing Notes¶
I've been using this change as part of the pageout improvement series I've been working on, but I have also explicitly built and booted it to confirm that it is having the desired effect by itself.
On a system before the change:
> ::taskq -n kmem_taskq | ::print -d taskq_t tq_minalloc tq_nalloc tq_minalloc = 0t300 tq_nalloc = 0t300 > ::taskq -n kmem_taskq | ::print -d taskq_t tq_freelist | ::list taskq_ent_t tqent_next ! wc -l 300
On a system after the change is installed:
> ::taskq -n kmem_taskq | ::print -d taskq_t tq_minalloc tq_nalloc tq_minalloc = 0t600 tq_nalloc = 0t600 > ::taskq -n kmem_taskq | ::print -d taskq_t tq_freelist | ::list taskq_ent_t tqent_next ! wc -l 600
Updated by Joshua M. Clulow over 1 year ago
Testing Notes (Additional)¶
Confirming that reaping is in fact not broken using this DTrace script:
#!/usr/sbin/dtrace -qs BEGIN { start = walltimestamp; reapstart = 0; } fbt::kmem_reap:entry { printf("%8u %s() kmem_reaping = %u\n", (walltimestamp - start) / 1000000, probefunc, `kmem_reaping); } fbt::kmem_reap_common:entry { self->x = 1; } fbt::taskq_dispatch:entry /self->x/ { printf("%8u dispatch kmem_reap_start()!\n", (walltimestamp - start) / 1000000); } fbt::kmem_reap_common:return /self->x/ { self->x = 0; } fbt::kmem_reap_start:entry { reapstart = timestamp; self->x2 = timestamp; self->x2ok = 0; self->x2fails = 0; } fbt::taskq_dispatch:return /self->x2/ { if (arg1 == 0) { self->x2fails += 1; } else { self->x2ok += 1; } } fbt::kmem_reap_start:return /self->x2/ { printf("%8u %Y: %s() complete, dur. %u ms, tasks: %u ok, %u failed\n", (walltimestamp - start) / 1000000, walltimestamp, probefunc, (timestamp - self->x2) / 1000000, self->x2ok, self->x2fails); self->x2 = 0; self->x2ok = 0; self->x2fails = 0; } fbt::kmem_cache_reap:entry /reapstart/ { self->cr_cache = args[0]; self->cr_start = timestamp; printf("%8u starting %s(%s)\n", (walltimestamp - start) / 1000000, probefunc, args[0]->cache_name); } fbt::kmem_cache_reap:return /self->cr_start/ { this->dur = (timestamp - self->cr_start) / 1000000; printf("%8u finished %s(%s); dur. %u ms\n", (walltimestamp - start) / 1000000, probefunc, self->cr_cache->cache_name, this->dur); self->cr_start = 0; self->cr_cache = 0; } fbt::kmem_reap_done:entry /reapstart/ { printf("%8u %s()! took %lu ms\n", (walltimestamp - start) / 1000000, probefunc, (timestamp - reapstart) / 1000000); reapstart = 0; } fbt::kmem_reap_timeout:entry { printf("%8u %s()!\n", (walltimestamp - start) / 1000000, probefunc); } tick-1s { printf("%8u %Y: kmem_reaping = %u\n", (walltimestamp - start) / 1000000, walltimestamp, `kmem_reaping); }
I started the trace and then ran the system out of memory, and:
$ pfexec ./reap.d 975 2020 Sep 17 21:35:53: kmem_reaping = 0 1975 2020 Sep 17 21:35:54: kmem_reaping = 0 2975 2020 Sep 17 21:35:55: kmem_reaping = 0 3975 2020 Sep 17 21:35:56: kmem_reaping = 0 4975 2020 Sep 17 21:35:57: kmem_reaping = 0 5975 2020 Sep 17 21:35:58: kmem_reaping = 0 6975 2020 Sep 17 21:35:59: kmem_reaping = 0 7975 2020 Sep 17 21:36:00: kmem_reaping = 0 8975 2020 Sep 17 21:36:01: kmem_reaping = 0 9975 2020 Sep 17 21:36:02: kmem_reaping = 0 10975 2020 Sep 17 21:36:03: kmem_reaping = 0 11975 2020 Sep 17 21:36:04: kmem_reaping = 0 12975 2020 Sep 17 21:36:05: kmem_reaping = 0 13974 2020 Sep 17 21:36:06: kmem_reaping = 0 14974 2020 Sep 17 21:36:07: kmem_reaping = 0 15974 2020 Sep 17 21:36:08: kmem_reaping = 0 16974 2020 Sep 17 21:36:09: kmem_reaping = 0 17974 2020 Sep 17 21:36:10: kmem_reaping = 0 18974 2020 Sep 17 21:36:11: kmem_reaping = 0 19974 2020 Sep 17 21:36:12: kmem_reaping = 0 20974 2020 Sep 17 21:36:13: kmem_reaping = 0 21974 2020 Sep 17 21:36:14: kmem_reaping = 0 22974 2020 Sep 17 21:36:15: kmem_reaping = 0 23974 2020 Sep 17 21:36:16: kmem_reaping = 0 24974 2020 Sep 17 21:36:17: kmem_reaping = 0 25973 2020 Sep 17 21:36:18: kmem_reaping = 0 26973 2020 Sep 17 21:36:19: kmem_reaping = 0 27973 2020 Sep 17 21:36:20: kmem_reaping = 0 28973 2020 Sep 17 21:36:21: kmem_reaping = 0 29973 2020 Sep 17 21:36:22: kmem_reaping = 0 30973 2020 Sep 17 21:36:23: kmem_reaping = 0 31973 2020 Sep 17 21:36:24: kmem_reaping = 0 32973 2020 Sep 17 21:36:25: kmem_reaping = 0 33973 2020 Sep 17 21:36:26: kmem_reaping = 0 34973 2020 Sep 17 21:36:27: kmem_reaping = 0 35973 2020 Sep 17 21:36:28: kmem_reaping = 0 36973 2020 Sep 17 21:36:29: kmem_reaping = 0 37972 2020 Sep 17 21:36:30: kmem_reaping = 0 38972 2020 Sep 17 21:36:31: kmem_reaping = 0 39972 2020 Sep 17 21:36:32: kmem_reaping = 0 40972 2020 Sep 17 21:36:33: kmem_reaping = 0 41973 2020 Sep 17 21:36:34: kmem_reaping = 0 42972 2020 Sep 17 21:36:35: kmem_reaping = 0 43972 2020 Sep 17 21:36:36: kmem_reaping = 0 44972 2020 Sep 17 21:36:37: kmem_reaping = 0 45972 2020 Sep 17 21:36:38: kmem_reaping = 0 46972 2020 Sep 17 21:36:39: kmem_reaping = 0 47972 2020 Sep 17 21:36:40: kmem_reaping = 0 48972 2020 Sep 17 21:36:41: kmem_reaping = 0 49971 2020 Sep 17 21:36:42: kmem_reaping = 0 50971 2020 Sep 17 21:36:43: kmem_reaping = 0 51971 2020 Sep 17 21:36:44: kmem_reaping = 0 52971 2020 Sep 17 21:36:45: kmem_reaping = 0 53971 2020 Sep 17 21:36:46: kmem_reaping = 0 54971 2020 Sep 17 21:36:47: kmem_reaping = 0 55971 2020 Sep 17 21:36:48: kmem_reaping = 0 56971 2020 Sep 17 21:36:49: kmem_reaping = 0 57971 2020 Sep 17 21:36:50: kmem_reaping = 0 58971 2020 Sep 17 21:36:51: kmem_reaping = 0 59971 2020 Sep 17 21:36:52: kmem_reaping = 0 60181 kmem_reap() kmem_reaping = 0 60182 dispatch kmem_reap_start()! 60185 2020 Sep 17 21:36:52: kmem_reap_start() complete, dur. 3 ms, tasks: 466 ok, 0 failed 60185 starting kmem_cache_reap(kmem_magazine_1) 60185 finished kmem_cache_reap(kmem_magazine_1); dur. 0 ms 60185 starting kmem_cache_reap(kmem_magazine_3) 60188 finished kmem_cache_reap(kmem_magazine_3); dur. 3 ms 60188 starting kmem_cache_reap(kmem_magazine_7) 60188 finished kmem_cache_reap(kmem_magazine_7); dur. 0 ms 60188 starting kmem_cache_reap(kmem_magazine_15) 60233 finished kmem_cache_reap(kmem_magazine_15); dur. 45 ms 60233 starting kmem_cache_reap(kmem_magazine_31) 60233 finished kmem_cache_reap(kmem_magazine_31); dur. 0 ms 60233 starting kmem_cache_reap(kmem_magazine_47) 60233 finished kmem_cache_reap(kmem_magazine_47); dur. 0 ms 60233 starting kmem_cache_reap(kmem_magazine_63) 60234 finished kmem_cache_reap(kmem_magazine_63); dur. 0 ms 60234 starting kmem_cache_reap(kmem_magazine_95) 60234 finished kmem_cache_reap(kmem_magazine_95); dur. 0 ms 60234 starting kmem_cache_reap(kmem_magazine_143) 60234 finished kmem_cache_reap(kmem_magazine_143); dur. 0 ms 60234 starting kmem_cache_reap(kmem_slab_cache) 60235 finished kmem_cache_reap(kmem_slab_cache); dur. 1 ms 60235 starting kmem_cache_reap(kmem_bufctl_cache) 60238 finished kmem_cache_reap(kmem_bufctl_cache); dur. 2 ms 60238 starting kmem_cache_reap(kmem_bufctl_audit_cache) 60238 finished kmem_cache_reap(kmem_bufctl_audit_cache); dur. 0 ms 60238 starting kmem_cache_reap(kmem_va_4096) 60240 finished kmem_cache_reap(kmem_va_4096); dur. 2 ms 60240 starting kmem_cache_reap(kmem_va_8192) 60240 finished kmem_cache_reap(kmem_va_8192); dur. 0 ms 60240 starting kmem_cache_reap(kmem_va_12288) 60240 finished kmem_cache_reap(kmem_va_12288); dur. 0 ms 60240 starting kmem_cache_reap(kmem_va_16384) 60240 finished kmem_cache_reap(kmem_va_16384); dur. 0 ms 60240 starting kmem_cache_reap(kmem_va_20480) 60240 finished kmem_cache_reap(kmem_va_20480); dur. 0 ms 60240 starting kmem_cache_reap(kmem_va_24576) 60240 finished kmem_cache_reap(kmem_va_24576); dur. 0 ms 60240 starting kmem_cache_reap(kmem_va_28672) 60240 finished kmem_cache_reap(kmem_va_28672); dur. 0 ms 60240 starting kmem_cache_reap(kmem_va_32768) 60240 finished kmem_cache_reap(kmem_va_32768); dur. 0 ms 60240 starting kmem_cache_reap(kmem_alloc_8) 60241 finished kmem_cache_reap(kmem_alloc_8); dur. 0 ms 60241 starting kmem_cache_reap(kmem_alloc_16) 60241 finished kmem_cache_reap(kmem_alloc_16); dur. 0 ms 60241 starting kmem_cache_reap(kmem_alloc_24) 60241 finished kmem_cache_reap(kmem_alloc_24); dur. 0 ms 60241 starting kmem_cache_reap(kmem_alloc_32) 60241 finished kmem_cache_reap(kmem_alloc_32); dur. 0 ms 60241 starting kmem_cache_reap(kmem_alloc_40) 60241 finished kmem_cache_reap(kmem_alloc_40); dur. 0 ms 60241 starting kmem_cache_reap(kmem_alloc_48) 60242 finished kmem_cache_reap(kmem_alloc_48); dur. 1 ms 60242 starting kmem_cache_reap(kmem_alloc_56) 60242 finished kmem_cache_reap(kmem_alloc_56); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_64) 60242 finished kmem_cache_reap(kmem_alloc_64); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_80) 60242 finished kmem_cache_reap(kmem_alloc_80); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_96) 60242 finished kmem_cache_reap(kmem_alloc_96); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_112) 60242 finished kmem_cache_reap(kmem_alloc_112); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_128) 60242 finished kmem_cache_reap(kmem_alloc_128); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_160) 60242 finished kmem_cache_reap(kmem_alloc_160); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_192) 60242 finished kmem_cache_reap(kmem_alloc_192); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_224) 60242 finished kmem_cache_reap(kmem_alloc_224); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_256) 60242 finished kmem_cache_reap(kmem_alloc_256); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_320) 60242 finished kmem_cache_reap(kmem_alloc_320); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_384) 60242 finished kmem_cache_reap(kmem_alloc_384); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_448) 60242 finished kmem_cache_reap(kmem_alloc_448); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_512) 60242 finished kmem_cache_reap(kmem_alloc_512); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_640) 60242 finished kmem_cache_reap(kmem_alloc_640); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_768) 60242 finished kmem_cache_reap(kmem_alloc_768); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_896) 60242 finished kmem_cache_reap(kmem_alloc_896); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_1152) 60242 finished kmem_cache_reap(kmem_alloc_1152); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_1344) 60242 finished kmem_cache_reap(kmem_alloc_1344); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_1600) 60242 finished kmem_cache_reap(kmem_alloc_1600); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_2048) 60242 finished kmem_cache_reap(kmem_alloc_2048); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_2688) 60242 finished kmem_cache_reap(kmem_alloc_2688); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_4096) 60242 finished kmem_cache_reap(kmem_alloc_4096); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_8192) 60242 finished kmem_cache_reap(kmem_alloc_8192); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_12288) 60242 finished kmem_cache_reap(kmem_alloc_12288); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_16384) 60242 finished kmem_cache_reap(kmem_alloc_16384); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_24576) 60242 finished kmem_cache_reap(kmem_alloc_24576); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_32768) 60242 finished kmem_cache_reap(kmem_alloc_32768); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_40960) 60242 finished kmem_cache_reap(kmem_alloc_40960); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_49152) 60242 finished kmem_cache_reap(kmem_alloc_49152); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_57344) 60242 finished kmem_cache_reap(kmem_alloc_57344); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_65536) 60242 finished kmem_cache_reap(kmem_alloc_65536); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_73728) 60242 finished kmem_cache_reap(kmem_alloc_73728); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_81920) 60242 finished kmem_cache_reap(kmem_alloc_81920); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_90112) 60242 finished kmem_cache_reap(kmem_alloc_90112); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_98304) 60242 finished kmem_cache_reap(kmem_alloc_98304); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_106496) 60242 finished kmem_cache_reap(kmem_alloc_106496); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_114688) 60242 finished kmem_cache_reap(kmem_alloc_114688); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_122880) 60242 finished kmem_cache_reap(kmem_alloc_122880); dur. 0 ms 60242 starting kmem_cache_reap(kmem_alloc_131072) 60242 finished kmem_cache_reap(kmem_alloc_131072); dur. 0 ms 60242 starting kmem_cache_reap(streams_mblk) 60242 finished kmem_cache_reap(streams_mblk); dur. 0 ms 60242 starting kmem_cache_reap(streams_dblk_16) 60242 finished kmem_cache_reap(streams_dblk_16); dur. 0 ms 60242 starting kmem_cache_reap(streams_dblk_80) 60243 finished kmem_cache_reap(streams_dblk_80); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_144) 60243 finished kmem_cache_reap(streams_dblk_144); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_208) 60243 finished kmem_cache_reap(streams_dblk_208); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_272) 60243 finished kmem_cache_reap(streams_dblk_272); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_336) 60243 finished kmem_cache_reap(streams_dblk_336); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_528) 60243 finished kmem_cache_reap(streams_dblk_528); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_1040) 60243 finished kmem_cache_reap(streams_dblk_1040); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_1488) 60243 finished kmem_cache_reap(streams_dblk_1488); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_1936) 60243 finished kmem_cache_reap(streams_dblk_1936); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_2576) 60243 finished kmem_cache_reap(streams_dblk_2576); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_3856) 60243 finished kmem_cache_reap(streams_dblk_3856); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_8192) 60243 finished kmem_cache_reap(streams_dblk_8192); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_12048) 60243 finished kmem_cache_reap(streams_dblk_12048); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_16384) 60243 finished kmem_cache_reap(streams_dblk_16384); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_20240) 60243 finished kmem_cache_reap(streams_dblk_20240); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_24576) 60243 finished kmem_cache_reap(streams_dblk_24576); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_28432) 60243 finished kmem_cache_reap(streams_dblk_28432); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_32768) 60243 finished kmem_cache_reap(streams_dblk_32768); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_36624) 60243 finished kmem_cache_reap(streams_dblk_36624); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_40960) 60243 finished kmem_cache_reap(streams_dblk_40960); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_44816) 60243 finished kmem_cache_reap(streams_dblk_44816); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_49152) 60243 finished kmem_cache_reap(streams_dblk_49152); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_53008) 60243 finished kmem_cache_reap(streams_dblk_53008); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_57344) 60243 finished kmem_cache_reap(streams_dblk_57344); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_61200) 60243 finished kmem_cache_reap(streams_dblk_61200); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_65536) 60243 finished kmem_cache_reap(streams_dblk_65536); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_69392) 60243 finished kmem_cache_reap(streams_dblk_69392); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_73728) 60243 finished kmem_cache_reap(streams_dblk_73728); dur. 0 ms 60243 starting kmem_cache_reap(streams_dblk_esb) 60243 finished kmem_cache_reap(streams_dblk_esb); dur. 0 ms 60243 starting kmem_cache_reap(streams_fthdr) 60243 finished kmem_cache_reap(streams_fthdr); dur. 0 ms 60243 starting kmem_cache_reap(streams_ftblk) 60243 finished kmem_cache_reap(streams_ftblk); dur. 0 ms 60243 starting kmem_cache_reap(multidata) 60243 finished kmem_cache_reap(multidata); dur. 0 ms 60243 starting kmem_cache_reap(multidata_pdslab) 60243 finished kmem_cache_reap(multidata_pdslab); dur. 0 ms 60243 starting kmem_cache_reap(multidata_pattbl) 60243 finished kmem_cache_reap(multidata_pattbl); dur. 0 ms 60243 starting kmem_cache_reap(log_cons_cache) 60243 finished kmem_cache_reap(log_cons_cache); dur. 0 ms 60243 starting kmem_cache_reap(taskq_ent_cache) 60243 finished kmem_cache_reap(taskq_ent_cache); dur. 0 ms 60243 starting kmem_cache_reap(taskq_cache) 60243 finished kmem_cache_reap(taskq_cache); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_64G_128) 60243 finished kmem_cache_reap(kmem_io_64G_128); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_64G_256) 60243 finished kmem_cache_reap(kmem_io_64G_256); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_64G_512) 60243 finished kmem_cache_reap(kmem_io_64G_512); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_64G_1024) 60243 finished kmem_cache_reap(kmem_io_64G_1024); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_64G_2048) 60243 finished kmem_cache_reap(kmem_io_64G_2048); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_64G_4096) 60243 finished kmem_cache_reap(kmem_io_64G_4096); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_4G_128) 60243 finished kmem_cache_reap(kmem_io_4G_128); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_4G_256) 60243 finished kmem_cache_reap(kmem_io_4G_256); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_4G_512) 60243 finished kmem_cache_reap(kmem_io_4G_512); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_4G_1024) 60243 finished kmem_cache_reap(kmem_io_4G_1024); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_4G_2048) 60243 finished kmem_cache_reap(kmem_io_4G_2048); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_4G_4096) 60243 finished kmem_cache_reap(kmem_io_4G_4096); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_2G_128) 60243 finished kmem_cache_reap(kmem_io_2G_128); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_2G_256) 60243 finished kmem_cache_reap(kmem_io_2G_256); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_2G_512) 60243 finished kmem_cache_reap(kmem_io_2G_512); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_2G_1024) 60243 finished kmem_cache_reap(kmem_io_2G_1024); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_2G_2048) 60243 finished kmem_cache_reap(kmem_io_2G_2048); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_2G_4096) 60243 finished kmem_cache_reap(kmem_io_2G_4096); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_16M_128) 60243 finished kmem_cache_reap(kmem_io_16M_128); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_16M_256) 60243 finished kmem_cache_reap(kmem_io_16M_256); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_16M_512) 60243 finished kmem_cache_reap(kmem_io_16M_512); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_16M_1024) 60243 finished kmem_cache_reap(kmem_io_16M_1024); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_16M_2048) 60243 finished kmem_cache_reap(kmem_io_16M_2048); dur. 0 ms 60243 starting kmem_cache_reap(kmem_io_16M_4096) 60243 finished kmem_cache_reap(kmem_io_16M_4096); dur. 0 ms 60243 starting kmem_cache_reap(id32_cache) 60243 finished kmem_cache_reap(id32_cache); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_4096) 60243 finished kmem_cache_reap(bp_map_4096); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_8192) 60243 finished kmem_cache_reap(bp_map_8192); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_12288) 60243 finished kmem_cache_reap(bp_map_12288); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_16384) 60243 finished kmem_cache_reap(bp_map_16384); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_20480) 60243 finished kmem_cache_reap(bp_map_20480); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_24576) 60243 finished kmem_cache_reap(bp_map_24576); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_28672) 60243 finished kmem_cache_reap(bp_map_28672); dur. 0 ms 60243 starting kmem_cache_reap(bp_map_32768) 60243 finished kmem_cache_reap(bp_map_32768); dur. 0 ms 60243 starting kmem_cache_reap(htable_t) 60243 finished kmem_cache_reap(htable_t); dur. 0 ms 60243 starting kmem_cache_reap(hment_t) 60243 finished kmem_cache_reap(hment_t); dur. 0 ms 60243 starting kmem_cache_reap(hat_t) 60243 finished kmem_cache_reap(hat_t); dur. 0 ms 60243 starting kmem_cache_reap(HatHash) 60243 finished kmem_cache_reap(HatHash); dur. 0 ms 60243 starting kmem_cache_reap(Hat32Hash) 60243 finished kmem_cache_reap(Hat32Hash); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_4096) 60243 finished kmem_cache_reap(zfs_file_data_4096); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_8192) 60243 finished kmem_cache_reap(zfs_file_data_8192); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_12288) 60243 finished kmem_cache_reap(zfs_file_data_12288); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_16384) 60243 finished kmem_cache_reap(zfs_file_data_16384); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_20480) 60243 finished kmem_cache_reap(zfs_file_data_20480); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_24576) 60243 finished kmem_cache_reap(zfs_file_data_24576); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_28672) 60243 finished kmem_cache_reap(zfs_file_data_28672); dur. 0 ms 60243 starting kmem_cache_reap(zfs_file_data_32768) 60243 finished kmem_cache_reap(zfs_file_data_32768); dur. 0 ms 60243 starting kmem_cache_reap(segkp_4096) 60243 finished kmem_cache_reap(segkp_4096); dur. 0 ms 60243 starting kmem_cache_reap(segkp_8192) 60243 finished kmem_cache_reap(segkp_8192); dur. 0 ms 60243 starting kmem_cache_reap(segkp_12288) 60243 finished kmem_cache_reap(segkp_12288); dur. 0 ms 60243 starting kmem_cache_reap(segkp_16384) 60243 finished kmem_cache_reap(segkp_16384); dur. 0 ms 60243 starting kmem_cache_reap(segkp_20480) 60243 finished kmem_cache_reap(segkp_20480); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_4096) 60243 finished kmem_cache_reap(umem_np_4096); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_8192) 60243 finished kmem_cache_reap(umem_np_8192); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_12288) 60243 finished kmem_cache_reap(umem_np_12288); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_16384) 60243 finished kmem_cache_reap(umem_np_16384); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_20480) 60243 finished kmem_cache_reap(umem_np_20480); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_24576) 60243 finished kmem_cache_reap(umem_np_24576); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_28672) 60243 finished kmem_cache_reap(umem_np_28672); dur. 0 ms 60243 starting kmem_cache_reap(umem_np_32768) 60243 finished kmem_cache_reap(umem_np_32768); dur. 0 ms 60243 starting kmem_cache_reap(mod_hash_entries) 60243 finished kmem_cache_reap(mod_hash_entries); dur. 0 ms 60243 starting kmem_cache_reap(ipp_mod) 60243 finished kmem_cache_reap(ipp_mod); dur. 0 ms 60243 starting kmem_cache_reap(ipp_action) 60243 finished kmem_cache_reap(ipp_action); dur. 0 ms 60243 starting kmem_cache_reap(ipp_packet) 60243 finished kmem_cache_reap(ipp_packet); dur. 0 ms 60243 starting kmem_cache_reap(seg_cache) 60243 finished kmem_cache_reap(seg_cache); dur. 0 ms 60243 starting kmem_cache_reap(seg_pcache) 60243 finished kmem_cache_reap(seg_pcache); dur. 0 ms 60243 starting kmem_cache_reap(fnode_cache) 60243 finished kmem_cache_reap(fnode_cache); dur. 0 ms 60243 starting kmem_cache_reap(pipe_cache) 60243 finished kmem_cache_reap(pipe_cache); dur. 0 ms 60243 starting kmem_cache_reap(snode_cache) 60243 finished kmem_cache_reap(snode_cache); dur. 0 ms 60243 starting kmem_cache_reap(dv_node_cache) 60243 finished kmem_cache_reap(dv_node_cache); dur. 0 ms 60243 starting kmem_cache_reap(mac_impl_cache) 60243 finished kmem_cache_reap(mac_impl_cache); dur. 0 ms 60243 starting kmem_cache_reap(mac_ring_cache) 60243 finished kmem_cache_reap(mac_ring_cache); dur. 0 ms 60243 starting kmem_cache_reap(flow_entry_cache) 60243 finished kmem_cache_reap(flow_entry_cache); dur. 0 ms 60243 starting kmem_cache_reap(flow_tab_cache) 60243 finished kmem_cache_reap(flow_tab_cache); dur. 0 ms 60243 starting kmem_cache_reap(mac_soft_ring_cache) 60243 finished kmem_cache_reap(mac_soft_ring_cache); dur. 0 ms 60243 starting kmem_cache_reap(mac_srs_cache) 60243 finished kmem_cache_reap(mac_srs_cache); dur. 0 ms 60243 starting kmem_cache_reap(mac_bcast_grp_cache) 60243 finished kmem_cache_reap(mac_bcast_grp_cache); dur. 0 ms 60243 starting kmem_cache_reap(mac_client_impl_cache) 60243 finished kmem_cache_reap(mac_client_impl_cache); dur. 0 ms 60243 starting kmem_cache_reap(mac_promisc_impl_cache) 60243 finished kmem_cache_reap(mac_promisc_impl_cache); dur. 0 ms 60243 starting kmem_cache_reap(dls_link_cache) 60243 finished kmem_cache_reap(dls_link_cache); dur. 0 ms 60243 starting kmem_cache_reap(dls_devnet_cache) 60243 finished kmem_cache_reap(dls_devnet_cache); dur. 0 ms 60243 starting kmem_cache_reap(sdev_node_cache) 60243 finished kmem_cache_reap(sdev_node_cache); dur. 0 ms 60243 starting kmem_cache_reap(sdev_plugin) 60243 finished kmem_cache_reap(sdev_plugin); dur. 0 ms 60243 starting kmem_cache_reap(namefs_inodes_1) 60243 finished kmem_cache_reap(namefs_inodes_1); dur. 0 ms 60243 starting kmem_cache_reap(dev_info_node_cache) 60243 finished kmem_cache_reap(dev_info_node_cache); dur. 0 ms 60243 starting kmem_cache_reap(ndi_fm_entry_cache) 60243 finished kmem_cache_reap(ndi_fm_entry_cache); dur. 0 ms 60243 starting kmem_cache_reap(thread_cache) 60244 finished kmem_cache_reap(thread_cache); dur. 0 ms 60244 starting kmem_cache_reap(lwp_cache) 60244 finished kmem_cache_reap(lwp_cache); dur. 0 ms 60244 starting kmem_cache_reap(turnstile_cache) 60244 finished kmem_cache_reap(turnstile_cache); dur. 0 ms 60244 starting kmem_cache_reap(tslabel_cache) 60244 finished kmem_cache_reap(tslabel_cache); dur. 0 ms 60244 starting kmem_cache_reap(cred_cache) 60244 finished kmem_cache_reap(cred_cache); dur. 0 ms 60244 starting kmem_cache_reap(rctl_cache) 60244 finished kmem_cache_reap(rctl_cache); dur. 0 ms 60244 starting kmem_cache_reap(rctl_val_cache) 60244 finished kmem_cache_reap(rctl_val_cache); dur. 0 ms 60244 starting kmem_cache_reap(task_cache) 60244 finished kmem_cache_reap(task_cache); dur. 0 ms 60244 starting kmem_cache_reap(kmem_defrag_cache) 60244 finished kmem_cache_reap(kmem_defrag_cache); dur. 0 ms 60244 starting kmem_cache_reap(kmem_move_cache) 60244 finished kmem_cache_reap(kmem_move_cache); dur. 0 ms 60244 starting kmem_cache_reap(fxsave_cache) 60244 finished kmem_cache_reap(fxsave_cache); dur. 0 ms 60244 starting kmem_cache_reap(rootnex_dmahdl) 60244 finished kmem_cache_reap(rootnex_dmahdl); dur. 0 ms 60244 starting kmem_cache_reap(ddi_periodic) 60244 finished kmem_cache_reap(ddi_periodic); dur. 0 ms 60244 starting kmem_cache_reap(cyclic_id_cache) 60244 finished kmem_cache_reap(cyclic_id_cache); dur. 0 ms 60244 starting kmem_cache_reap(callout_cachebabecafe) 60244 finished kmem_cache_reap(callout_cachebabecafe); dur. 0 ms 60244 starting kmem_cache_reap(callout_lcachebabecafe) 60244 finished kmem_cache_reap(callout_lcachebabecafe); dur. 0 ms 60244 starting kmem_cache_reap(dnlc_space_cache) 60244 finished kmem_cache_reap(dnlc_space_cache); dur. 0 ms 60244 starting kmem_cache_reap(vfs_cache) 60244 finished kmem_cache_reap(vfs_cache); dur. 0 ms 60244 starting kmem_cache_reap(vn_cache) 60244 finished kmem_cache_reap(vn_cache); dur. 0 ms 60244 starting kmem_cache_reap(vsk_anchor_cache) 60244 finished kmem_cache_reap(vsk_anchor_cache); dur. 0 ms 60244 starting kmem_cache_reap(file_cache) 60244 finished kmem_cache_reap(file_cache); dur. 0 ms 60244 starting kmem_cache_reap(stream_head_cache) 60244 finished kmem_cache_reap(stream_head_cache); dur. 0 ms 60244 starting kmem_cache_reap(queue_cache) 60244 finished kmem_cache_reap(queue_cache); dur. 0 ms 60244 starting kmem_cache_reap(syncq_cache) 60244 finished kmem_cache_reap(syncq_cache); dur. 0 ms 60244 starting kmem_cache_reap(qband_cache) 60244 finished kmem_cache_reap(qband_cache); dur. 0 ms 60244 starting kmem_cache_reap(linkinfo_cache) 60244 finished kmem_cache_reap(linkinfo_cache); dur. 0 ms 60244 starting kmem_cache_reap(ciputctrl_cache) 60244 finished kmem_cache_reap(ciputctrl_cache); dur. 0 ms 60244 starting kmem_cache_reap(serializer_cache) 60244 finished kmem_cache_reap(serializer_cache); dur. 0 ms 60244 starting kmem_cache_reap(as_cache) 60244 finished kmem_cache_reap(as_cache); dur. 0 ms 60244 starting kmem_cache_reap(marker_cache) 60244 finished kmem_cache_reap(marker_cache); dur. 0 ms 60244 starting kmem_cache_reap(anon_cache) 60244 finished kmem_cache_reap(anon_cache); dur. 0 ms 60244 starting kmem_cache_reap(anonmap_cache) 60244 finished kmem_cache_reap(anonmap_cache); dur. 0 ms 60244 starting kmem_cache_reap(segvn_cache) 60244 finished kmem_cache_reap(segvn_cache); dur. 0 ms 60244 starting kmem_cache_reap(segvn_szc_cache1) 60244 finished kmem_cache_reap(segvn_szc_cache1); dur. 0 ms 60244 starting kmem_cache_reap(flk_edges) 60244 finished kmem_cache_reap(flk_edges); dur. 0 ms 60244 starting kmem_cache_reap(fdb_cache) 60244 finished kmem_cache_reap(fdb_cache); dur. 0 ms 60244 starting kmem_cache_reap(timer_cache) 60244 finished kmem_cache_reap(timer_cache); dur. 0 ms 60244 starting kmem_cache_reap(vmu_bound_cache) 60244 finished kmem_cache_reap(vmu_bound_cache); dur. 0 ms 60244 starting kmem_cache_reap(vmu_object_cache) 60244 finished kmem_cache_reap(vmu_object_cache); dur. 0 ms 60244 starting kmem_cache_reap(physio_buf_cache) 60244 finished kmem_cache_reap(physio_buf_cache); dur. 0 ms 60244 starting kmem_cache_reap(process_cache) 60244 finished kmem_cache_reap(process_cache); dur. 0 ms 60244 starting kmem_cache_reap(kcf_sreq_cache) 60244 finished kmem_cache_reap(kcf_sreq_cache); dur. 0 ms 60244 starting kmem_cache_reap(kcf_areq_cache) 60244 finished kmem_cache_reap(kcf_areq_cache); dur. 0 ms 60244 starting kmem_cache_reap(kcf_context_cache) 60244 finished kmem_cache_reap(kcf_context_cache); dur. 0 ms 60244 starting kmem_cache_reap(clnt_clts_endpnt_cache) 60244 finished kmem_cache_reap(clnt_clts_endpnt_cache); dur. 0 ms 60244 starting kmem_cache_reap(zfs_btree_leaf_cache) 60244 finished kmem_cache_reap(zfs_btree_leaf_cache); dur. 0 ms 60244 starting kmem_cache_reap(metaslab_alloc_trace_cache) 60244 finished kmem_cache_reap(metaslab_alloc_trace_cache); dur. 0 ms 60244 starting kmem_cache_reap(zio_cache) 60245 finished kmem_cache_reap(zio_cache); dur. 0 ms 60245 starting kmem_cache_reap(zio_link_cache) 60245 finished kmem_cache_reap(zio_link_cache); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_512) 60245 finished kmem_cache_reap(zio_buf_512); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_512) 60245 finished kmem_cache_reap(zio_data_buf_512); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_1024) 60245 finished kmem_cache_reap(zio_buf_1024); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_1024) 60245 finished kmem_cache_reap(zio_data_buf_1024); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_1536) 60245 finished kmem_cache_reap(zio_buf_1536); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_1536) 60245 finished kmem_cache_reap(zio_data_buf_1536); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_2048) 60245 finished kmem_cache_reap(zio_buf_2048); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_2048) 60245 finished kmem_cache_reap(zio_data_buf_2048); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_2560) 60245 finished kmem_cache_reap(zio_buf_2560); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_2560) 60245 finished kmem_cache_reap(zio_data_buf_2560); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_3072) 60245 finished kmem_cache_reap(zio_buf_3072); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_3072) 60245 finished kmem_cache_reap(zio_data_buf_3072); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_3584) 60245 finished kmem_cache_reap(zio_buf_3584); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_3584) 60245 finished kmem_cache_reap(zio_data_buf_3584); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_4096) 60245 finished kmem_cache_reap(zio_buf_4096); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_4096) 60245 finished kmem_cache_reap(zio_data_buf_4096); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_5120) 60245 finished kmem_cache_reap(zio_buf_5120); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_5120) 60245 finished kmem_cache_reap(zio_data_buf_5120); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_6144) 60245 finished kmem_cache_reap(zio_buf_6144); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_6144) 60245 finished kmem_cache_reap(zio_data_buf_6144); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_7168) 60245 finished kmem_cache_reap(zio_buf_7168); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_7168) 60245 finished kmem_cache_reap(zio_data_buf_7168); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_8192) 60245 finished kmem_cache_reap(zio_buf_8192); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_8192) 60245 finished kmem_cache_reap(zio_data_buf_8192); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_10240) 60245 finished kmem_cache_reap(zio_buf_10240); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_10240) 60245 finished kmem_cache_reap(zio_data_buf_10240); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_12288) 60245 finished kmem_cache_reap(zio_buf_12288); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_12288) 60245 finished kmem_cache_reap(zio_data_buf_12288); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_14336) 60245 finished kmem_cache_reap(zio_buf_14336); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_14336) 60245 finished kmem_cache_reap(zio_data_buf_14336); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_16384) 60245 finished kmem_cache_reap(zio_buf_16384); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_16384) 60245 finished kmem_cache_reap(zio_data_buf_16384); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_20480) 60245 finished kmem_cache_reap(zio_buf_20480); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_20480) 60245 finished kmem_cache_reap(zio_data_buf_20480); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_24576) 60245 finished kmem_cache_reap(zio_buf_24576); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_24576) 60245 finished kmem_cache_reap(zio_data_buf_24576); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_28672) 60245 finished kmem_cache_reap(zio_buf_28672); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_28672) 60245 finished kmem_cache_reap(zio_data_buf_28672); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_32768) 60245 finished kmem_cache_reap(zio_buf_32768); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_32768) 60245 finished kmem_cache_reap(zio_data_buf_32768); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_40960) 60245 finished kmem_cache_reap(zio_buf_40960); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_40960) 60245 finished kmem_cache_reap(zio_data_buf_40960); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_49152) 60245 finished kmem_cache_reap(zio_buf_49152); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_49152) 60245 finished kmem_cache_reap(zio_data_buf_49152); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_57344) 60245 finished kmem_cache_reap(zio_buf_57344); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_57344) 60245 finished kmem_cache_reap(zio_data_buf_57344); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_65536) 60245 finished kmem_cache_reap(zio_buf_65536); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_65536) 60245 finished kmem_cache_reap(zio_data_buf_65536); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_81920) 60245 finished kmem_cache_reap(zio_buf_81920); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_81920) 60245 finished kmem_cache_reap(zio_data_buf_81920); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_98304) 60245 finished kmem_cache_reap(zio_buf_98304); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_98304) 60245 finished kmem_cache_reap(zio_data_buf_98304); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_114688) 60245 finished kmem_cache_reap(zio_buf_114688); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_114688) 60245 finished kmem_cache_reap(zio_data_buf_114688); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_131072) 60245 finished kmem_cache_reap(zio_buf_131072); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_131072) 60245 finished kmem_cache_reap(zio_data_buf_131072); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_163840) 60245 finished kmem_cache_reap(zio_buf_163840); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_163840) 60245 finished kmem_cache_reap(zio_data_buf_163840); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_196608) 60245 finished kmem_cache_reap(zio_buf_196608); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_196608) 60245 finished kmem_cache_reap(zio_data_buf_196608); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_229376) 60245 finished kmem_cache_reap(zio_buf_229376); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_229376) 60245 finished kmem_cache_reap(zio_data_buf_229376); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_262144) 60245 finished kmem_cache_reap(zio_buf_262144); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_262144) 60245 finished kmem_cache_reap(zio_data_buf_262144); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_327680) 60245 finished kmem_cache_reap(zio_buf_327680); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_327680) 60245 finished kmem_cache_reap(zio_data_buf_327680); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_393216) 60245 finished kmem_cache_reap(zio_buf_393216); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_393216) 60245 finished kmem_cache_reap(zio_data_buf_393216); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_458752) 60245 finished kmem_cache_reap(zio_buf_458752); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_458752) 60245 finished kmem_cache_reap(zio_data_buf_458752); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_524288) 60245 finished kmem_cache_reap(zio_buf_524288); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_524288) 60245 finished kmem_cache_reap(zio_data_buf_524288); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_655360) 60245 finished kmem_cache_reap(zio_buf_655360); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_655360) 60245 finished kmem_cache_reap(zio_data_buf_655360); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_786432) 60245 finished kmem_cache_reap(zio_buf_786432); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_786432) 60245 finished kmem_cache_reap(zio_data_buf_786432); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_917504) 60245 finished kmem_cache_reap(zio_buf_917504); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_917504) 60245 finished kmem_cache_reap(zio_data_buf_917504); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_1048576) 60245 finished kmem_cache_reap(zio_buf_1048576); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_1048576) 60245 finished kmem_cache_reap(zio_data_buf_1048576); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_1310720) 60245 finished kmem_cache_reap(zio_buf_1310720); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_1310720) 60245 finished kmem_cache_reap(zio_data_buf_1310720); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_1572864) 60245 finished kmem_cache_reap(zio_buf_1572864); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_1572864) 60245 finished kmem_cache_reap(zio_data_buf_1572864); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_1835008) 60245 finished kmem_cache_reap(zio_buf_1835008); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_1835008) 60245 finished kmem_cache_reap(zio_data_buf_1835008); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_2097152) 60245 finished kmem_cache_reap(zio_buf_2097152); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_2097152) 60245 finished kmem_cache_reap(zio_data_buf_2097152); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_2621440) 60245 finished kmem_cache_reap(zio_buf_2621440); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_2621440) 60245 finished kmem_cache_reap(zio_data_buf_2621440); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_3145728) 60245 finished kmem_cache_reap(zio_buf_3145728); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_3145728) 60245 finished kmem_cache_reap(zio_data_buf_3145728); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_3670016) 60245 finished kmem_cache_reap(zio_buf_3670016); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_3670016) 60245 finished kmem_cache_reap(zio_data_buf_3670016); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_4194304) 60245 finished kmem_cache_reap(zio_buf_4194304); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_4194304) 60245 finished kmem_cache_reap(zio_data_buf_4194304); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_5242880) 60245 finished kmem_cache_reap(zio_buf_5242880); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_5242880) 60245 finished kmem_cache_reap(zio_data_buf_5242880); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_6291456) 60245 finished kmem_cache_reap(zio_buf_6291456); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_6291456) 60245 finished kmem_cache_reap(zio_data_buf_6291456); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_7340032) 60245 finished kmem_cache_reap(zio_buf_7340032); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_7340032) 60245 finished kmem_cache_reap(zio_data_buf_7340032); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_8388608) 60245 finished kmem_cache_reap(zio_buf_8388608); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_8388608) 60245 finished kmem_cache_reap(zio_data_buf_8388608); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_10485760) 60245 finished kmem_cache_reap(zio_buf_10485760); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_10485760) 60245 finished kmem_cache_reap(zio_data_buf_10485760); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_12582912) 60245 finished kmem_cache_reap(zio_buf_12582912); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_12582912) 60245 finished kmem_cache_reap(zio_data_buf_12582912); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_14680064) 60245 finished kmem_cache_reap(zio_buf_14680064); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_14680064) 60245 finished kmem_cache_reap(zio_data_buf_14680064); dur. 0 ms 60245 starting kmem_cache_reap(zio_buf_16777216) 60245 finished kmem_cache_reap(zio_buf_16777216); dur. 0 ms 60245 starting kmem_cache_reap(zio_data_buf_16777216) 60245 finished kmem_cache_reap(zio_data_buf_16777216); dur. 0 ms 60245 starting kmem_cache_reap(abd_chunk) 60245 finished kmem_cache_reap(abd_chunk); dur. 0 ms 60245 starting kmem_cache_reap(sa_cache) 60245 finished kmem_cache_reap(sa_cache); dur. 0 ms 60245 starting kmem_cache_reap(dnode_t) 60246 finished kmem_cache_reap(dnode_t); dur. 0 ms 60246 starting kmem_cache_reap(arc_buf_hdr_t_full) 60246 finished kmem_cache_reap(arc_buf_hdr_t_full); dur. 0 ms 60246 starting kmem_cache_reap(arc_buf_hdr_t_full_crypt) 60246 finished kmem_cache_reap(arc_buf_hdr_t_full_crypt); dur. 0 ms 60246 starting kmem_cache_reap(arc_buf_hdr_t_l2only) 60246 finished kmem_cache_reap(arc_buf_hdr_t_l2only); dur. 0 ms 60246 starting kmem_cache_reap(arc_buf_t) 60246 finished kmem_cache_reap(arc_buf_t); dur. 0 ms 60246 starting kmem_cache_reap(dmu_buf_impl_t) 60248 finished kmem_cache_reap(dmu_buf_impl_t); dur. 2 ms 60248 starting kmem_cache_reap(zil_lwb_cache) 60248 finished kmem_cache_reap(zil_lwb_cache); dur. 0 ms 60248 starting kmem_cache_reap(zil_zcw_cache) 60248 finished kmem_cache_reap(zil_zcw_cache); dur. 0 ms 60248 starting kmem_cache_reap(sio_cache_0) 60248 finished kmem_cache_reap(sio_cache_0); dur. 0 ms 60248 starting kmem_cache_reap(sio_cache_1) 60248 finished kmem_cache_reap(sio_cache_1); dur. 0 ms 60248 starting kmem_cache_reap(sio_cache_2) 60248 finished kmem_cache_reap(sio_cache_2); dur. 0 ms 60248 starting kmem_cache_reap(zfs_znode_cache) 60248 finished kmem_cache_reap(zfs_znode_cache); dur. 0 ms 60248 starting kmem_cache_reap(blkdev1_xfer) 60248 finished kmem_cache_reap(blkdev1_xfer); dur. 0 ms 60248 starting kmem_cache_reap(bootfs_node_cache) 60248 finished kmem_cache_reap(bootfs_node_cache); dur. 0 ms 60248 starting kmem_cache_reap(audit_proc) 60248 finished kmem_cache_reap(audit_proc); dur. 0 ms 60248 starting kmem_cache_reap(drv_secobj_cache) 60248 finished kmem_cache_reap(drv_secobj_cache); dur. 0 ms 60248 starting kmem_cache_reap(dld_str_cache) 60248 finished kmem_cache_reap(dld_str_cache); dur. 0 ms 60248 starting kmem_cache_reap(ip_minor_arena_sa_1) 60248 finished kmem_cache_reap(ip_minor_arena_sa_1); dur. 0 ms 60248 starting kmem_cache_reap(ip_minor_arena_la_1) 60248 finished kmem_cache_reap(ip_minor_arena_la_1); dur. 0 ms 60248 starting kmem_cache_reap(ip_conn_cache) 60248 finished kmem_cache_reap(ip_conn_cache); dur. 0 ms 60248 starting kmem_cache_reap(tcp_conn_cache) 60248 finished kmem_cache_reap(tcp_conn_cache); dur. 0 ms 60248 starting kmem_cache_reap(udp_conn_cache) 60248 finished kmem_cache_reap(udp_conn_cache); dur. 0 ms 60248 starting kmem_cache_reap(rawip_conn_cache) 60248 finished kmem_cache_reap(rawip_conn_cache); dur. 0 ms 60248 starting kmem_cache_reap(rts_conn_cache) 60248 finished kmem_cache_reap(rts_conn_cache); dur. 0 ms 60248 starting kmem_cache_reap(ire_cache) 60248 finished kmem_cache_reap(ire_cache); dur. 0 ms 60248 starting kmem_cache_reap(ncec_cache) 60248 finished kmem_cache_reap(ncec_cache); dur. 0 ms 60248 starting kmem_cache_reap(nce_cache) 60248 finished kmem_cache_reap(nce_cache); dur. 0 ms 60248 starting kmem_cache_reap(rt_entry) 60248 finished kmem_cache_reap(rt_entry); dur. 0 ms 60248 starting kmem_cache_reap(radix_mask) 60248 finished kmem_cache_reap(radix_mask); dur. 0 ms 60248 starting kmem_cache_reap(radix_node) 60248 finished kmem_cache_reap(radix_node); dur. 0 ms 60248 starting kmem_cache_reap(ipsec_actions) 60248 finished kmem_cache_reap(ipsec_actions); dur. 0 ms 60248 starting kmem_cache_reap(ipsec_selectors) 60248 finished kmem_cache_reap(ipsec_selectors); dur. 0 ms 60248 starting kmem_cache_reap(ipsec_policy) 60248 finished kmem_cache_reap(ipsec_policy); dur. 0 ms 60248 starting kmem_cache_reap(tcp_timercache) 60248 finished kmem_cache_reap(tcp_timercache); dur. 0 ms 60248 starting kmem_cache_reap(tcp_notsack_blk_cache) 60248 finished kmem_cache_reap(tcp_notsack_blk_cache); dur. 0 ms 60248 starting kmem_cache_reap(squeue_cache) 60248 finished kmem_cache_reap(squeue_cache); dur. 0 ms 60248 starting kmem_cache_reap(sctp_conn_cache) 60248 finished kmem_cache_reap(sctp_conn_cache); dur. 0 ms 60248 starting kmem_cache_reap(sctp_faddr_cache) 60248 finished kmem_cache_reap(sctp_faddr_cache); dur. 0 ms 60248 starting kmem_cache_reap(sctp_set_cache) 60248 finished kmem_cache_reap(sctp_set_cache); dur. 0 ms 60248 starting kmem_cache_reap(sctp_ftsn_set_cache) 60248 finished kmem_cache_reap(sctp_ftsn_set_cache); dur. 0 ms 60248 starting kmem_cache_reap(dce_cache) 60248 finished kmem_cache_reap(dce_cache); dur. 0 ms 60248 starting kmem_cache_reap(ire_gw_secattr_cache) 60248 finished kmem_cache_reap(ire_gw_secattr_cache); dur. 0 ms 60248 starting kmem_cache_reap(socket_cache) 60248 finished kmem_cache_reap(socket_cache); dur. 0 ms 60248 starting kmem_cache_reap(socktpi_cache) 60248 finished kmem_cache_reap(socktpi_cache); dur. 0 ms 60248 starting kmem_cache_reap(socktpi_unix_cache) 60248 finished kmem_cache_reap(socktpi_unix_cache); dur. 0 ms 60248 starting kmem_cache_reap(sock_sod_cache) 60248 finished kmem_cache_reap(sock_sod_cache); dur. 0 ms 60248 starting kmem_cache_reap(exacct_object_cache) 60248 finished kmem_cache_reap(exacct_object_cache); dur. 0 ms 60248 starting kmem_cache_reap(kssl_cache) 60248 finished kmem_cache_reap(kssl_cache); dur. 0 ms 60248 starting kmem_cache_reap(fctl_cache) 60248 finished kmem_cache_reap(fctl_cache); dur. 0 ms 60248 starting kmem_cache_reap(tl_cache) 60248 finished kmem_cache_reap(tl_cache); dur. 0 ms 60248 starting kmem_cache_reap(keysock_1) 60248 finished kmem_cache_reap(keysock_1); dur. 0 ms 60248 starting kmem_cache_reap(spdsock_1) 60248 finished kmem_cache_reap(spdsock_1); dur. 0 ms 60248 starting kmem_cache_reap(rds_alloc_cache) 60248 finished kmem_cache_reap(rds_alloc_cache); dur. 0 ms 60248 starting kmem_cache_reap(port_cache) 60248 finished kmem_cache_reap(port_cache); dur. 0 ms 60248 starting kmem_cache_reap(softmac_cache) 60248 finished kmem_cache_reap(softmac_cache); dur. 0 ms 60248 starting kmem_cache_reap(softmac_upper_cache) 60248 finished kmem_cache_reap(softmac_upper_cache); dur. 0 ms 60248 starting kmem_cache_reap(lnode_cache) 60248 finished kmem_cache_reap(lnode_cache); dur. 0 ms 60248 starting kmem_cache_reap(Hex0xfffffe06519d3518_minor_1) 60248 finished kmem_cache_reap(Hex0xfffffe06519d3518_minor_1); dur. 0 ms 60248 starting kmem_cache_reap(Hex0xfffffe06519d3520_minor_1) 60248 finished kmem_cache_reap(Hex0xfffffe06519d3520_minor_1); dur. 0 ms 60248 starting kmem_cache_reap(blkdev2_xfer) 60248 finished kmem_cache_reap(blkdev2_xfer); dur. 0 ms 60248 starting kmem_cache_reap(idm_buf_cache) 60248 finished kmem_cache_reap(idm_buf_cache); dur. 0 ms 60248 starting kmem_cache_reap(idm_task_cache) 60248 finished kmem_cache_reap(idm_task_cache); dur. 0 ms 60248 starting kmem_cache_reap(idm_tx_pdu_cache) 60248 finished kmem_cache_reap(idm_tx_pdu_cache); dur. 0 ms 60248 starting kmem_cache_reap(idm_rx_pdu_cache) 60248 finished kmem_cache_reap(idm_rx_pdu_cache); dur. 0 ms 60248 starting kmem_cache_reap(idm_128k_buf_cache) 60248 finished kmem_cache_reap(idm_128k_buf_cache); dur. 0 ms 60248 starting kmem_cache_reap(dtrace_state_cache) 60248 finished kmem_cache_reap(dtrace_state_cache); dur. 0 ms 60248 starting kmem_cache_reap(ufs_inode_cache) 60248 finished kmem_cache_reap(ufs_inode_cache); dur. 0 ms 60248 starting kmem_cache_reap(directio_buf_cache) 60248 finished kmem_cache_reap(directio_buf_cache); dur. 0 ms 60248 starting kmem_cache_reap(lufs_save) 60248 finished kmem_cache_reap(lufs_save); dur. 0 ms 60248 starting kmem_cache_reap(lufs_bufs) 60248 finished kmem_cache_reap(lufs_bufs); dur. 0 ms 60248 starting kmem_cache_reap(lufs_mapentry_cache) 60248 finished kmem_cache_reap(lufs_mapentry_cache); dur. 0 ms 60248 starting kmem_cache_reap(pty_map) 60248 finished kmem_cache_reap(pty_map); dur. 0 ms 60248 starting kmem_cache_reap(authkern_cache) 60248 finished kmem_cache_reap(authkern_cache); dur. 0 ms 60248 starting kmem_cache_reap(authnone_cache) 60248 finished kmem_cache_reap(authnone_cache); dur. 0 ms 60248 starting kmem_cache_reap(authloopback_cache) 60248 finished kmem_cache_reap(authloopback_cache); dur. 0 ms 60248 starting kmem_cache_reap(authdes_cache_handle) 60248 finished kmem_cache_reap(authdes_cache_handle); dur. 0 ms 60248 starting kmem_cache_reap(rnode_cache) 60249 finished kmem_cache_reap(rnode_cache); dur. 0 ms 60249 starting kmem_cache_reap(nfs_access_cache) 60249 finished kmem_cache_reap(nfs_access_cache); dur. 0 ms 60249 starting kmem_cache_reap(client_handle_cache) 60249 finished kmem_cache_reap(client_handle_cache); dur. 0 ms 60249 starting kmem_cache_reap(rnode4_cache) 60250 finished kmem_cache_reap(rnode4_cache); dur. 0 ms 60250 starting kmem_cache_reap(svnode_cache) 60250 finished kmem_cache_reap(svnode_cache); dur. 0 ms 60250 starting kmem_cache_reap(nfs4_access_cache) 60250 finished kmem_cache_reap(nfs4_access_cache); dur. 0 ms 60250 starting kmem_cache_reap(client_handle4_cache) 60250 finished kmem_cache_reap(client_handle4_cache); dur. 0 ms 60250 starting kmem_cache_reap(nfs4_ace4vals_cache) 60250 finished kmem_cache_reap(nfs4_ace4vals_cache); dur. 0 ms 60250 starting kmem_cache_reap(nfs4_ace4_list_cache) 60250 finished kmem_cache_reap(nfs4_ace4_list_cache); dur. 0 ms 60250 starting kmem_cache_reap(NFS_idmap_cache) 60250 finished kmem_cache_reap(NFS_idmap_cache); dur. 0 ms 60250 starting kmem_cache_reap(nlm_host_cache) 60250 finished kmem_cache_reap(nlm_host_cache); dur. 0 ms 60250 starting kmem_cache_reap(nlm_vhold_cache) 60250 finished kmem_cache_reap(nlm_vhold_cache); dur. 0 ms 60250 starting kmem_cache_reap(nlm_rpch_cache) 60250 finished kmem_cache_reap(nlm_rpch_cache); dur. 0 ms 60250 starting kmem_cache_reap(aggr_port_cache) 60250 finished kmem_cache_reap(aggr_port_cache); dur. 0 ms 60250 starting kmem_cache_reap(aggr_grp_cache) 60250 finished kmem_cache_reap(aggr_grp_cache); dur. 0 ms 60250 starting kmem_cache_reap(crypto_session_cache) 60250 finished kmem_cache_reap(crypto_session_cache); dur. 0 ms 60250 starting kmem_cache_reap(fcsm_job_cache) 60250 finished kmem_cache_reap(fcsm_job_cache); dur. 0 ms 60250 starting kmem_cache_reap(iptun_cache) 60250 finished kmem_cache_reap(iptun_cache); dur. 0 ms 60250 starting kmem_cache_reap(vnic_cache) 60250 finished kmem_cache_reap(vnic_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_share_cache) 60250 finished kmem_cache_reap(smb_share_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_unexport_cache) 60250 finished kmem_cache_reap(smb_unexport_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_mbc_cache) 60250 finished kmem_cache_reap(smb_mbc_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_mbuf_cache) 60250 finished kmem_cache_reap(smb_mbuf_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_mbufcl_cache) 60250 finished kmem_cache_reap(smb_mbufcl_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_node_cache) 60250 finished kmem_cache_reap(smb_node_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_lease_cache) 60250 finished kmem_cache_reap(smb_lease_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_request_cache) 60250 finished kmem_cache_reap(smb_request_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_session_cache) 60250 finished kmem_cache_reap(smb_session_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_user_cache) 60250 finished kmem_cache_reap(smb_user_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_tree_cache) 60250 finished kmem_cache_reap(smb_tree_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_ofile_cache) 60250 finished kmem_cache_reap(smb_ofile_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_odir_cache) 60250 finished kmem_cache_reap(smb_odir_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_opipe_cache) 60250 finished kmem_cache_reap(smb_opipe_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_event_cache) 60250 finished kmem_cache_reap(smb_event_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_lock_cache) 60250 finished kmem_cache_reap(smb_lock_cache); dur. 0 ms 60250 starting kmem_cache_reap(smb_dtor_cache) 60250 finished kmem_cache_reap(smb_dtor_cache); dur. 0 ms 60250 kmem_reap_done()! took 68 ms 60432 kmem_reap() kmem_reaping = 1 60682 kmem_reap() kmem_reaping = 1 60932 kmem_reap() kmem_reaping = 1 60971 2020 Sep 17 21:36:53: kmem_reaping = 1 61182 kmem_reap() kmem_reaping = 1 61432 kmem_reap() kmem_reaping = 1 61682 kmem_reap() kmem_reaping = 1 61749 kmem_reap_timeout()! 61932 kmem_reap() kmem_reaping = 0 61932 dispatch kmem_reap_start()! 61935 2020 Sep 17 21:36:54: kmem_reap_start() complete, dur. 3 ms, tasks: 466 ok, 0 failed 61935 starting kmem_cache_reap(kmem_magazine_1) 61935 finished kmem_cache_reap(kmem_magazine_1); dur. 0 ms 61935 starting kmem_cache_reap(kmem_magazine_3) 61935 finished kmem_cache_reap(kmem_magazine_3); dur. 0 ms 61935 starting kmem_cache_reap(kmem_magazine_7) 61935 finished kmem_cache_reap(kmem_magazine_7); dur. 0 ms 61935 starting kmem_cache_reap(kmem_magazine_15) 61958 finished kmem_cache_reap(kmem_magazine_15); dur. 23 ms 61958 starting kmem_cache_reap(kmem_magazine_31) 61958 finished kmem_cache_reap(kmem_magazine_31); dur. 0 ms 61958 starting kmem_cache_reap(kmem_magazine_47) 61958 finished kmem_cache_reap(kmem_magazine_47); dur. 0 ms 61958 starting kmem_cache_reap(kmem_magazine_63) 61958 finished kmem_cache_reap(kmem_magazine_63); dur. 0 ms 61958 starting kmem_cache_reap(kmem_magazine_95) 61958 finished kmem_cache_reap(kmem_magazine_95); dur. 0 ms 61958 starting kmem_cache_reap(kmem_magazine_143) 61958 finished kmem_cache_reap(kmem_magazine_143); dur. 0 ms 61958 starting kmem_cache_reap(kmem_slab_cache) 61961 finished kmem_cache_reap(kmem_slab_cache); dur. 2 ms 61961 starting kmem_cache_reap(kmem_bufctl_cache) 61963 finished kmem_cache_reap(kmem_bufctl_cache); dur. 1 ms 61963 starting kmem_cache_reap(kmem_bufctl_audit_cache) 61963 finished kmem_cache_reap(kmem_bufctl_audit_cache); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_4096) 61963 finished kmem_cache_reap(kmem_va_4096); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_8192) 61963 finished kmem_cache_reap(kmem_va_8192); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_12288) 61963 finished kmem_cache_reap(kmem_va_12288); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_16384) 61963 finished kmem_cache_reap(kmem_va_16384); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_20480) 61963 finished kmem_cache_reap(kmem_va_20480); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_24576) 61963 finished kmem_cache_reap(kmem_va_24576); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_28672) 61963 finished kmem_cache_reap(kmem_va_28672); dur. 0 ms 61963 starting kmem_cache_reap(kmem_va_32768) 61963 finished kmem_cache_reap(kmem_va_32768); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_8) 61963 finished kmem_cache_reap(kmem_alloc_8); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_16) 61963 finished kmem_cache_reap(kmem_alloc_16); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_24) 61963 finished kmem_cache_reap(kmem_alloc_24); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_32) 61963 finished kmem_cache_reap(kmem_alloc_32); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_40) 61963 finished kmem_cache_reap(kmem_alloc_40); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_48) 61963 finished kmem_cache_reap(kmem_alloc_48); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_56) 61963 finished kmem_cache_reap(kmem_alloc_56); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_64) 61963 finished kmem_cache_reap(kmem_alloc_64); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_80) 61963 finished kmem_cache_reap(kmem_alloc_80); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_96) 61963 finished kmem_cache_reap(kmem_alloc_96); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_112) 61963 finished kmem_cache_reap(kmem_alloc_112); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_128) 61963 finished kmem_cache_reap(kmem_alloc_128); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_160) 61963 finished kmem_cache_reap(kmem_alloc_160); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_192) 61963 finished kmem_cache_reap(kmem_alloc_192); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_224) 61963 finished kmem_cache_reap(kmem_alloc_224); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_256) 61963 finished kmem_cache_reap(kmem_alloc_256); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_320) 61963 finished kmem_cache_reap(kmem_alloc_320); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_384) 61963 finished kmem_cache_reap(kmem_alloc_384); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_448) 61963 finished kmem_cache_reap(kmem_alloc_448); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_512) 61963 finished kmem_cache_reap(kmem_alloc_512); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_640) 61963 finished kmem_cache_reap(kmem_alloc_640); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_768) 61963 finished kmem_cache_reap(kmem_alloc_768); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_896) 61963 finished kmem_cache_reap(kmem_alloc_896); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_1152) 61963 finished kmem_cache_reap(kmem_alloc_1152); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_1344) 61963 finished kmem_cache_reap(kmem_alloc_1344); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_1600) 61963 finished kmem_cache_reap(kmem_alloc_1600); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_2048) 61963 finished kmem_cache_reap(kmem_alloc_2048); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_2688) 61963 finished kmem_cache_reap(kmem_alloc_2688); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_4096) 61963 finished kmem_cache_reap(kmem_alloc_4096); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_8192) 61963 finished kmem_cache_reap(kmem_alloc_8192); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_12288) 61963 finished kmem_cache_reap(kmem_alloc_12288); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_16384) 61963 finished kmem_cache_reap(kmem_alloc_16384); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_24576) 61963 finished kmem_cache_reap(kmem_alloc_24576); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_32768) 61963 finished kmem_cache_reap(kmem_alloc_32768); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_40960) 61963 finished kmem_cache_reap(kmem_alloc_40960); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_49152) 61963 finished kmem_cache_reap(kmem_alloc_49152); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_57344) 61963 finished kmem_cache_reap(kmem_alloc_57344); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_65536) 61963 finished kmem_cache_reap(kmem_alloc_65536); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_73728) 61963 finished kmem_cache_reap(kmem_alloc_73728); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_81920) 61963 finished kmem_cache_reap(kmem_alloc_81920); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_90112) 61963 finished kmem_cache_reap(kmem_alloc_90112); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_98304) 61963 finished kmem_cache_reap(kmem_alloc_98304); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_106496) 61963 finished kmem_cache_reap(kmem_alloc_106496); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_114688) 61963 finished kmem_cache_reap(kmem_alloc_114688); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_122880) 61963 finished kmem_cache_reap(kmem_alloc_122880); dur. 0 ms 61963 starting kmem_cache_reap(kmem_alloc_131072) 61963 finished kmem_cache_reap(kmem_alloc_131072); dur. 0 ms 61963 starting kmem_cache_reap(streams_mblk) 61963 finished kmem_cache_reap(streams_mblk); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_16) 61963 finished kmem_cache_reap(streams_dblk_16); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_80) 61963 finished kmem_cache_reap(streams_dblk_80); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_144) 61963 finished kmem_cache_reap(streams_dblk_144); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_208) 61963 finished kmem_cache_reap(streams_dblk_208); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_272) 61963 finished kmem_cache_reap(streams_dblk_272); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_336) 61963 finished kmem_cache_reap(streams_dblk_336); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_528) 61963 finished kmem_cache_reap(streams_dblk_528); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_1040) 61963 finished kmem_cache_reap(streams_dblk_1040); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_1488) 61963 finished kmem_cache_reap(streams_dblk_1488); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_1936) 61963 finished kmem_cache_reap(streams_dblk_1936); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_2576) 61963 finished kmem_cache_reap(streams_dblk_2576); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_3856) 61963 finished kmem_cache_reap(streams_dblk_3856); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_8192) 61963 finished kmem_cache_reap(streams_dblk_8192); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_12048) 61963 finished kmem_cache_reap(streams_dblk_12048); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_16384) 61963 finished kmem_cache_reap(streams_dblk_16384); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_20240) 61963 finished kmem_cache_reap(streams_dblk_20240); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_24576) 61963 finished kmem_cache_reap(streams_dblk_24576); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_28432) 61963 finished kmem_cache_reap(streams_dblk_28432); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_32768) 61963 finished kmem_cache_reap(streams_dblk_32768); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_36624) 61963 finished kmem_cache_reap(streams_dblk_36624); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_40960) 61963 finished kmem_cache_reap(streams_dblk_40960); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_44816) 61963 finished kmem_cache_reap(streams_dblk_44816); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_49152) 61963 finished kmem_cache_reap(streams_dblk_49152); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_53008) 61963 finished kmem_cache_reap(streams_dblk_53008); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_57344) 61963 finished kmem_cache_reap(streams_dblk_57344); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_61200) 61963 finished kmem_cache_reap(streams_dblk_61200); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_65536) 61963 finished kmem_cache_reap(streams_dblk_65536); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_69392) 61963 finished kmem_cache_reap(streams_dblk_69392); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_73728) 61963 finished kmem_cache_reap(streams_dblk_73728); dur. 0 ms 61963 starting kmem_cache_reap(streams_dblk_esb) 61963 finished kmem_cache_reap(streams_dblk_esb); dur. 0 ms 61963 starting kmem_cache_reap(streams_fthdr) 61963 finished kmem_cache_reap(streams_fthdr); dur. 0 ms 61963 starting kmem_cache_reap(streams_ftblk) 61963 finished kmem_cache_reap(streams_ftblk); dur. 0 ms 61963 starting kmem_cache_reap(multidata) 61963 finished kmem_cache_reap(multidata); dur. 0 ms 61963 starting kmem_cache_reap(multidata_pdslab) 61963 finished kmem_cache_reap(multidata_pdslab); dur. 0 ms 61963 starting kmem_cache_reap(multidata_pattbl) 61963 finished kmem_cache_reap(multidata_pattbl); dur. 0 ms 61963 starting kmem_cache_reap(log_cons_cache) 61963 finished kmem_cache_reap(log_cons_cache); dur. 0 ms 61963 starting kmem_cache_reap(taskq_ent_cache) 61963 finished kmem_cache_reap(taskq_ent_cache); dur. 0 ms 61963 starting kmem_cache_reap(taskq_cache) 61963 finished kmem_cache_reap(taskq_cache); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_64G_128) 61963 finished kmem_cache_reap(kmem_io_64G_128); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_64G_256) 61963 finished kmem_cache_reap(kmem_io_64G_256); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_64G_512) 61963 finished kmem_cache_reap(kmem_io_64G_512); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_64G_1024) 61963 finished kmem_cache_reap(kmem_io_64G_1024); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_64G_2048) 61963 finished kmem_cache_reap(kmem_io_64G_2048); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_64G_4096) 61963 finished kmem_cache_reap(kmem_io_64G_4096); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_4G_128) 61963 finished kmem_cache_reap(kmem_io_4G_128); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_4G_256) 61963 finished kmem_cache_reap(kmem_io_4G_256); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_4G_512) 61963 finished kmem_cache_reap(kmem_io_4G_512); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_4G_1024) 61963 finished kmem_cache_reap(kmem_io_4G_1024); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_4G_2048) 61963 finished kmem_cache_reap(kmem_io_4G_2048); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_4G_4096) 61963 finished kmem_cache_reap(kmem_io_4G_4096); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_2G_128) 61963 finished kmem_cache_reap(kmem_io_2G_128); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_2G_256) 61963 finished kmem_cache_reap(kmem_io_2G_256); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_2G_512) 61963 finished kmem_cache_reap(kmem_io_2G_512); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_2G_1024) 61963 finished kmem_cache_reap(kmem_io_2G_1024); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_2G_2048) 61963 finished kmem_cache_reap(kmem_io_2G_2048); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_2G_4096) 61963 finished kmem_cache_reap(kmem_io_2G_4096); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_16M_128) 61963 finished kmem_cache_reap(kmem_io_16M_128); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_16M_256) 61963 finished kmem_cache_reap(kmem_io_16M_256); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_16M_512) 61963 finished kmem_cache_reap(kmem_io_16M_512); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_16M_1024) 61963 finished kmem_cache_reap(kmem_io_16M_1024); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_16M_2048) 61963 finished kmem_cache_reap(kmem_io_16M_2048); dur. 0 ms 61963 starting kmem_cache_reap(kmem_io_16M_4096) 61963 finished kmem_cache_reap(kmem_io_16M_4096); dur. 0 ms 61963 starting kmem_cache_reap(id32_cache) 61963 finished kmem_cache_reap(id32_cache); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_4096) 61963 finished kmem_cache_reap(bp_map_4096); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_8192) 61963 finished kmem_cache_reap(bp_map_8192); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_12288) 61963 finished kmem_cache_reap(bp_map_12288); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_16384) 61963 finished kmem_cache_reap(bp_map_16384); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_20480) 61963 finished kmem_cache_reap(bp_map_20480); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_24576) 61963 finished kmem_cache_reap(bp_map_24576); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_28672) 61963 finished kmem_cache_reap(bp_map_28672); dur. 0 ms 61963 starting kmem_cache_reap(bp_map_32768) 61963 finished kmem_cache_reap(bp_map_32768); dur. 0 ms 61963 starting kmem_cache_reap(htable_t) 61963 finished kmem_cache_reap(htable_t); dur. 0 ms 61963 starting kmem_cache_reap(hment_t) 61963 finished kmem_cache_reap(hment_t); dur. 0 ms 61963 starting kmem_cache_reap(hat_t) 61963 finished kmem_cache_reap(hat_t); dur. 0 ms 61963 starting kmem_cache_reap(HatHash) 61963 finished kmem_cache_reap(HatHash); dur. 0 ms 61963 starting kmem_cache_reap(Hat32Hash) 61963 finished kmem_cache_reap(Hat32Hash); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_4096) 61963 finished kmem_cache_reap(zfs_file_data_4096); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_8192) 61963 finished kmem_cache_reap(zfs_file_data_8192); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_12288) 61963 finished kmem_cache_reap(zfs_file_data_12288); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_16384) 61963 finished kmem_cache_reap(zfs_file_data_16384); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_20480) 61963 finished kmem_cache_reap(zfs_file_data_20480); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_24576) 61963 finished kmem_cache_reap(zfs_file_data_24576); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_28672) 61963 finished kmem_cache_reap(zfs_file_data_28672); dur. 0 ms 61963 starting kmem_cache_reap(zfs_file_data_32768) 61963 finished kmem_cache_reap(zfs_file_data_32768); dur. 0 ms 61963 starting kmem_cache_reap(segkp_4096) 61963 finished kmem_cache_reap(segkp_4096); dur. 0 ms 61963 starting kmem_cache_reap(segkp_8192) 61963 finished kmem_cache_reap(segkp_8192); dur. 0 ms 61963 starting kmem_cache_reap(segkp_12288) 61963 finished kmem_cache_reap(segkp_12288); dur. 0 ms 61963 starting kmem_cache_reap(segkp_16384) 61963 finished kmem_cache_reap(segkp_16384); dur. 0 ms 61963 starting kmem_cache_reap(segkp_20480) 61963 finished kmem_cache_reap(segkp_20480); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_4096) 61963 finished kmem_cache_reap(umem_np_4096); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_8192) 61963 finished kmem_cache_reap(umem_np_8192); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_12288) 61963 finished kmem_cache_reap(umem_np_12288); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_16384) 61963 finished kmem_cache_reap(umem_np_16384); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_20480) 61963 finished kmem_cache_reap(umem_np_20480); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_24576) 61963 finished kmem_cache_reap(umem_np_24576); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_28672) 61963 finished kmem_cache_reap(umem_np_28672); dur. 0 ms 61963 starting kmem_cache_reap(umem_np_32768) 61963 finished kmem_cache_reap(umem_np_32768); dur. 0 ms 61963 starting kmem_cache_reap(mod_hash_entries) 61963 finished kmem_cache_reap(mod_hash_entries); dur. 0 ms 61963 starting kmem_cache_reap(ipp_mod) 61963 finished kmem_cache_reap(ipp_mod); dur. 0 ms 61963 starting kmem_cache_reap(ipp_action) 61963 finished kmem_cache_reap(ipp_action); dur. 0 ms 61963 starting kmem_cache_reap(ipp_packet) 61963 finished kmem_cache_reap(ipp_packet); dur. 0 ms 61963 starting kmem_cache_reap(seg_cache) 61963 finished kmem_cache_reap(seg_cache); dur. 0 ms 61963 starting kmem_cache_reap(seg_pcache) 61963 finished kmem_cache_reap(seg_pcache); dur. 0 ms 61963 starting kmem_cache_reap(fnode_cache) 61963 finished kmem_cache_reap(fnode_cache); dur. 0 ms 61963 starting kmem_cache_reap(pipe_cache) 61963 finished kmem_cache_reap(pipe_cache); dur. 0 ms 61963 starting kmem_cache_reap(snode_cache) 61963 finished kmem_cache_reap(snode_cache); dur. 0 ms 61963 starting kmem_cache_reap(dv_node_cache) 61963 finished kmem_cache_reap(dv_node_cache); dur. 0 ms 61963 starting kmem_cache_reap(mac_impl_cache) 61963 finished kmem_cache_reap(mac_impl_cache); dur. 0 ms 61963 starting kmem_cache_reap(mac_ring_cache) 61963 finished kmem_cache_reap(mac_ring_cache); dur. 0 ms 61963 starting kmem_cache_reap(flow_entry_cache) 61963 finished kmem_cache_reap(flow_entry_cache); dur. 0 ms 61963 starting kmem_cache_reap(flow_tab_cache) 61963 finished kmem_cache_reap(flow_tab_cache); dur. 0 ms 61963 starting kmem_cache_reap(mac_soft_ring_cache) 61963 finished kmem_cache_reap(mac_soft_ring_cache); dur. 0 ms 61963 starting kmem_cache_reap(mac_srs_cache) 61963 finished kmem_cache_reap(mac_srs_cache); dur. 0 ms 61963 starting kmem_cache_reap(mac_bcast_grp_cache) 61963 finished kmem_cache_reap(mac_bcast_grp_cache); dur. 0 ms 61963 starting kmem_cache_reap(mac_client_impl_cache) 61963 finished kmem_cache_reap(mac_client_impl_cache); dur. 0 ms 61963 starting kmem_cache_reap(mac_promisc_impl_cache) 61963 finished kmem_cache_reap(mac_promisc_impl_cache); dur. 0 ms 61963 starting kmem_cache_reap(dls_link_cache) 61963 finished kmem_cache_reap(dls_link_cache); dur. 0 ms 61963 starting kmem_cache_reap(dls_devnet_cache) 61963 finished kmem_cache_reap(dls_devnet_cache); dur. 0 ms 61963 starting kmem_cache_reap(sdev_node_cache) 61963 finished kmem_cache_reap(sdev_node_cache); dur. 0 ms 61963 starting kmem_cache_reap(sdev_plugin) 61963 finished kmem_cache_reap(sdev_plugin); dur. 0 ms 61963 starting kmem_cache_reap(namefs_inodes_1) 61963 finished kmem_cache_reap(namefs_inodes_1); dur. 0 ms 61963 starting kmem_cache_reap(dev_info_node_cache) 61963 finished kmem_cache_reap(dev_info_node_cache); dur. 0 ms 61963 starting kmem_cache_reap(ndi_fm_entry_cache) 61963 finished kmem_cache_reap(ndi_fm_entry_cache); dur. 0 ms 61964 starting kmem_cache_reap(thread_cache) 61964 finished kmem_cache_reap(thread_cache); dur. 0 ms 61964 starting kmem_cache_reap(lwp_cache) 61964 finished kmem_cache_reap(lwp_cache); dur. 0 ms 61964 starting kmem_cache_reap(turnstile_cache) 61964 finished kmem_cache_reap(turnstile_cache); dur. 0 ms 61964 starting kmem_cache_reap(tslabel_cache) 61964 finished kmem_cache_reap(tslabel_cache); dur. 0 ms 61964 starting kmem_cache_reap(cred_cache) 61964 finished kmem_cache_reap(cred_cache); dur. 0 ms 61964 starting kmem_cache_reap(rctl_cache) 61964 finished kmem_cache_reap(rctl_cache); dur. 0 ms 61964 starting kmem_cache_reap(rctl_val_cache) 61964 finished kmem_cache_reap(rctl_val_cache); dur. 0 ms 61964 starting kmem_cache_reap(task_cache) 61964 finished kmem_cache_reap(task_cache); dur. 0 ms 61964 starting kmem_cache_reap(kmem_defrag_cache) 61964 finished kmem_cache_reap(kmem_defrag_cache); dur. 0 ms 61964 starting kmem_cache_reap(kmem_move_cache) 61964 finished kmem_cache_reap(kmem_move_cache); dur. 0 ms 61964 starting kmem_cache_reap(fxsave_cache) 61964 finished kmem_cache_reap(fxsave_cache); dur. 0 ms 61964 starting kmem_cache_reap(rootnex_dmahdl) 61964 finished kmem_cache_reap(rootnex_dmahdl); dur. 0 ms 61964 starting kmem_cache_reap(ddi_periodic) 61964 finished kmem_cache_reap(ddi_periodic); dur. 0 ms 61964 starting kmem_cache_reap(cyclic_id_cache) 61964 finished kmem_cache_reap(cyclic_id_cache); dur. 0 ms 61964 starting kmem_cache_reap(callout_cachebabecafe) 61964 finished kmem_cache_reap(callout_cachebabecafe); dur. 0 ms 61964 starting kmem_cache_reap(callout_lcachebabecafe) 61964 finished kmem_cache_reap(callout_lcachebabecafe); dur. 0 ms 61964 starting kmem_cache_reap(dnlc_space_cache) 61964 finished kmem_cache_reap(dnlc_space_cache); dur. 0 ms 61964 starting kmem_cache_reap(vfs_cache) 61964 finished kmem_cache_reap(vfs_cache); dur. 0 ms 61964 starting kmem_cache_reap(vn_cache) 61964 finished kmem_cache_reap(vn_cache); dur. 0 ms 61964 starting kmem_cache_reap(vsk_anchor_cache) 61964 finished kmem_cache_reap(vsk_anchor_cache); dur. 0 ms 61964 starting kmem_cache_reap(file_cache) 61964 finished kmem_cache_reap(file_cache); dur. 0 ms 61964 starting kmem_cache_reap(stream_head_cache) 61964 finished kmem_cache_reap(stream_head_cache); dur. 0 ms 61964 starting kmem_cache_reap(queue_cache) 61964 finished kmem_cache_reap(queue_cache); dur. 0 ms 61964 starting kmem_cache_reap(syncq_cache) 61964 finished kmem_cache_reap(syncq_cache); dur. 0 ms 61964 starting kmem_cache_reap(qband_cache) 61964 finished kmem_cache_reap(qband_cache); dur. 0 ms 61964 starting kmem_cache_reap(linkinfo_cache) 61964 finished kmem_cache_reap(linkinfo_cache); dur. 0 ms 61964 starting kmem_cache_reap(ciputctrl_cache) 61964 finished kmem_cache_reap(ciputctrl_cache); dur. 0 ms 61964 starting kmem_cache_reap(serializer_cache) 61964 finished kmem_cache_reap(serializer_cache); dur. 0 ms 61964 starting kmem_cache_reap(as_cache) 61964 finished kmem_cache_reap(as_cache); dur. 0 ms 61964 starting kmem_cache_reap(marker_cache) 61964 finished kmem_cache_reap(marker_cache); dur. 0 ms 61964 starting kmem_cache_reap(anon_cache) 61964 finished kmem_cache_reap(anon_cache); dur. 0 ms 61964 starting kmem_cache_reap(anonmap_cache) 61964 finished kmem_cache_reap(anonmap_cache); dur. 0 ms 61964 starting kmem_cache_reap(segvn_cache) 61964 finished kmem_cache_reap(segvn_cache); dur. 0 ms 61964 starting kmem_cache_reap(segvn_szc_cache1) 61964 finished kmem_cache_reap(segvn_szc_cache1); dur. 0 ms 61964 starting kmem_cache_reap(flk_edges) 61964 finished kmem_cache_reap(flk_edges); dur. 0 ms 61964 starting kmem_cache_reap(fdb_cache) 61964 finished kmem_cache_reap(fdb_cache); dur. 0 ms 61964 starting kmem_cache_reap(timer_cache) 61964 finished kmem_cache_reap(timer_cache); dur. 0 ms 61964 starting kmem_cache_reap(vmu_bound_cache) 61964 finished kmem_cache_reap(vmu_bound_cache); dur. 0 ms 61964 starting kmem_cache_reap(vmu_object_cache) 61964 finished kmem_cache_reap(vmu_object_cache); dur. 0 ms 61964 starting kmem_cache_reap(physio_buf_cache) 61964 finished kmem_cache_reap(physio_buf_cache); dur. 0 ms 61964 starting kmem_cache_reap(process_cache) 61964 finished kmem_cache_reap(process_cache); dur. 0 ms 61964 starting kmem_cache_reap(kcf_sreq_cache) 61964 finished kmem_cache_reap(kcf_sreq_cache); dur. 0 ms 61964 starting kmem_cache_reap(kcf_areq_cache) 61964 finished kmem_cache_reap(kcf_areq_cache); dur. 0 ms 61964 starting kmem_cache_reap(kcf_context_cache) 61964 finished kmem_cache_reap(kcf_context_cache); dur. 0 ms 61964 starting kmem_cache_reap(clnt_clts_endpnt_cache) 61964 finished kmem_cache_reap(clnt_clts_endpnt_cache); dur. 0 ms 61964 starting kmem_cache_reap(zfs_btree_leaf_cache) 61964 finished kmem_cache_reap(zfs_btree_leaf_cache); dur. 0 ms 61964 starting kmem_cache_reap(metaslab_alloc_trace_cache) 61964 finished kmem_cache_reap(metaslab_alloc_trace_cache); dur. 0 ms 61964 starting kmem_cache_reap(zio_cache) 61964 finished kmem_cache_reap(zio_cache); dur. 0 ms 61964 starting kmem_cache_reap(zio_link_cache) 61964 finished kmem_cache_reap(zio_link_cache); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_512) 61964 finished kmem_cache_reap(zio_buf_512); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_512) 61964 finished kmem_cache_reap(zio_data_buf_512); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_1024) 61964 finished kmem_cache_reap(zio_buf_1024); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_1024) 61964 finished kmem_cache_reap(zio_data_buf_1024); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_1536) 61964 finished kmem_cache_reap(zio_buf_1536); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_1536) 61964 finished kmem_cache_reap(zio_data_buf_1536); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_2048) 61964 finished kmem_cache_reap(zio_buf_2048); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_2048) 61964 finished kmem_cache_reap(zio_data_buf_2048); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_2560) 61964 finished kmem_cache_reap(zio_buf_2560); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_2560) 61964 finished kmem_cache_reap(zio_data_buf_2560); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_3072) 61964 finished kmem_cache_reap(zio_buf_3072); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_3072) 61964 finished kmem_cache_reap(zio_data_buf_3072); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_3584) 61964 finished kmem_cache_reap(zio_buf_3584); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_3584) 61964 finished kmem_cache_reap(zio_data_buf_3584); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_4096) 61964 finished kmem_cache_reap(zio_buf_4096); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_4096) 61964 finished kmem_cache_reap(zio_data_buf_4096); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_5120) 61964 finished kmem_cache_reap(zio_buf_5120); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_5120) 61964 finished kmem_cache_reap(zio_data_buf_5120); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_6144) 61964 finished kmem_cache_reap(zio_buf_6144); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_6144) 61964 finished kmem_cache_reap(zio_data_buf_6144); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_7168) 61964 finished kmem_cache_reap(zio_buf_7168); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_7168) 61964 finished kmem_cache_reap(zio_data_buf_7168); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_8192) 61964 finished kmem_cache_reap(zio_buf_8192); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_8192) 61964 finished kmem_cache_reap(zio_data_buf_8192); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_10240) 61964 finished kmem_cache_reap(zio_buf_10240); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_10240) 61964 finished kmem_cache_reap(zio_data_buf_10240); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_12288) 61964 finished kmem_cache_reap(zio_buf_12288); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_12288) 61964 finished kmem_cache_reap(zio_data_buf_12288); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_14336) 61964 finished kmem_cache_reap(zio_buf_14336); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_14336) 61964 finished kmem_cache_reap(zio_data_buf_14336); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_16384) 61964 finished kmem_cache_reap(zio_buf_16384); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_16384) 61964 finished kmem_cache_reap(zio_data_buf_16384); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_20480) 61964 finished kmem_cache_reap(zio_buf_20480); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_20480) 61964 finished kmem_cache_reap(zio_data_buf_20480); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_24576) 61964 finished kmem_cache_reap(zio_buf_24576); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_24576) 61964 finished kmem_cache_reap(zio_data_buf_24576); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_28672) 61964 finished kmem_cache_reap(zio_buf_28672); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_28672) 61964 finished kmem_cache_reap(zio_data_buf_28672); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_32768) 61964 finished kmem_cache_reap(zio_buf_32768); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_32768) 61964 finished kmem_cache_reap(zio_data_buf_32768); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_40960) 61964 finished kmem_cache_reap(zio_buf_40960); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_40960) 61964 finished kmem_cache_reap(zio_data_buf_40960); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_49152) 61964 finished kmem_cache_reap(zio_buf_49152); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_49152) 61964 finished kmem_cache_reap(zio_data_buf_49152); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_57344) 61964 finished kmem_cache_reap(zio_buf_57344); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_57344) 61964 finished kmem_cache_reap(zio_data_buf_57344); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_65536) 61964 finished kmem_cache_reap(zio_buf_65536); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_65536) 61964 finished kmem_cache_reap(zio_data_buf_65536); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_81920) 61964 finished kmem_cache_reap(zio_buf_81920); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_81920) 61964 finished kmem_cache_reap(zio_data_buf_81920); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_98304) 61964 finished kmem_cache_reap(zio_buf_98304); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_98304) 61964 finished kmem_cache_reap(zio_data_buf_98304); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_114688) 61964 finished kmem_cache_reap(zio_buf_114688); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_114688) 61964 finished kmem_cache_reap(zio_data_buf_114688); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_131072) 61964 finished kmem_cache_reap(zio_buf_131072); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_131072) 61964 finished kmem_cache_reap(zio_data_buf_131072); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_163840) 61964 finished kmem_cache_reap(zio_buf_163840); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_163840) 61964 finished kmem_cache_reap(zio_data_buf_163840); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_196608) 61964 finished kmem_cache_reap(zio_buf_196608); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_196608) 61964 finished kmem_cache_reap(zio_data_buf_196608); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_229376) 61964 finished kmem_cache_reap(zio_buf_229376); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_229376) 61964 finished kmem_cache_reap(zio_data_buf_229376); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_262144) 61964 finished kmem_cache_reap(zio_buf_262144); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_262144) 61964 finished kmem_cache_reap(zio_data_buf_262144); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_327680) 61964 finished kmem_cache_reap(zio_buf_327680); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_327680) 61964 finished kmem_cache_reap(zio_data_buf_327680); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_393216) 61964 finished kmem_cache_reap(zio_buf_393216); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_393216) 61964 finished kmem_cache_reap(zio_data_buf_393216); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_458752) 61964 finished kmem_cache_reap(zio_buf_458752); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_458752) 61964 finished kmem_cache_reap(zio_data_buf_458752); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_524288) 61964 finished kmem_cache_reap(zio_buf_524288); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_524288) 61964 finished kmem_cache_reap(zio_data_buf_524288); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_655360) 61964 finished kmem_cache_reap(zio_buf_655360); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_655360) 61964 finished kmem_cache_reap(zio_data_buf_655360); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_786432) 61964 finished kmem_cache_reap(zio_buf_786432); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_786432) 61964 finished kmem_cache_reap(zio_data_buf_786432); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_917504) 61964 finished kmem_cache_reap(zio_buf_917504); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_917504) 61964 finished kmem_cache_reap(zio_data_buf_917504); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_1048576) 61964 finished kmem_cache_reap(zio_buf_1048576); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_1048576) 61964 finished kmem_cache_reap(zio_data_buf_1048576); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_1310720) 61964 finished kmem_cache_reap(zio_buf_1310720); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_1310720) 61964 finished kmem_cache_reap(zio_data_buf_1310720); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_1572864) 61964 finished kmem_cache_reap(zio_buf_1572864); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_1572864) 61964 finished kmem_cache_reap(zio_data_buf_1572864); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_1835008) 61964 finished kmem_cache_reap(zio_buf_1835008); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_1835008) 61964 finished kmem_cache_reap(zio_data_buf_1835008); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_2097152) 61964 finished kmem_cache_reap(zio_buf_2097152); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_2097152) 61964 finished kmem_cache_reap(zio_data_buf_2097152); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_2621440) 61964 finished kmem_cache_reap(zio_buf_2621440); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_2621440) 61964 finished kmem_cache_reap(zio_data_buf_2621440); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_3145728) 61964 finished kmem_cache_reap(zio_buf_3145728); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_3145728) 61964 finished kmem_cache_reap(zio_data_buf_3145728); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_3670016) 61964 finished kmem_cache_reap(zio_buf_3670016); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_3670016) 61964 finished kmem_cache_reap(zio_data_buf_3670016); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_4194304) 61964 finished kmem_cache_reap(zio_buf_4194304); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_4194304) 61964 finished kmem_cache_reap(zio_data_buf_4194304); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_5242880) 61964 finished kmem_cache_reap(zio_buf_5242880); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_5242880) 61964 finished kmem_cache_reap(zio_data_buf_5242880); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_6291456) 61964 finished kmem_cache_reap(zio_buf_6291456); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_6291456) 61964 finished kmem_cache_reap(zio_data_buf_6291456); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_7340032) 61964 finished kmem_cache_reap(zio_buf_7340032); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_7340032) 61964 finished kmem_cache_reap(zio_data_buf_7340032); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_8388608) 61964 finished kmem_cache_reap(zio_buf_8388608); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_8388608) 61964 finished kmem_cache_reap(zio_data_buf_8388608); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_10485760) 61964 finished kmem_cache_reap(zio_buf_10485760); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_10485760) 61964 finished kmem_cache_reap(zio_data_buf_10485760); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_12582912) 61964 finished kmem_cache_reap(zio_buf_12582912); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_12582912) 61964 finished kmem_cache_reap(zio_data_buf_12582912); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_14680064) 61964 finished kmem_cache_reap(zio_buf_14680064); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_14680064) 61964 finished kmem_cache_reap(zio_data_buf_14680064); dur. 0 ms 61964 starting kmem_cache_reap(zio_buf_16777216) 61964 finished kmem_cache_reap(zio_buf_16777216); dur. 0 ms 61964 starting kmem_cache_reap(zio_data_buf_16777216) 61964 finished kmem_cache_reap(zio_data_buf_16777216); dur. 0 ms 61964 starting kmem_cache_reap(abd_chunk) 61964 finished kmem_cache_reap(abd_chunk); dur. 0 ms 61964 starting kmem_cache_reap(sa_cache) 61964 finished kmem_cache_reap(sa_cache); dur. 0 ms 61964 starting kmem_cache_reap(dnode_t) 61964 finished kmem_cache_reap(dnode_t); dur. 0 ms 61964 starting kmem_cache_reap(arc_buf_hdr_t_full) 61964 finished kmem_cache_reap(arc_buf_hdr_t_full); dur. 0 ms 61964 starting kmem_cache_reap(arc_buf_hdr_t_full_crypt) 61964 finished kmem_cache_reap(arc_buf_hdr_t_full_crypt); dur. 0 ms 61964 starting kmem_cache_reap(arc_buf_hdr_t_l2only) 61964 finished kmem_cache_reap(arc_buf_hdr_t_l2only); dur. 0 ms 61964 starting kmem_cache_reap(arc_buf_t) 61964 finished kmem_cache_reap(arc_buf_t); dur. 0 ms 61964 starting kmem_cache_reap(dmu_buf_impl_t) 61964 finished kmem_cache_reap(dmu_buf_impl_t); dur. 0 ms 61964 starting kmem_cache_reap(zil_lwb_cache) 61964 finished kmem_cache_reap(zil_lwb_cache); dur. 0 ms 61964 starting kmem_cache_reap(zil_zcw_cache) 61964 finished kmem_cache_reap(zil_zcw_cache); dur. 0 ms 61964 starting kmem_cache_reap(sio_cache_0) 61964 finished kmem_cache_reap(sio_cache_0); dur. 0 ms 61964 starting kmem_cache_reap(sio_cache_1) 61964 finished kmem_cache_reap(sio_cache_1); dur. 0 ms 61964 starting kmem_cache_reap(sio_cache_2) 61964 finished kmem_cache_reap(sio_cache_2); dur. 0 ms 61964 starting kmem_cache_reap(zfs_znode_cache) 61964 finished kmem_cache_reap(zfs_znode_cache); dur. 0 ms 61964 starting kmem_cache_reap(blkdev1_xfer) 61964 finished kmem_cache_reap(blkdev1_xfer); dur. 0 ms 61964 starting kmem_cache_reap(bootfs_node_cache) 61964 finished kmem_cache_reap(bootfs_node_cache); dur. 0 ms 61964 starting kmem_cache_reap(audit_proc) 61964 finished kmem_cache_reap(audit_proc); dur. 0 ms 61964 starting kmem_cache_reap(drv_secobj_cache) 61964 finished kmem_cache_reap(drv_secobj_cache); dur. 0 ms 61964 starting kmem_cache_reap(dld_str_cache) 61964 finished kmem_cache_reap(dld_str_cache); dur. 0 ms 61964 starting kmem_cache_reap(ip_minor_arena_sa_1) 61964 finished kmem_cache_reap(ip_minor_arena_sa_1); dur. 0 ms 61964 starting kmem_cache_reap(ip_minor_arena_la_1) 61964 finished kmem_cache_reap(ip_minor_arena_la_1); dur. 0 ms 61964 starting kmem_cache_reap(ip_conn_cache) 61964 finished kmem_cache_reap(ip_conn_cache); dur. 0 ms 61964 starting kmem_cache_reap(tcp_conn_cache) 61964 finished kmem_cache_reap(tcp_conn_cache); dur. 0 ms 61964 starting kmem_cache_reap(udp_conn_cache) 61964 finished kmem_cache_reap(udp_conn_cache); dur. 0 ms 61964 starting kmem_cache_reap(rawip_conn_cache) 61964 finished kmem_cache_reap(rawip_conn_cache); dur. 0 ms 61964 starting kmem_cache_reap(rts_conn_cache) 61964 finished kmem_cache_reap(rts_conn_cache); dur. 0 ms 61964 starting kmem_cache_reap(ire_cache) 61964 finished kmem_cache_reap(ire_cache); dur. 0 ms 61964 starting kmem_cache_reap(ncec_cache) 61964 finished kmem_cache_reap(ncec_cache); dur. 0 ms 61964 starting kmem_cache_reap(nce_cache) 61964 finished kmem_cache_reap(nce_cache); dur. 0 ms 61964 starting kmem_cache_reap(rt_entry) 61964 finished kmem_cache_reap(rt_entry); dur. 0 ms 61964 starting kmem_cache_reap(radix_mask) 61964 finished kmem_cache_reap(radix_mask); dur. 0 ms 61964 starting kmem_cache_reap(radix_node) 61964 finished kmem_cache_reap(radix_node); dur. 0 ms 61964 starting kmem_cache_reap(ipsec_actions) 61964 finished kmem_cache_reap(ipsec_actions); dur. 0 ms 61964 starting kmem_cache_reap(ipsec_selectors) 61964 finished kmem_cache_reap(ipsec_selectors); dur. 0 ms 61964 starting kmem_cache_reap(ipsec_policy) 61964 finished kmem_cache_reap(ipsec_policy); dur. 0 ms 61964 starting kmem_cache_reap(tcp_timercache) 61964 finished kmem_cache_reap(tcp_timercache); dur. 0 ms 61964 starting kmem_cache_reap(tcp_notsack_blk_cache) 61964 finished kmem_cache_reap(tcp_notsack_blk_cache); dur. 0 ms 61964 starting kmem_cache_reap(squeue_cache) 61964 finished kmem_cache_reap(squeue_cache); dur. 0 ms 61964 starting kmem_cache_reap(sctp_conn_cache) 61964 finished kmem_cache_reap(sctp_conn_cache); dur. 0 ms 61964 starting kmem_cache_reap(sctp_faddr_cache) 61964 finished kmem_cache_reap(sctp_faddr_cache); dur. 0 ms 61964 starting kmem_cache_reap(sctp_set_cache) 61965 finished kmem_cache_reap(sctp_set_cache); dur. 0 ms 61965 starting kmem_cache_reap(sctp_ftsn_set_cache) 61965 finished kmem_cache_reap(sctp_ftsn_set_cache); dur. 0 ms 61965 starting kmem_cache_reap(dce_cache) 61965 finished kmem_cache_reap(dce_cache); dur. 0 ms 61965 starting kmem_cache_reap(ire_gw_secattr_cache) 61965 finished kmem_cache_reap(ire_gw_secattr_cache); dur. 0 ms 61965 starting kmem_cache_reap(socket_cache) 61965 finished kmem_cache_reap(socket_cache); dur. 0 ms 61965 starting kmem_cache_reap(socktpi_cache) 61965 finished kmem_cache_reap(socktpi_cache); dur. 0 ms 61965 starting kmem_cache_reap(socktpi_unix_cache) 61965 finished kmem_cache_reap(socktpi_unix_cache); dur. 0 ms 61965 starting kmem_cache_reap(sock_sod_cache) 61965 finished kmem_cache_reap(sock_sod_cache); dur. 0 ms 61965 starting kmem_cache_reap(exacct_object_cache) 61965 finished kmem_cache_reap(exacct_object_cache); dur. 0 ms 61965 starting kmem_cache_reap(kssl_cache) 61965 finished kmem_cache_reap(kssl_cache); dur. 0 ms 61965 starting kmem_cache_reap(fctl_cache) 61965 finished kmem_cache_reap(fctl_cache); dur. 0 ms 61965 starting kmem_cache_reap(tl_cache) 61965 finished kmem_cache_reap(tl_cache); dur. 0 ms 61965 starting kmem_cache_reap(keysock_1) 61965 finished kmem_cache_reap(keysock_1); dur. 0 ms 61965 starting kmem_cache_reap(spdsock_1) 61965 finished kmem_cache_reap(spdsock_1); dur. 0 ms 61965 starting kmem_cache_reap(rds_alloc_cache) 61965 finished kmem_cache_reap(rds_alloc_cache); dur. 0 ms 61965 starting kmem_cache_reap(port_cache) 61965 finished kmem_cache_reap(port_cache); dur. 0 ms 61965 starting kmem_cache_reap(softmac_cache) 61965 finished kmem_cache_reap(softmac_cache); dur. 0 ms 61965 starting kmem_cache_reap(softmac_upper_cache) 61965 finished kmem_cache_reap(softmac_upper_cache); dur. 0 ms 61965 starting kmem_cache_reap(lnode_cache) 61965 finished kmem_cache_reap(lnode_cache); dur. 0 ms 61965 starting kmem_cache_reap(Hex0xfffffe06519d3518_minor_1) 61965 finished kmem_cache_reap(Hex0xfffffe06519d3518_minor_1); dur. 0 ms 61965 starting kmem_cache_reap(Hex0xfffffe06519d3520_minor_1) 61965 finished kmem_cache_reap(Hex0xfffffe06519d3520_minor_1); dur. 0 ms 61965 starting kmem_cache_reap(blkdev2_xfer) 61965 finished kmem_cache_reap(blkdev2_xfer); dur. 0 ms 61965 starting kmem_cache_reap(idm_buf_cache) 61965 finished kmem_cache_reap(idm_buf_cache); dur. 0 ms 61965 starting kmem_cache_reap(idm_task_cache) 61965 finished kmem_cache_reap(idm_task_cache); dur. 0 ms 61965 starting kmem_cache_reap(idm_tx_pdu_cache) 61965 finished kmem_cache_reap(idm_tx_pdu_cache); dur. 0 ms 61965 starting kmem_cache_reap(idm_rx_pdu_cache) 61965 finished kmem_cache_reap(idm_rx_pdu_cache); dur. 0 ms 61965 starting kmem_cache_reap(idm_128k_buf_cache) 61965 finished kmem_cache_reap(idm_128k_buf_cache); dur. 0 ms 61965 starting kmem_cache_reap(dtrace_state_cache) 61965 finished kmem_cache_reap(dtrace_state_cache); dur. 0 ms 61965 starting kmem_cache_reap(ufs_inode_cache) 61965 finished kmem_cache_reap(ufs_inode_cache); dur. 0 ms 61965 starting kmem_cache_reap(directio_buf_cache) 61965 finished kmem_cache_reap(directio_buf_cache); dur. 0 ms 61965 starting kmem_cache_reap(lufs_save) 61965 finished kmem_cache_reap(lufs_save); dur. 0 ms 61965 starting kmem_cache_reap(lufs_bufs) 61965 finished kmem_cache_reap(lufs_bufs); dur. 0 ms 61965 starting kmem_cache_reap(lufs_mapentry_cache) 61965 finished kmem_cache_reap(lufs_mapentry_cache); dur. 0 ms 61965 starting kmem_cache_reap(pty_map) 61965 finished kmem_cache_reap(pty_map); dur. 0 ms 61965 starting kmem_cache_reap(authkern_cache) 61965 finished kmem_cache_reap(authkern_cache); dur. 0 ms 61965 starting kmem_cache_reap(authnone_cache) 61965 finished kmem_cache_reap(authnone_cache); dur. 0 ms 61965 starting kmem_cache_reap(authloopback_cache) 61965 finished kmem_cache_reap(authloopback_cache); dur. 0 ms 61965 starting kmem_cache_reap(authdes_cache_handle) 61965 finished kmem_cache_reap(authdes_cache_handle); dur. 0 ms 61965 starting kmem_cache_reap(rnode_cache) 61966 finished kmem_cache_reap(rnode_cache); dur. 0 ms 61966 starting kmem_cache_reap(nfs_access_cache) 61966 finished kmem_cache_reap(nfs_access_cache); dur. 0 ms 61966 starting kmem_cache_reap(client_handle_cache) 61966 finished kmem_cache_reap(client_handle_cache); dur. 0 ms 61966 starting kmem_cache_reap(rnode4_cache) 61966 finished kmem_cache_reap(rnode4_cache); dur. 0 ms 61966 starting kmem_cache_reap(svnode_cache) 61966 finished kmem_cache_reap(svnode_cache); dur. 0 ms 61966 starting kmem_cache_reap(nfs4_access_cache) 61966 finished kmem_cache_reap(nfs4_access_cache); dur. 0 ms 61966 starting kmem_cache_reap(client_handle4_cache) 61966 finished kmem_cache_reap(client_handle4_cache); dur. 0 ms 61966 starting kmem_cache_reap(nfs4_ace4vals_cache) 61966 finished kmem_cache_reap(nfs4_ace4vals_cache); dur. 0 ms 61966 starting kmem_cache_reap(nfs4_ace4_list_cache) 61966 finished kmem_cache_reap(nfs4_ace4_list_cache); dur. 0 ms 61966 starting kmem_cache_reap(NFS_idmap_cache) 61966 finished kmem_cache_reap(NFS_idmap_cache); dur. 0 ms 61966 starting kmem_cache_reap(nlm_host_cache) 61967 finished kmem_cache_reap(nlm_host_cache); dur. 0 ms 61967 starting kmem_cache_reap(nlm_vhold_cache) 61967 finished kmem_cache_reap(nlm_vhold_cache); dur. 0 ms 61967 starting kmem_cache_reap(nlm_rpch_cache) 61967 finished kmem_cache_reap(nlm_rpch_cache); dur. 0 ms 61967 starting kmem_cache_reap(aggr_port_cache) 61967 finished kmem_cache_reap(aggr_port_cache); dur. 0 ms 61967 starting kmem_cache_reap(aggr_grp_cache) 61967 finished kmem_cache_reap(aggr_grp_cache); dur. 0 ms 61967 starting kmem_cache_reap(crypto_session_cache) 61967 finished kmem_cache_reap(crypto_session_cache); dur. 0 ms 61967 starting kmem_cache_reap(fcsm_job_cache) 61967 finished kmem_cache_reap(fcsm_job_cache); dur. 0 ms 61967 starting kmem_cache_reap(iptun_cache) 61967 finished kmem_cache_reap(iptun_cache); dur. 0 ms 61967 starting kmem_cache_reap(vnic_cache) 61967 finished kmem_cache_reap(vnic_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_share_cache) 61967 finished kmem_cache_reap(smb_share_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_unexport_cache) 61967 finished kmem_cache_reap(smb_unexport_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_mbc_cache) 61967 finished kmem_cache_reap(smb_mbc_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_mbuf_cache) 61967 finished kmem_cache_reap(smb_mbuf_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_mbufcl_cache) 61967 finished kmem_cache_reap(smb_mbufcl_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_node_cache) 61967 finished kmem_cache_reap(smb_node_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_lease_cache) 61967 finished kmem_cache_reap(smb_lease_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_request_cache) 61967 finished kmem_cache_reap(smb_request_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_session_cache) 61967 finished kmem_cache_reap(smb_session_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_user_cache) 61967 finished kmem_cache_reap(smb_user_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_tree_cache) 61967 finished kmem_cache_reap(smb_tree_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_ofile_cache) 61967 finished kmem_cache_reap(smb_ofile_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_odir_cache) 61967 finished kmem_cache_reap(smb_odir_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_opipe_cache) 61967 finished kmem_cache_reap(smb_opipe_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_event_cache) 61967 finished kmem_cache_reap(smb_event_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_lock_cache) 61967 finished kmem_cache_reap(smb_lock_cache); dur. 0 ms 61967 starting kmem_cache_reap(smb_dtor_cache) 61967 finished kmem_cache_reap(smb_dtor_cache); dur. 0 ms 61967 kmem_reap_done()! took 35 ms 61971 2020 Sep 17 21:36:54: kmem_reaping = 1 62970 2020 Sep 17 21:36:55: kmem_reaping = 1 63467 kmem_reap_timeout()! 63970 2020 Sep 17 21:36:56: kmem_reaping = 0 64970 2020 Sep 17 21:36:57: kmem_reaping = 0 65970 2020 Sep 17 21:36:58: kmem_reaping = 0 66970 2020 Sep 17 21:36:59: kmem_reaping = 0 67970 2020 Sep 17 21:37:00: kmem_reaping = 0 68970 2020 Sep 17 21:37:01: kmem_reaping = 0 69970 2020 Sep 17 21:37:02: kmem_reaping = 0 70970 2020 Sep 17 21:37:03: kmem_reaping = 0 71970 2020 Sep 17 21:37:04: kmem_reaping = 0 72970 2020 Sep 17 21:37:05: kmem_reaping = 0 73970 2020 Sep 17 21:37:06: kmem_reaping = 0 74970 2020 Sep 17 21:37:07: kmem_reaping = 0 75969 2020 Sep 17 21:37:08: kmem_reaping = 0 76969 2020 Sep 17 21:37:09: kmem_reaping = 0 77969 2020 Sep 17 21:37:10: kmem_reaping = 0 78969 2020 Sep 17 21:37:11: kmem_reaping = 0 79969 2020 Sep 17 21:37:12: kmem_reaping = 0 80969 2020 Sep 17 21:37:13: kmem_reaping = 0 81969 2020 Sep 17 21:37:14: kmem_reaping = 0 82969 2020 Sep 17 21:37:15: kmem_reaping = 0 83969 2020 Sep 17 21:37:16: kmem_reaping = 0 84969 2020 Sep 17 21:37:17: kmem_reaping = 0 85969 2020 Sep 17 21:37:18: kmem_reaping = 0 86969 2020 Sep 17 21:37:19: kmem_reaping = 0 87968 2020 Sep 17 21:37:20: kmem_reaping = 0 88968 2020 Sep 17 21:37:21: kmem_reaping = 0 89968 2020 Sep 17 21:37:22: kmem_reaping = 0 ^C
Updated by Electric Monk over 1 year ago
- Status changed from New to Closed
- % Done changed from 0 to 100
git commit baf00aa88d7d535ed115175b04253f5db99a7d0b
commit baf00aa88d7d535ed115175b04253f5db99a7d0b Author: Joshua M. Clulow <josh@sysmgr.org> Date: 2020-09-23T22:22:51.000Z 13094 systems have more kmem caches than they used to Reviewed by: Andy Fiddaman <andy@omniosce.org> Reviewed by: Jason King <jason.brian.king@gmail.com> Reviewed by: Peter Tribble <peter.tribble@gmail.com> Approved by: Hans Rosenfeld <rosenfeld@grumpf.hope-2000.org>