Project

General

Profile

Bug #7097

::kmastat overflows columns with inscrutable output

Added by Robert Mustacchi over 3 years ago.

Status:
New
Priority:
Normal
Category:
mdb - modular debugger
Start date:
2016-06-09
Due date:
% Done:

100%

Estimated time:
Difficulty:
Medium
Tags:

Description

On big machines, the ::kmastat dcmd overflows its columns with output that quickly becomes inscrutable, e.g.:

> ::kmastat
cache                        buf    buf    buf    memory     alloc alloc 
name                        size in use  total    in use   succeed  fail 
------------------------- ------ ------ ------ ---------- --------- ----- 
kmem_magazine_1               16  80318  81073    1323008B     85161     0 
kmem_magazine_3               32  35505  47625    1560576B     57923     0 
kmem_magazine_7               64  26877  32550    2150400B     53061     0 
kmem_magazine_15             128  23415  28923    3821568B     48305     0 
kmem_magazine_31             256   4250   9270    2531328B     17539     0 
kmem_magazine_47             384   1973   4450    1822720B     10437     0 
kmem_magazine_63             512   2877  17269   10104832B     23597     0 
kmem_magazine_95             768   1067  29640   24281088B     33490     0 
kmem_magazine_143           1152  22752  22752   31064064B     22752     0 
kmem_slab_cache               72 995889 995940   74170368B   1006403     0 
kmem_bufctl_cache             24 4024107 4024199   98701312B   4078497     0 
kmem_bufctl_audit_cache      192      0      0          0B         0     0 
kmem_va_4096                4096 676592 676608 2771386368B    763681     0 
kmem_va_8192                8192  95408  95408  781582336B    102903     0 
kmem_va_12288              12288   1036   1040   13631488B      1036     0 
kmem_va_16384              16384  88626  88632 1452146688B     90692     0 
kmem_va_20480              20480    484    486   10616832B       544     0 
kmem_va_24576              24576    222    225    5898240B       222     0 
kmem_va_28672              28672    275    276    9043968B       275     0 
kmem_va_32768              32768   2117   2120   69468160B      2117     0 
kmem_alloc_8                   8 840156 842022    6856704B 110418245     0 
kmem_alloc_16                 16  57973  62750    1024000B  35057799     0 
kmem_alloc_24                 24 312089 369571    9064448B  36217640     0 
kmem_alloc_32                 32  49546  74000    2424832B 205487258     0 
kmem_alloc_40                 40  43588  73200    2998272B 152507245     0 
kmem_alloc_48                 48 990722 992016   48955392B  18905491     0 
kmem_alloc_56                 56 204971 211367   12193792B   9833563     0 
kmem_alloc_64                 64 399161 458676   30302208B 258868586     0 
kmem_alloc_80                 80 141689 187650   15372288B 909200751     0 
kmem_alloc_96                 96  31199  43091    4304896B  12488984     0 
kmem_alloc_112               112 140789 142625   16691200B 139426457     0 
kmem_alloc_128               128 130685 146475   19353600B  11989720     0 
kmem_alloc_160               160 192461 229900   37666816B  53566513     0 
kmem_alloc_192               192 326156 373460   76484608B   6034277     0 
kmem_alloc_224               224  43422 123692   29802496B  18730763     0 
kmem_alloc_256               256   3746  90210   24633344B  59244291     0 
kmem_alloc_320               320   4985   5772    1970176B  15630706     0 
kmem_alloc_384               384    549    750     307200B   1678332     0 
kmem_alloc_448               448    928   1032     528384B    630034     0 
kmem_alloc_512               512   1765   1880     962560B   4744098     0 
kmem_alloc_640               640   1449   1674    1142784B   1163845     0 
kmem_alloc_768               768    346    430     352256B    123777     0 
kmem_alloc_896               896  37071  37152   33816576B    106828     0 
kmem_alloc_1152             1152  18621  28287   33103872B  28065238     0 
kmem_alloc_1344             1344    205    261     356352B    294117     0 
kmem_alloc_1600             1600   1168   1255    2056192B    516260     0 
kmem_alloc_2048             2048   1637   2242    4591616B   1557437     0 
kmem_alloc_2688             2688   2016   2433    6643712B  15910584     0 
kmem_alloc_4096             4096 198003 199821  818466816B   4064492     0 
kmem_alloc_8192             8192   1752   1824   14942208B   2242601     0 
kmem_alloc_12288           12288     52     79     970752B    590868     0 
kmem_alloc_16384           16384    276    302    4947968B      7733     0 
kmem_alloc_24576           24576    118    144    3538944B      1164     0 
kmem_alloc_32768           32768   2041   2076   68026368B    123432     0 
kmem_alloc_40960           40960     34     52    2129920B       234     0 
kmem_alloc_49152           49152     25     41    2015232B       158     0 
kmem_alloc_57344           57344     22     39    2236416B       139     0 
kmem_alloc_65536           65536    115    142    9306112B     76035     0 
kmem_alloc_73728           73728     24     85    6266880B      2051     0 
kmem_alloc_81920           81920      3     21    1720320B       149     0 
kmem_alloc_90112           90112      4     21    1892352B        93     0 
kmem_alloc_98304           98304     17     31    3047424B        72     0 
kmem_alloc_106496         106496      3     18    1916928B        49     0 
kmem_alloc_114688         114688      3     13    1490944B        19     0 
kmem_alloc_122880         122880      1     10    1228800B        50     0 
kmem_alloc_131072         131072     18     49    6422528B      5792     0 
streams_mblk                  64  11647  13516     892928B 140594911     0 
streams_dblk_16              128    268   1457     192512B 1258995961     0 
streams_dblk_80              192    753   1840     376832B  68450015     0 
streams_dblk_144             256     33    435     118784B 1315787172     0 
streams_dblk_208             320    162   1272     434176B  28692798     0 
streams_dblk_272             384     40    990     405504B  14255849     0 
streams_dblk_336             448      0    312     159744B   2049222     0 
streams_dblk_528             640      0    834     569344B   6584732     0 
streams_dblk_1040           1152      0     98     114688B    373212     0 
streams_dblk_1488           1600     12    630    1032192B  18987983     0 
streams_dblk_1936           2048      0    742    1519616B  85663114     0 
streams_dblk_2576           2688      1    102     278528B  10001655     0 
streams_dblk_3856           3968      0     30     122880B     58857     0 
streams_dblk_8192            112      0   1271     167936B 147322002     0 
streams_dblk_12048         12160      0     30     368640B  49938778     0 
streams_dblk_16384           112      0    186      24576B    226311     0 
streams_dblk_20240         20352      0     77    1576960B    633720     0 
streams_dblk_24576           112      0     31       4096B      1197     0 
streams_dblk_28432         28544      0     17     487424B       832     0 
streams_dblk_32768           112      0     31       4096B       982     0 
streams_dblk_36624         36736      0     18     663552B       779     0 
streams_dblk_40960           112      0     31       4096B      1110     0 
streams_dblk_44816         44928      0     18     811008B       617     0 
streams_dblk_49152           112      0     31       4096B       657     0 
streams_dblk_53008         53120      0     17     905216B       378     0 
streams_dblk_57344           112      0     31       4096B       272     0 
streams_dblk_61200         61312      0     17    1044480B       165     0 
streams_dblk_65536           112      0     62       8192B       173     0 
streams_dblk_69392         69504      0     17    1183744B        67     0 
streams_dblk_73728           112      0     31       4096B        47     0 
streams_dblk_esb             112   1024   1147     151552B  22808305     0 
streams_fthdr                408      0      0          0B         0     0 
streams_ftblk                376      0      0          0B         0     0 
multidata                    248      0      0          0B         0     0 
multidata_pdslab            7112      0      0          0B         0     0 
multidata_pattbl              32      0      0          0B         0     0 
log_cons_cache                48     54    332      16384B      3922     0 
taskq_ent_cache               56   1538   2059     118784B     16381     0 
taskq_cache                  280    197    252      73728B      1277     0 
kmem_io_64G_128              128      0      0          0B         0     0 
kmem_io_64G_256              256      0      0          0B         0     0 
kmem_io_64G_512              512      0      0          0B         0     0 
kmem_io_64G_1024            1024      0      0          0B         0     0 
kmem_io_64G_2048            2048      0      0          0B         0     0 
kmem_io_64G_4096            4096      0      0          0B         0     0 
kmem_io_4G_128               128      0     93      12288B       137     0 
kmem_io_4G_256               256      0     90      24576B     14412     0 
kmem_io_4G_512               512      4      8       4096B         6     0 
kmem_io_4G_1024             1024      0      0          0B         0     0 
kmem_io_4G_2048             2048   1008   1008    2064384B      1008     0 
kmem_io_4G_4096             4096      0      0          0B         0     0 
kmem_io_2G_128               128      0      0          0B         0     0 
kmem_io_2G_256               256      0      0          0B         0     0 
kmem_io_2G_512               512      0      0          0B         0     0 
kmem_io_2G_1024             1024      0      0          0B         0     0 
kmem_io_2G_2048             2048      0      0          0B         0     0 
kmem_io_2G_4096             4096      0      0          0B         0     0 
kmem_io_16M_128              128      0      0          0B         0     0 
kmem_io_16M_256              256      0      0          0B         0     0 
kmem_io_16M_512              512      0      0          0B         0     0 
kmem_io_16M_1024            1024      0      0          0B         0     0 
kmem_io_16M_2048            2048      0      0          0B         0     0 
kmem_io_16M_4096            4096      0      0          0B         0     0 
id32_cache                    32      7    250       8192B      1163     0 
bp_map_4096                 4096      0      0          0B         0     0 
bp_map_8192                 8192      0     48     393216B     11730     0 
bp_map_12288               12288      0      0          0B         0     0 
bp_map_16384               16384      0      8     131072B         2     0 
bp_map_20480               20480      0      0          0B         0     0 
bp_map_24576               24576      0      0          0B         0     0 
bp_map_28672               28672      0      0          0B         0     0 
bp_map_32768               32768      0      0          0B         0     0 
htable_t                      72  20413  20845    1552384B   4906461     0 
hment_t                       64 119576 148304    9797632B 212480381     0 
hat_t                        176    280    484      90112B    671721     0 
HatHash                    65536     17     57    3735552B     33075     0 
HatVlpHash                  4096    263    334    1368064B    797197     0 
zfs_file_data_4096          4096  69170  69184  283377664B     70104     0 
zfs_file_data_8192          8192  47808  47808  391643136B     47808     0 
zfs_file_data_12288        12288  38121  38130  499777536B     38121     0 
zfs_file_data_16384        16384   8307   8312  136183808B      8307     0 
zfs_file_data_20480        20480  35855  35856  783286272B     35855     0 
zfs_file_data_24576        24576   8715   8715  228458496B      8715     0 
zfs_file_data_28672        28672  19092  19092  625606656B     19092     0 
zfs_file_data_32768        32768   4894   4896  160432128B      4894     0 
segkp_4096                  4096    265    336    1376256B    591481     0 
segkp_8192                  8192      0      0          0B         0     0 
segkp_12288                12288      0      0          0B         0     0 
segkp_16384                16384      0      0          0B         0     0 
segkp_20480                20480      0      0          0B         0     0 
umem_np_4096                4096      1     32     131072B      1416     0 
umem_np_8192                8192      2     32     262144B       337     0 
umem_np_12288              12288      0      0          0B         0     0 
umem_np_16384              16384      0     24     393216B       800     0 
umem_np_20480              20480      0     18     393216B       238     0 
umem_np_24576              24576      0     10     262144B        29     0 
umem_np_28672              28672      0      0          0B         0     0 
umem_np_32768              32768      0     20     655360B       334     0 
mod_hash_entries              24   1349   2004      49152B     75019     0 
ipp_mod                      304      0      0          0B         0     0 
ipp_action                   368      0      0          0B         0     0 
ipp_packet                    64      0      0          0B         0     0 
seg_cache                     96  14994  17302    1728512B  29998680     0 
seg_pcache                   104      0     38       4096B         7     0 
fnode_cache                  176    217    240      49152B    325762     0 
pipe_cache                   320    143    240      81920B    296068     0 
snode_cache                  152    692    884     139264B    683823     0 
dv_node_cache                176     93    528      98304B       617     0 
mac_impl_cache             13568     17     21     286720B        20     0 
mac_ring_cache               192      8     20       4096B        14     0 
flow_entry_cache           27112     21     32     868352B        28     0 
flow_tab_cache               216     17     36       8192B        20     0 
mac_soft_ring_cache          376     42     60      24576B        57     0 
mac_srs_cache               3240     28     30      98304B        36     0 
mac_bcast_grp_cache           80      4     50       4096B         8     0 
mac_client_impl_cache       2096     17     27      61440B        20     0 
mac_promisc_impl_cache       112      1     35       4096B         2     0 
dls_link_cache               344     17     22       8192B        20     0 
dls_devnet_cache             368     17     20       8192B        20     0 
sdev_node_cache              256   1932   2010     548864B      6350     0 
dev_info_node_cache          680    186    198     135168B      1560     0 
ndi_fm_entry_cache            32   3592   4125     135168B  14969142     0 
thread_cache                 912   1390  22676   23220224B 134532232     0 
lwp_cache                   1760   1583   1872    3407872B    128386     0 
turnstile_cache               64   2328  24180    1597440B 133884132     0 
tslabel_cache                 48      2     83       4096B         2     0 
cred_cache                   184    685    861     167936B   1168204     0 
rctl_cache                    48   4672   5644     278528B   4896727     0 
rctl_val_cache                64   8793  10788     712704B  10022262     0 
task_cache                   160    207    325      53248B      1436     0 
kmem_defrag_cache            216      2     18       4096B         2     0 
kmem_move_cache               56      0      0          0B         0     0 
rootnex_dmahdl              2592   3606   4017   10969088B  15014587     0 
timeout_request              128      1     31       4096B         1     0 
cyclic_id_cache               72     77    220      16384B   2453637     0 
callout_cachebabecafe         80   2862   2883     380928B      2862     0 
callout_lcachebabecafe        48   4452   4464     294912B      4452     0 
dnlc_space_cache              24      0      0          0B         0     0 
vfs_cache                    208    376    418      90112B       482     0 
vn_cache                     208 384881 408225  111472640B  48211609     0 
vsk_anchor_cache              40    104    200       8192B       313     0 
file_cache                    56   2577   3053     176128B  24838878     0 
stream_head_cache            376   1069   1210     495616B    655130     0 
queue_cache                  656   1752   1902    1298432B    702258     0 
syncq_cache                  160     17     50       8192B       115     0 
qband_cache                   64      0      0          0B         0     0 
linkinfo_cache                48     32     83       4096B        34     0 
ciputctrl_cache             1024      0      0          0B         0     0 
serializer_cache              64    224    372      24576B      2875     0 
as_cache                     232    279    476     114688B    671726     0 
marker_cache                 120      0    165      20480B   1847220     0 
anon_cache                    48 2828585 3762888  185696256B 267696787     0 
anonmap_cache                112  10378  12040    1409024B  15759775     0 
segvn_cache                  168  14992  17181    3059712B  25872750     0 
segvn_szc_cache1            4096      0     48     196608B    162679     0 
segvn_szc_cache2          2097152      0      0          0B         0     0 
flk_edges                     48      0      0          0B         0     0 
fdb_cache                    104      0      0          0B         0     0 
timer_cache                  136      9     29       4096B         9     0 
vmu_bound_cache               56      0      0          0B         0     0 
vmu_object_cache              64      0      0          0B         0     0 
physio_buf_cache             248      0     16       4096B        26     0 
process_cache               3880    296    366    1499136B    448114     0 
ufs_inode_cache              368   4833   4840    1982464B      4834     0 
directio_buf_cache           272      0      0          0B         0     0 
lufs_save                     24      0      0          0B         0     0 
lufs_bufs                    256      0      0          0B         0     0 
lufs_mapentry_cache          112      0      0          0B         0     0 
audit_proc                    40    297    700      28672B    389315     0 
drv_secobj_cache             296      0      0          0B         0     0 
dld_str_cache                304     27     52      16384B        93     0 
kcf_sreq_cache                56      0      0          0B         0     0 
kcf_areq_cache               296      0      0          0B         0     0 
kcf_context_cache            112      0      0          0B         0     0 
ip_minor_arena_sa_1            1     10     64         64B     13570     0 
ip_minor_arena_la_1            1     26    128        128B     24130     0 
ip_conn_cache                720      0     15      12288B        25     0 
tcp_conn_cache              1808     78    314     643072B     88995     0 
udp_conn_cache              1256     56    153     208896B     74331     0 
rawip_conn_cache            1096      0     14      16384B        50     0 
rts_conn_cache               816     28     63      57344B       237     0 
ire_cache                    352    289    297     110592B       432     0 
ncec_cache                   200     94    120      24576B       344     0 
nce_cache                     88     94    135      12288B       398     0 
rt_entry                     152    181    182      28672B       324     0 
radix_mask                    32     39    125       4096B        65     0 
radix_node                   120      2     33       4096B         2     0 
ipsec_actions                 72      0      0          0B         0     0 
ipsec_selectors               80      0      0          0B         0     0 
ipsec_policy                  80      0      0          0B         0     0 
tcp_timercache                88    594    765      69632B      6127     0 
tcp_notsack_blk_cache         24      0    167       4096B      8034     0 
squeue_cache                 168     29     40       8192B        29     0 
sctp_conn_cache             2528      0      0          0B         0     0 
sctp_faddr_cache             176      0      0          0B         0     0 
sctp_set_cache                24      0      0          0B         0     0 
sctp_ftsn_set_cache           16      0      0          0B         0     0 
dce_cache                    152    216    234      36864B       216     0 
ire_gw_secattr_cache          24      0      0          0B         0     0 
socket_cache                 640    134    234     159744B    285009     0 
socktpi_cache                944      0      8       8192B        13     0 
socktpi_unix_cache           944    387    464     475136B      3094     0 
sock_sod_cache               648      0      0          0B         0     0 
exacct_object_cache           40      0      0          0B         0     0 
kssl_cache                  1624      0      0          0B         0     0 
tl_cache                     432    398    477     217088B      3113     0 
keysock_1                      1      0      0          0B         0     0 
spdsock_1                      1      0     64         64B        13     0 
namefs_inodes_1                1     97    128        128B       103     0 
port_cache                    80     55    250      20480B     50917     0 
clnt_clts_endpnt_cache        88      0      0          0B         0     0 
zio_cache                    880      1  47745   43458560B 169476546     0 
zio_link_cache                48      0  48555    2396160B  45889167     0 
zio_buf_512                  512 850150 850992  435707904B   3445343     0 
zio_data_buf_512             512  90121  90176   46170112B    472413     0 
zio_buf_1024                1024  14762  14996   15355904B    535286     0 
zio_data_buf_1024           1024  45961  45992   47095808B    244352     0 
zio_buf_1536                1536   3620   3696    5677056B     70310     0 
zio_data_buf_1536           1536  56639  56664   87035904B    172876     0 
zio_buf_2048                2048   1689   1758    3600384B    646983     0 
zio_data_buf_2048           2048  53997  54048  110690304B    150743     0 
zio_buf_2560                2560    847    912    2334720B    105986     0 
zio_data_buf_2560           2560  38865  38896   99573760B    119252     0 
zio_buf_3072                3072    830    892    2740224B     86581     0 
zio_data_buf_3072           3072  24713  24736   75988992B     89650     0 
zio_buf_3584                3584    443    472    1691648B    168022     0 
zio_data_buf_3584           3584  21054  21072   75522048B     91188     0 
zio_buf_4096                4096   1293   1456    5963776B    940420     0 
zio_data_buf_4096           4096  19349  19376   79364096B     81950     0 
zio_buf_5120                5120    528    556    2846720B    139444     0 
zio_data_buf_5120           5120  30704  30728  157327360B    142335     0 
zio_buf_6144                6144    297    326    2002944B    194138     0 
zio_data_buf_6144           6144  20331  20354  125054976B    113376     0 
zio_buf_7168                7168    338    364    2609152B    122395     0 
zio_data_buf_7168           7168  17993  18020  129167360B    101715     0 
zio_buf_8192                8192     49     76     622592B    182327     0 
zio_data_buf_8192           8192  47770  47808  391643136B    118689     0 
zio_buf_10240              10240    106    132    1351680B    118091     0 
zio_data_buf_10240         10240  19897  19920  203980800B    138332     0 
zio_buf_12288              12288     54     79     970752B    218646     0 
zio_data_buf_12288         12288  14652  14677  180350976B    110521     0 
zio_buf_14336              14336     20     42     602112B     56466     0 
zio_data_buf_14336         14336   9862   9888  141754368B     91738     0 
zio_buf_16384              16384  87969  88097 1443381248B   3253968     0 
zio_data_buf_16384         16384   8281   8307  136101888B    100772     0 
zio_buf_20480              20480     62     85    1740800B     59995     0 
zio_data_buf_20480         20480  13324  13351  273428480B    134230     0 
zio_buf_24576              24576     56     78    1916928B     26267     0 
zio_data_buf_24576         24576   8689   8715  214179840B    104891     0 
zio_buf_28672              28672     65     87    2494464B     11707     0 
zio_data_buf_28672         28672   6981   7009  200962048B     83885     0 
zio_buf_32768              32768     14     39    1277952B    120273     0 
zio_data_buf_32768         32768   4870   4894  160366592B     78577     0 
zio_buf_36864              36864     18     45    1658880B     66985     0 
zio_data_buf_36864         36864   3594   3614  133226496B     60235     0 
zio_buf_40960              40960     14     37    1515520B      4784     0 
zio_data_buf_40960         40960   3267   3288  134676480B     53570     0 
zio_buf_45056              45056      9     30    1351680B      3937     0 
zio_data_buf_45056         45056   2820   2843  128094208B     48080     0 
zio_buf_49152              49152      8     32    1572864B     60545     0 
zio_data_buf_49152         49152   2128   2153  105824256B     49599     0 
zio_buf_53248              53248      7     30    1597440B      3071     0 
zio_data_buf_53248         53248   1956   1979  105377792B     40953     0 
zio_buf_57344              57344      3     26    1490944B      2830     0 
zio_data_buf_57344         57344   1507   1533   87908352B     37452     0 
zio_buf_61440              61440      3     27    1658880B      2416     0 
zio_data_buf_61440         61440   1180   1203   73912320B     35828     0 
zio_buf_65536              65536      1     26    1703936B     28762     0 
zio_data_buf_65536         65536   1019   1045   68485120B     38938     0 
zio_buf_69632              69632      0     22    1531904B      2060     0 
zio_data_buf_69632         69632    962    983   68448256B     32960     0 
zio_buf_73728              73728      1     23    1695744B      2120     0 
zio_data_buf_73728         73728   1317   1341   98869248B     31843     0 
zio_buf_77824              77824      5     28    2179072B      1946     0 
zio_data_buf_77824         77824    701    726   56500224B     28570     0 
zio_buf_81920              81920      0     25    2048000B     24494     0 
zio_data_buf_81920         81920    415    442   36208640B     31424     0 
zio_buf_86016              86016      1     26    2236416B      1867     0 
zio_data_buf_86016         86016    862    885   76124160B     26292     0 
zio_buf_90112              90112      0     23    2072576B      1895     0 
zio_data_buf_90112         90112   1065   1092   98402304B     25207     0 
zio_buf_94208              94208      0     22    2072576B      1855     0 
zio_data_buf_94208         94208    420    449   42299392B     20970     0 
zio_buf_98304              98304      0     25    2457600B     21559     0 
zio_data_buf_98304         98304    417    440   43253760B     23760     0 
zio_buf_102400            102400      0     23    2355200B      1866     0 
zio_data_buf_102400       102400    227    248   25395200B     20183     0 
zio_buf_106496            106496      0     23    2449408B      1998     0 
zio_data_buf_106496       106496    398    421   44834816B     20024     0 
zio_buf_110592            110592      0     23    2543616B      2008     0 
zio_data_buf_110592       110592    347    372   41140224B     19080     0 
zio_buf_114688            114688      0     24    2752512B     16435     0 
zio_data_buf_114688       114688    313    339   38879232B     22177     0 
zio_buf_118784            118784      0     23    2732032B      2663     0 
zio_data_buf_118784       118784    484    506   60104704B     19090     0 
zio_buf_122880            122880      0     25    3072000B      3389     0 
zio_data_buf_122880       122880    204    228   28016640B     18773     0 
zio_buf_126976            126976      0     25    3174400B      4802     0 
zio_data_buf_126976       126976    222    244   30982144B     18947     0 
zio_buf_131072            131072     38     68    8912896B     76222     0 
zio_data_buf_131072       131072 162799 162979 21361983488B  11716828     0 
sa_cache                      56 339857 352231   20320256B   2044669     0 
dnode_t                      744 850668 851950  634470400B   1855716     0 
dmu_buf_impl_t               192 1659660 1660560  340082688B  11311535     0 
arc_buf_hdr_t                176 1555088 1555114  289533952B  10858702     0 
arc_buf_t                     56 948991 949128   54755328B  10712994     0 
zil_lwb_cache                192     14    940     192512B     83569     0 
zfs_znode_cache              248 339857 352192   90161152B   2069217     0 
softmac_cache                568      4      7       4096B         7     0 
softmac_upper_cache          232      0      0          0B         0     0 
lnode_cache                   32    444    875      28672B  38541843     0 
idm_buf_cache                240      0      0          0B         0     0 
idm_task_cache              2432      0      0          0B         0     0 
idm_tx_pdu_cache             464      0      0          0B         0     0 
idm_rx_pdu_cache             513      0      0          0B         0     0 
idm_128k_buf_cache        131072      0      0          0B         0     0 
vnic_cache                   120     13     33       4096B        13     0 
dtrace_state_cache         16384      0     13     212992B        20     0 
pty_map                       64      3     62       4096B        71     0 
kvm_vcpu                   29536      2      2      65536B         2     0 
kvm_pte_chain                 56    138    426      24576B     55831     0 
kvm_rmap_desc                 40     55    200       8192B       191     0 
kvm_mmu_page_header          264    242    330      90112B    226067     0 
sppptun_map                  440      0      0          0B         0     0 
authkern_cache                72      0      0          0B         0     0 
authnone_cache                72      0      0          0B         0     0 
authloopback_cache            72      0      0          0B         0     0 
authdes_cache_handle          80      0      0          0B         0     0 
rnode_cache                  656      0      0          0B         0     0 
nfs_access_cache              56      0      0          0B         0     0 
client_handle_cache           32      0      0          0B         0     0 
rnode4_cache                 968      0      0          0B         0     0 
svnode_cache                  40      0      0          0B         0     0 
nfs4_access_cache             56      0      0          0B         0     0 
client_handle4_cache          32      0      0          0B         0     0 
nfs4_ace4vals_cache           48      0      0          0B         0     0 
nfs4_ace4_list_cache         264      0      0          0B         0     0 
NFS_idmap_cache               48      0      0          0B         0     0 
Hex0xffffff0d2ce32560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d2ce32568_minor_1      1      0      0          0B         0     0 
audit_buffer                 152      0    130      20480B      2485     0 
lxpr_cache                    80     12     50       4096B        12     0 
crypto_session_cache         104      0      0          0B         0     0 
aggr_port_cache              992      0      0          0B         0     0 
aggr_grp_cache             10168      0      0          0B         0     0 
iptun_cache                  288      0      0          0B         0     0 
smb_share_cache              136      0      0          0B         0     0 
smb_unexport_cache           272      0      0          0B         0     0 
smb_vfs_cache                 48      0      0          0B         0     0 
smb_mbc_cache                 56      0      0          0B         0     0 
smb_node_cache               752      0      0          0B         0     0 
smb_oplock_break_cache        32      0      0          0B         0     0 
smb_txreq                  66592      0      0          0B         0     0 
smb_dtor_cache                40      0      0          0B         0     0 
Hex0xffffff0d2d958560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d2d958568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d44175560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d44175568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d42d93560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d42d93568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41b03560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41b03568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41c74560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41c74568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d42b21560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d42b21568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41c68560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41c68568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d44171560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d44171568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d36740560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d36740568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41c6c560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d41c6c568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d43633560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d43633568_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d37df3560_minor_1      1      0      0          0B         0     0 
Hex0xffffff0d37df3568_minor_1      1      0      0          0B         0     0 
------------------------- ------ ------ ------ ---------- --------- ----- 
Total [hat_memload]                              11350016B 217386842     0
Total [kmem_msb]                                251535360B   5437167     0
Total [kmem_va]                                5113774080B    961470     0
Total [kmem_default]                           5216313344B 2033726904     0
Total [kmem_io_4G]                                2105344B     15563     0
Total [bp_map]                                     524288B     11732     0
Total [umem_np]                                   2097152B      3154     0
Total [id32]                                         8192B      1163     0
Total [zfs_file_data]                          3108765696B    232896     0
Total [zfs_file_data_buf]                      25924706304B  15182268     0
Total [segkp]                                     1376256B    591481     0
Total [ip_minor_arena_sa]                              64B     13570     0
Total [ip_minor_arena_la]                             128B     24130     0
Total [spdsock]                                        64B        13     0
Total [namefs_inodes]                                 128B       103     0
------------------------- ------ ------ ------ ---------- --------- ----- 

vmem                         memory     memory    memory     alloc alloc 
name                         in use      total    import   succeed  fail 
------------------------- ---------- ----------- ---------- --------- ----- 
heap                      6159556608B 1042087411712B         0B   4763633     0 
    vmem_metadata         202579968B  202637312B 202637312B     45887     0 
        vmem_seg          187297792B  187297792B 187297792B     45709     0 
        vmem_hash          14900224B   14905344B  14905344B        73     0 
        vmem_vmem            371280B     413232B    376832B       137     0 
    static                        0B          0B         0B         0     0 
        static_alloc              0B          0B         0B         0     0 
    hat_memload            11350016B   11350016B  11350016B      3679     0 
    kstat                   1223792B    1257472B   1191936B      6380     0 
    kmem_metadata         283705344B  283770880B 283770880B     61863     0 
        kmem_msb          251535360B  251535360B 251535360B     61415     0 
        kmem_cache           706848B     909312B    909312B       503     0 
        kmem_hash          31221760B   31260672B  31260672B       527     0 
    kmem_log                 526944B     528384B    528384B         6     0 
    kmem_firewall_va      417169408B  417169408B 417169408B     22136     0 
        kmem_firewall             0B          0B         0B         0     0 
        kmem_oversize     417132266B  417169408B 417169408B     22136     0 
    mod_sysfile                1254B       4096B      4096B        32     0 
    kmem_va               5219782656B 5219782656B 5219782656B     40373     0 
        kmem_default      5216313344B 5216313344B 5216313344B    914955     0 
    kmem_io_64G                   0B          0B         0B         0     0 
    kmem_io_4G              2105344B    2105344B   2105344B       514     0 
    kmem_io_2G                57344B      57344B     57344B      1100     0 
    kmem_io_16M                   0B          0B         0B         0     0 
    bp_map                   524288B     524288B    524288B        92     0 
    umem_np                 2097152B    2097152B   2097152B       659     0 
    ksyms                   2126214B    2187264B   2187264B       705     0 
    ctf                     1059907B    1077248B   1077248B       301     0 
heap_core                    630784B  931115008B         0B        46     0 
    heaptext               10227712B   67108864B         0B       647     0 
        module_text        10084704B   10354688B  10227712B       737     0 
    id32                       8192B       8192B      8192B         2     0 
    module_data              797903B     929792B    622592B      1272     0 
logminor_space                  278B     262137B         0B      4137     0 
taskq_id_arena                  111B 2147483647B         0B       295     0 
zfs_file_data             26097713152B 51518636032B         0B    213071     0 
    zfs_file_data_buf     25924706304B 25924706304B 25924706304B    421784     0

device                      2400256B 1073741824B         0B      2218     0 
segkp                      59338752B 2147483648B         0B     19271     0 
mac_minor_ids                    60B     130070B         0B        61     0 
rctl_ids                         43B      32767B         0B        43     0 
zoneid_space                     13B       9998B         0B        13     0 
taskid_space                    207B     999999B         0B      1427     0 
pool_ids                          0B     999998B         0B         0     0 
contracts                       281B 2147483646B         0B      3430     0 
ip_minor_arena_sa                64B     262140B         0B         1     0 
ip_minor_arena_la               128B 4294705152B         0B         2     0 
lib_va_32                   7499776B 2138808320B         0B        20     0 
tl_minor_space                  398B     262138B         0B      2882     0 
keysock                           0B 4294967295B         0B         0     0 
spdsock                          64B 4294967295B         0B         1     0 
namefs_inodes                   128B      65536B         0B         2     0 
lport-instances                   0B      65536B         0B         0     0 
rport-instances                   0B      65536B         0B         0     0 
lofi_minor_id                     1B     262143B         0B        99     0 
lib_va_64                  63741952B 137988695945216B         0B       203     0

devfsadm_event_channel            1B        101B         0B         1     0 
devfsadm_event_channel            2B          2B         0B         3     0 
syseventconfd_door                0B        101B         0B         0     0 
syseventconfd_door                2B          2B         0B         3     0 
dtrace                        71018B 4294967295B         0B    242395     0 
dtrace_minor                      0B 4294967293B         0B        29     0 
logdmux_minor                     0B        256B         0B         0     0 
ptms_minor                        3B         16B         0B        71     0 
kvm_minor                         3B 4294967294B         0B         4     0 
sppptun_minor                     0B         16B         0B         0     0 
lmsysid_space                     1B      16383B         0B         2     0 
ipmi_id_space                     2B        127B         0B       201     0 
syseventd_channel                 1B        101B         0B         1     0 
syseventd_channel                 1B          2B         0B         1     0 
Hex0xffffff0d2ce32560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d2ce32568_minor         0B 4294967294B         0B         0     0 
crypto                            0B         16B         0B      3530     0 
aggr_portids                      0B      65534B         0B         0     0 
aggr_key_ids                      0B      64535B         0B         0     0 
ds_minors                         0B     262140B         0B         0     0 
ipnet_minor_space                26B     262141B         0B        26     0 
Hex0xffffff0d2d958560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d2d958568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d44175560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d44175568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d42d93560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d42d93568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41b03560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41b03568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41c74560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41c74568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d42b21560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d42b21568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41c68560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41c68568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d44171560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d44171568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d36740560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d36740568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41c6c560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d41c6c568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d43633560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d43633568_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d37df3560_minor         0B 4294967294B         0B         0     0 
Hex0xffffff0d37df3568_minor         0B 4294967294B         0B         0     0 
shmids                            0B         64B         0B         3     0 
------------------------- ---------- ----------- ---------- --------- -----

The output should become human-readable (the sizes should be expressed with %H introduced by 3668), and dammit, the columns should line up. Prototype output from the same system:

cache                            buf       buf       buf memory      alloc alloc
name                            size    in use     total in use    succeed  fail
------------------------------ ----- --------- --------- ------ ---------- -----
kmem_magazine_1                   16     80318     81073  1.26M      85161     0
kmem_magazine_3                   32     35505     47625  1.49M      57923     0
kmem_magazine_7                   64     26877     32550  2.05M      53061     0
kmem_magazine_15                 128     23415     28923  3.64M      48305     0
kmem_magazine_31                 256      4250      9270  2.41M      17539     0
kmem_magazine_47                 384      1973      4450  1.74M      10437     0
kmem_magazine_63                 512      2877     17269  9.64M      23597     0
kmem_magazine_95                 768      1067     29640  23.2M      33490     0
kmem_magazine_143              1.12K     22752     22752  29.6M      22752     0
kmem_slab_cache                   72    995889    995940  70.7M    1006403     0
kmem_bufctl_cache                 24   4024107   4024199  94.1M    4078497     0
kmem_bufctl_audit_cache          192         0         0      0          0     0
kmem_va_4096                      4K    676592    676608  2.58G     763681     0
kmem_va_8192                      8K     95408     95408   745M     102903     0
kmem_va_12288                    12K      1036      1040    13M       1036     0
kmem_va_16384                    16K     88626     88632  1.35G      90692     0
kmem_va_20480                    20K       484       486  10.1M        544     0
kmem_va_24576                    24K       222       225  5.62M        222     0
kmem_va_28672                    28K       275       276  8.62M        275     0
kmem_va_32768                    32K      2117      2120  66.2M       2117     0
kmem_alloc_8                       8    840155    842022  6.54M  110418619     0
kmem_alloc_16                     16     57975     62750  1000K   35058053     0
kmem_alloc_24                     24    312088    369571  8.64M   36218457     0
kmem_alloc_32                     32     49555     74000  2.31M  205488235     0
kmem_alloc_40                     40     43589     73200  2.86M  152507578     0
kmem_alloc_48                     48    990723    992016  46.7M   18905558     0
kmem_alloc_56                     56    204972    211367  11.6M    9833662     0
kmem_alloc_64                     64    399186    458676  28.9M  258874839     0
kmem_alloc_80                     80    141671    187650  14.7M  909205571     0
kmem_alloc_96                     96     31199     43091  4.11M   12489430     0
kmem_alloc_112                   112    140784    142625  15.9M  139426712     0
kmem_alloc_128                   128    130685    146475  18.5M   11990547     0
kmem_alloc_160                   160    192462    229900  35.9M   53567774     0
kmem_alloc_192                   192    326156    373460  72.9M    6034389     0
kmem_alloc_224                   224     43422    123692  28.4M   18731204     0
kmem_alloc_256                   256      3746     90210  23.5M   59245066     0
kmem_alloc_320                   320      4985      5772  1.88M   15630724     0
kmem_alloc_384                   384       550       750   300K    1678335     0
kmem_alloc_448                   448       928      1032   516K     630037     0
kmem_alloc_512                   512      1765      1880   940K    4744293     0
kmem_alloc_640                   640      1449      1674  1.09M    1163847     0
kmem_alloc_768                   768       347       430   344K     123779     0
kmem_alloc_896                   896     37071     37152  32.2M     106828     0
kmem_alloc_1152                1.12K     18621     28287  31.6M   28066942     0
kmem_alloc_1344                1.31K       205       261   348K     294201     0
kmem_alloc_1600                1.56K      1168      1255  1.96M     516325     0
kmem_alloc_2048                   2K      1637      2242  4.38M    1557513     0
kmem_alloc_2688                2.62K      2016      2433  6.34M   15910841     0
kmem_alloc_4096                   4K    198003    199821   781M    4068137     0
kmem_alloc_8192                   8K      1752      1824  14.2M    2242647     0
kmem_alloc_12288                 12K        52        79   948K     590868     0
kmem_alloc_16384                 16K       276       302  4.72M       7733     0
kmem_alloc_24576                 24K       118       144  3.38M       1164     0
kmem_alloc_32768                 32K      2041      2076  64.9M     123433     0
kmem_alloc_40960                 40K        34        52  2.03M        234     0
kmem_alloc_49152                 48K        25        41  1.92M        158     0
kmem_alloc_57344                 56K        22        39  2.13M        139     0
kmem_alloc_65536                   0       115       142  8.88M      76058     0
kmem_alloc_73728                  8K        24        85  5.98M       2051     0
kmem_alloc_81920                 16K         3        21  1.64M        149     0
kmem_alloc_90112                 24K         4        21  1.80M         93     0
kmem_alloc_98304                 32K        17        31  2.91M         72     0
kmem_alloc_106496                40K         3        18  1.83M         49     0
kmem_alloc_114688                48K         3        13  1.42M         19     0
kmem_alloc_122880                56K         1        10  1.17M         50     0
kmem_alloc_131072                  0        18        49  6.12M       5792     0
streams_mblk                      64     11647     13516   872K  140595473     0
streams_dblk_16                  128       268      1457   188K 1259161776     0
streams_dblk_80                  192       722      1840   368K   68455121     0
streams_dblk_144                 256        33       435   116K 1315962500     0
streams_dblk_208                 320       162      1272   424K   28692873     0
streams_dblk_272                 384        40       990   396K   14256309     0
streams_dblk_336                 448         0       312   156K    2049228     0
streams_dblk_528                 640         0       834   556K    6584772     0
streams_dblk_1040              1.12K         0        98   112K     373225     0
streams_dblk_1488              1.56K        12       630  1008K   18987983     0
streams_dblk_1936                 2K         0       742  1.45M   85663114     0
streams_dblk_2576              2.62K         1       102   272K   10002070     0
streams_dblk_3856              3.88K         0        30   120K      58857     0
streams_dblk_8192                112         0      1271   164K  147322002     0
streams_dblk_12048             11.9K         0        30   360K   49938778     0
streams_dblk_16384               112         0       186    24K     226311     0
streams_dblk_20240             19.9K         0        77  1.50M     633720     0
streams_dblk_24576               112         0        31     4K       1197     0
streams_dblk_28432             27.9K         0        17   476K        832     0
streams_dblk_32768               112         0        31     4K        982     0
streams_dblk_36624             35.9K         0        18   648K        779     0
streams_dblk_40960               112         0        31     4K       1110     0
streams_dblk_44816             43.9K         0        18   792K        617     0
streams_dblk_49152               112         0        31     4K        657     0
streams_dblk_53008             51.9K         0        17   884K        378     0
streams_dblk_57344               112         0        31     4K        272     0
streams_dblk_61200             59.9K         0        17  1020K        165     0
streams_dblk_65536               112         0        62     8K        173     0
streams_dblk_69392             3.88K         0        17  1.13M         67     0
streams_dblk_73728               112         0        31     4K         47     0
streams_dblk_esb                 112      1024      1147   148K   22808634     0
streams_fthdr                    408         0         0      0          0     0
streams_ftblk                    376         0         0      0          0     0
multidata                        248         0         0      0          0     0
multidata_pdslab               6.95K         0         0      0          0     0
multidata_pattbl                  32         0         0      0          0     0
log_cons_cache                    48        54       332    16K       3922     0
taskq_ent_cache                   56      1539      2059   116K      16385     0
taskq_cache                      280       197       252    72K       1277     0
kmem_io_64G_128                  128         0         0      0          0     0
kmem_io_64G_256                  256         0         0      0          0     0
kmem_io_64G_512                  512         0         0      0          0     0
kmem_io_64G_1024                  1K         0         0      0          0     0
kmem_io_64G_2048                  2K         0         0      0          0     0
kmem_io_64G_4096                  4K         0         0      0          0     0
kmem_io_4G_128                   128         0        93    12K        137     0
kmem_io_4G_256                   256         0        90    24K      14412     0
kmem_io_4G_512                   512         4         8     4K          6     0
kmem_io_4G_1024                   1K         0         0      0          0     0
kmem_io_4G_2048                   2K      1008      1008  1.97M       1008     0
kmem_io_4G_4096                   4K         0         0      0          0     0
kmem_io_2G_128                   128         0         0      0          0     0
kmem_io_2G_256                   256         0         0      0          0     0
kmem_io_2G_512                   512         0         0      0          0     0
kmem_io_2G_1024                   1K         0         0      0          0     0
kmem_io_2G_2048                   2K         0         0      0          0     0
kmem_io_2G_4096                   4K         0         0      0          0     0
kmem_io_16M_128                  128         0         0      0          0     0
kmem_io_16M_256                  256         0         0      0          0     0
kmem_io_16M_512                  512         0         0      0          0     0
kmem_io_16M_1024                  1K         0         0      0          0     0
kmem_io_16M_2048                  2K         0         0      0          0     0
kmem_io_16M_4096                  4K         0         0      0          0     0
id32_cache                        32         7       250     8K       1163     0
bp_map_4096                       4K         0         0      0          0     0
bp_map_8192                       8K         0        48   384K      11730     0
bp_map_12288                     12K         0         0      0          0     0
bp_map_16384                     16K         0         8   128K          2     0
bp_map_20480                     20K         0         0      0          0     0
bp_map_24576                     24K         0         0      0          0     0
bp_map_28672                     28K         0         0      0          0     0
bp_map_32768                     32K         0         0      0          0     0
htable_t                          72     20416     20845  1.48M    4906513     0
hment_t                           64    119712    148304  9.34M  212483691     0
hat_t                            176       280       484    88K     671724     0
HatHash                            0        17        57  3.56M      33076     0
HatVlpHash                        4K       263       334  1.30M     797199     0
zfs_file_data_4096                4K     69170     69184   270M      70104     0
zfs_file_data_8192                8K     47808     47808   374M      47808     0
zfs_file_data_12288              12K     38121     38130   477M      38121     0
zfs_file_data_16384              16K      8307      8312   130M       8307     0
zfs_file_data_20480              20K     35855     35856   747M      35855     0
zfs_file_data_24576              24K      8715      8715   218M       8715     0
zfs_file_data_28672              28K     19092     19092   597M      19092     0
zfs_file_data_32768              32K      4894      4896   153M       4894     0
segkp_4096                        4K       265       336  1.31M     591483     0
segkp_8192                        8K         0         0      0          0     0
segkp_12288                      12K         0         0      0          0     0
segkp_16384                      16K         0         0      0          0     0
segkp_20480                      20K         0         0      0          0     0
umem_np_4096                      4K         1        32   128K       1416     0
umem_np_8192                      8K         2        32   256K        337     0
umem_np_12288                    12K         0         0      0          0     0
umem_np_16384                    16K         0        24   384K        800     0
umem_np_20480                    20K         0        18   384K        238     0
umem_np_24576                    24K         0        10   256K         29     0
umem_np_28672                    28K         0         0      0          0     0
umem_np_32768                    32K         0        20   640K        334     0
mod_hash_entries                  24      1349      2004    48K      75019     0
ipp_mod                          304         0         0      0          0     0
ipp_action                       368         0         0      0          0     0
ipp_packet                        64         0         0      0          0     0
seg_cache                         96     15002     17302  1.65M   29999438     0
seg_pcache                       104         0        38     4K          7     0
fnode_cache                      176       217       240    48K     325800     0
pipe_cache                       320       143       240    80K     296068     0
snode_cache                      152       692       884   136K     683884     0
dv_node_cache                    176        93       528    96K        617     0
mac_impl_cache                 13.2K        17        21   280K         20     0
mac_ring_cache                   192         8        20     4K         14     0
flow_entry_cache               26.5K        21        32   848K         28     0
flow_tab_cache                   216        17        36     8K         20     0
mac_soft_ring_cache              376        42        60    24K         57     0
mac_srs_cache                  3.16K        28        30    96K         36     0
mac_bcast_grp_cache               80         4        50     4K          8     0
mac_client_impl_cache          2.05K        17        27    60K         20     0
mac_promisc_impl_cache           112         1        35     4K          2     0
dls_link_cache                   344        17        22     8K         20     0
dls_devnet_cache                 368        17        20     8K         20     0
sdev_node_cache                  256      1932      2010   536K       6350     0
dev_info_node_cache              680       186       198   132K       1560     0
ndi_fm_entry_cache                32      3592      4125   132K   14969324     0
thread_cache                     912      1385     22676  22.1M  134532282     0
lwp_cache                      1.72K      1580      1872  3.25M     128394     0
turnstile_cache                   64      2324     24180  1.52M  133884185     0
tslabel_cache                     48         2        83     4K          2     0
cred_cache                       184       685       861   164K    1168344     0
rctl_cache                        48      4672      5644   272K    4896739     0
rctl_val_cache                    64      8793     10788   696K   10022300     0
task_cache                       160       207       325    52K       1436     0
kmem_defrag_cache                216         2        18     4K          2     0
kmem_move_cache                   56         0         0      0          0     0
rootnex_dmahdl                 2.53K      3606      4017  10.5M   15014768     0
timeout_request                  128         1        31     4K          1     0
cyclic_id_cache                   72        77       220    16K    2453960     0
callout_cachebabecafe             80      2862      2883   372K       2862     0
callout_lcachebabecafe            48      4452      4464   288K       4452     0
dnlc_space_cache                  24         0         0      0          0     0
vfs_cache                        208       376       418    88K        482     0
vn_cache                         208    384881    408225   106M   48212644     0
vsk_anchor_cache                  40       104       200     8K        313     0
file_cache                        56      2577      3053   172K   24839571     0
stream_head_cache                376      1069      1210   484K     655136     0
queue_cache                      656      1752      1902  1.24M     702270     0
syncq_cache                      160        17        50     8K        115     0
qband_cache                       64         0         0      0          0     0
linkinfo_cache                    48        32        83     4K         34     0
ciputctrl_cache                   1K         0         0      0          0     0
serializer_cache                  64       224       372    24K       2875     0
as_cache                         232       279       476   112K     671729     0
marker_cache                     120         0       165    20K    1847220     0
anon_cache                        48   2828610   3762888   177M  267703176     0
anonmap_cache                    112     10386     12040  1.34M   15760054     0
segvn_cache                      168     15000     17181  2.92M   25873384     0
segvn_szc_cache1                  4K         0        48   192K     162679     0
segvn_szc_cache2                   0         0         0      0          0     0
flk_edges                         48         0         0      0          0     0
fdb_cache                        104         0         0      0          0     0
timer_cache                      136         9        29     4K          9     0
vmu_bound_cache                   56         0         0      0          0     0
vmu_object_cache                  64         0         0      0          0     0
physio_buf_cache                 248         0        16     4K         26     0
process_cache                  3.79K       296       366  1.43M     448115     0
ufs_inode_cache                  368      4833      4840  1.89M       4834     0
directio_buf_cache               272         0         0      0          0     0
lufs_save                         24         0         0      0          0     0
lufs_bufs                        256         0         0      0          0     0
lufs_mapentry_cache              112         0         0      0          0     0
audit_proc                        40       297       700    28K     389316     0
drv_secobj_cache                 296         0         0      0          0     0
dld_str_cache                    304        27        52    16K         93     0
kcf_sreq_cache                    56         0         0      0          0     0
kcf_areq_cache                   296         0         0      0          0     0
kcf_context_cache                112         0         0      0          0     0
ip_minor_arena_sa_1                1        10        64     64      13570     0
ip_minor_arena_la_1                1        26       128    128      24136     0
ip_conn_cache                    720         0        15    12K         25     0
tcp_conn_cache                 1.77K        78       314   628K      88995     0
udp_conn_cache                 1.23K        56       153   204K      74346     0
rawip_conn_cache               1.07K         0        14    16K         50     0
rts_conn_cache                   816        28        63    56K        237     0
ire_cache                        352       289       297   108K        432     0
ncec_cache                       200        94       120    24K        344     0
nce_cache                         88        94       135    12K        398     0
rt_entry                         152       181       182    28K        324     0
radix_mask                        32        39       125     4K         65     0
radix_node                       120         2        33     4K          2     0
ipsec_actions                     72         0         0      0          0     0
ipsec_selectors                   80         0         0      0          0     0
ipsec_policy                      80         0         0      0          0     0
tcp_timercache                    88       594       765    68K       6127     0
tcp_notsack_blk_cache             24         0       167     4K       8039     0
squeue_cache                     168        29        40     8K         29     0
sctp_conn_cache                2.47K         0         0      0          0     0
sctp_faddr_cache                 176         0         0      0          0     0
sctp_set_cache                    24         0         0      0          0     0
sctp_ftsn_set_cache               16         0         0      0          0     0
dce_cache                        152       216       234    36K        216     0
ire_gw_secattr_cache              24         0         0      0          0     0
socket_cache                     640       134       234   156K     285024     0
socktpi_cache                    944         0         8     8K         13     0
socktpi_unix_cache               944       387       464   464K       3094     0
sock_sod_cache                   648         0         0      0          0     0
exacct_object_cache               40         0         0      0          0     0
kssl_cache                     1.59K         0         0      0          0     0
tl_cache                         432       398       477   212K       3113     0
keysock_1                          1         0         0      0          0     0
spdsock_1                          1         0        64     64         13     0
namefs_inodes_1                    1        97       128    128        103     0
port_cache                        80        55       250    20K      50917     0
clnt_clts_endpnt_cache            88         0         0      0          0     0
zio_cache                        880         1     47745  41.4M  169477240     0
zio_link_cache                    48         0     48555  2.29M   45889644     0
zio_buf_512                      512    850150    850992   416M    3445368     0
zio_data_buf_512                 512     90121     90176  44.0M     472413     0
zio_buf_1024                      1K     14762     14996  14.6M     535298     0
zio_data_buf_1024                 1K     45961     45992  44.9M     244356     0
zio_buf_1536                   1.50K      3620      3696  5.41M      70311     0
zio_data_buf_1536              1.50K     56639     56664  83.0M     172876     0
zio_buf_2048                      2K      1689      1758  3.43M     646998     0
zio_data_buf_2048                 2K     53997     54048   106M     150743     0
zio_buf_2560                   2.50K       847       912  2.23M     105986     0
zio_data_buf_2560              2.50K     38865     38896  95.0M     119252     0
zio_buf_3072                      3K       830       892  2.61M      86581     0
zio_data_buf_3072                 3K     24713     24736  72.5M      89650     0
zio_buf_3584                   3.50K       443       472  1.61M     168023     0
zio_data_buf_3584              3.50K     21054     21072  72.0M      91188     0
zio_buf_4096                      4K      1293      1456  5.69M     940437     0
zio_data_buf_4096                 4K     19349     19376  75.7M      81950     0
zio_buf_5120                      5K       528       556  2.71M     139444     0
zio_data_buf_5120                 5K     30704     30728   150M     142335     0
zio_buf_6144                      6K       297       326  1.91M     194147     0
zio_data_buf_6144                 6K     20331     20354   119M     113376     0
zio_buf_7168                      7K       338       364  2.49M     122403     0
zio_data_buf_7168                 7K     17993     18020   123M     101715     0
zio_buf_8192                      8K        49        76   608K     182327     0
zio_data_buf_8192                 8K     47770     47808   374M     118689     0
zio_buf_10240                    10K       106       132  1.29M     118092     0
zio_data_buf_10240               10K     19897     19920   195M     138332     0
zio_buf_12288                    12K        54        79   948K     218646     0
zio_data_buf_12288               12K     14652     14677   172M     110521     0
zio_buf_14336                    14K        20        42   588K      56471     0
zio_data_buf_14336               14K      9862      9888   135M      91738     0
zio_buf_16384                    16K     87969     88097  1.34G    3254031     0
zio_data_buf_16384               16K      8281      8307   130M     100772     0
zio_buf_20480                    20K        62        85  1.66M      59997     0
zio_data_buf_20480               20K     13324     13351   261M     134230     0
zio_buf_24576                    24K        56        78  1.83M      26267     0
zio_data_buf_24576               24K      8689      8715   204M     104891     0
zio_buf_28672                    28K        65        87  2.38M      11707     0
zio_data_buf_28672               28K      6981      7009   192M      83885     0
zio_buf_32768                    32K        14        39  1.22M     120273     0
zio_data_buf_32768               32K      4870      4894   153M      78577     0
zio_buf_36864                    36K        18        45  1.58M      66985     0
zio_data_buf_36864               36K      3594      3614   127M      60235     0
zio_buf_40960                    40K        14        37  1.45M       4784     0
zio_data_buf_40960               40K      3267      3288   128M      53570     0
zio_buf_45056                    44K         9        30  1.29M       3937     0
zio_data_buf_45056               44K      2820      2843   122M      48080     0
zio_buf_49152                    48K         8        32  1.50M      60545     0
zio_data_buf_49152               48K      2128      2153   101M      49599     0
zio_buf_53248                    52K         7        30  1.52M       3071     0
zio_data_buf_53248               52K      1956      1979   100M      40953     0
zio_buf_57344                    56K         3        26  1.42M       2830     0
zio_data_buf_57344               56K      1507      1533  83.8M      37454     0
zio_buf_61440                    60K         3        27  1.58M       2416     0
zio_data_buf_61440               60K      1180      1203  70.5M      35828     0
zio_buf_65536                      0         1        26  1.62M      28763     0
zio_data_buf_65536                 0      1019      1045  65.3M      38938     0
zio_buf_69632                     4K         0        22  1.46M       2060     0
zio_data_buf_69632                4K       962       983  65.3M      32960     0
zio_buf_73728                     8K         1        23  1.62M       2120     0
zio_data_buf_73728                8K      1317      1341  94.3M      31843     0
zio_buf_77824                    12K         5        28  2.08M       1946     0
zio_data_buf_77824               12K       701       726  53.9M      28570     0
zio_buf_81920                    16K         0        25  1.95M      24494     0
zio_data_buf_81920               16K       415       442  34.5M      31424     0
zio_buf_86016                    20K         1        26  2.13M       1867     0
zio_data_buf_86016               20K       862       885  72.6M      26292     0
zio_buf_90112                    24K         0        23  1.98M       1895     0
zio_data_buf_90112               24K      1065      1092  93.8M      25207     0
zio_buf_94208                    28K         0        22  1.98M       1855     0
zio_data_buf_94208               28K       420       449  40.3M      20970     0
zio_buf_98304                    32K         0        25  2.34M      21559     0
zio_data_buf_98304               32K       417       440  41.2M      23760     0
zio_buf_102400                   36K         0        23  2.25M       1866     0
zio_data_buf_102400              36K       227       248  24.2M      20183     0
zio_buf_106496                   40K         0        23  2.34M       1998     0
zio_data_buf_106496              40K       398       421  42.8M      20024     0
zio_buf_110592                   44K         0        23  2.43M       2008     0
zio_data_buf_110592              44K       347       372  39.2M      19080     0
zio_buf_114688                   48K         0        24  2.62M      16435     0
zio_data_buf_114688              48K       313       339  37.1M      22177     0
zio_buf_118784                   52K         0        23  2.61M       2663     0
zio_data_buf_118784              52K       484       506  57.3M      19090     0
zio_buf_122880                   56K         0        25  2.93M       3389     0
zio_data_buf_122880              56K       204       228  26.7M      18773     0
zio_buf_126976                   60K         0        25  3.03M       4802     0
zio_data_buf_126976              60K       222       244  29.5M      18947     0
zio_buf_131072                     0        38        68  8.50M      76222     0
zio_data_buf_131072                0    162799    162979  19.9G   11716828     0
sa_cache                          56    339857    352231  19.4M    2044669     0
dnode_t                          744    850668    851950   605M    1855716     0
dmu_buf_impl_t                   192   1659660   1660560   324M   11311541     0
arc_buf_hdr_t                    176   1555090   1555114   276M   10858708     0
arc_buf_t                         56    948991    949128  52.2M   10713000     0
zil_lwb_cache                    192        14       940   188K      83569     0
zfs_znode_cache                  248    339857    352192  86.0M    2069217     0
softmac_cache                    568         4         7     4K          7     0
softmac_upper_cache              232         0         0      0          0     0
lnode_cache                       32       444       875    28K   38541843     0
idm_buf_cache                    240         0         0      0          0     0
idm_task_cache                 2.38K         0         0      0          0     0
idm_tx_pdu_cache                 464         0         0      0          0     0
idm_rx_pdu_cache                 513         0         0      0          0     0
idm_128k_buf_cache                 0         0         0      0          0     0
vnic_cache                       120        13        33     4K         13     0
dtrace_state_cache               16K         0        13   208K         20     0
pty_map                           64         3        62     4K         71     0
kvm_vcpu                       28.8K         2         2    64K          2     0
kvm_pte_chain                     56       138       426    24K      55831     0
kvm_rmap_desc                     40        55       200     8K        191     0
kvm_mmu_page_header              264       242       330    88K     226067     0
sppptun_map                      440         0         0      0          0     0
authkern_cache                    72         0         0      0          0     0
authnone_cache                    72         0         0      0          0     0
authloopback_cache                72         0         0      0          0     0
authdes_cache_handle              80         0         0      0          0     0
rnode_cache                      656         0         0      0          0     0
nfs_access_cache                  56         0         0      0          0     0
client_handle_cache               32         0         0      0          0     0
rnode4_cache                     968         0         0      0          0     0
svnode_cache                      40         0         0      0          0     0
nfs4_access_cache                 56         0         0      0          0     0
client_handle4_cache              32         0         0      0          0     0
nfs4_ace4vals_cache               48         0         0      0          0     0
nfs4_ace4_list_cache             264         0         0      0          0     0
NFS_idmap_cache                   48         0         0      0          0     0
Hex0xffffff0d2ce32560_minor_1      1         0         0      0          0     0
Hex0xffffff0d2ce32568_minor_1      1         0         0      0          0     0
audit_buffer                     152         0       130    20K       2507     0
lxpr_cache                        80        12        50     4K         12     0
crypto_session_cache             104         0         0      0          0     0
aggr_port_cache                  992         0         0      0          0     0
aggr_grp_cache                 9.93K         0         0      0          0     0
iptun_cache                      288         0         0      0          0     0
smb_share_cache                  136         0         0      0          0     0
smb_unexport_cache               272         0         0      0          0     0
smb_vfs_cache                     48         0         0      0          0     0
smb_mbc_cache                     56         0         0      0          0     0
smb_node_cache                   752         0         0      0          0     0
smb_oplock_break_cache            32         0         0      0          0     0
smb_txreq                      1.03K         0         0      0          0     0
smb_dtor_cache                    40         0         0      0          0     0
Hex0xffffff0d2d958560_minor_1      1         0         0      0          0     0
Hex0xffffff0d2d958568_minor_1      1         0         0      0          0     0
Hex0xffffff0d44175560_minor_1      1         0         0      0          0     0
Hex0xffffff0d44175568_minor_1      1         0         0      0          0     0
Hex0xffffff0d42d93560_minor_1      1         0         0      0          0     0
Hex0xffffff0d42d93568_minor_1      1         0         0      0          0     0
Hex0xffffff0d41b03560_minor_1      1         0         0      0          0     0
Hex0xffffff0d41b03568_minor_1      1         0         0      0          0     0
Hex0xffffff0d41c74560_minor_1      1         0         0      0          0     0
Hex0xffffff0d41c74568_minor_1      1         0         0      0          0     0
Hex0xffffff0d42b21560_minor_1      1         0         0      0          0     0
Hex0xffffff0d42b21568_minor_1      1         0         0      0          0     0
Hex0xffffff0d41c68560_minor_1      1         0         0      0          0     0
Hex0xffffff0d41c68568_minor_1      1         0         0      0          0     0
Hex0xffffff0d44171560_minor_1      1         0         0      0          0     0
Hex0xffffff0d44171568_minor_1      1         0         0      0          0     0
Hex0xffffff0d36740560_minor_1      1         0         0      0          0     0
Hex0xffffff0d36740568_minor_1      1         0         0      0          0     0
Hex0xffffff0d41c6c560_minor_1      1         0         0      0          0     0
Hex0xffffff0d41c6c568_minor_1      1         0         0      0          0     0
Hex0xffffff0d43633560_minor_1      1         0         0      0          0     0
Hex0xffffff0d43633568_minor_1      1         0         0      0          0     0
Hex0xffffff0d37df3560_minor_1      1         0         0      0          0     0
Hex0xffffff0d37df3568_minor_1      1         0         0      0          0     0
------------------------------ ----- --------- --------- ------ ---------- -----
Total [hat_memload]                                       10.8M  217390204     0
Total [kmem_msb]                                           240M    5437167     0
Total [kmem_va]                                           4.76G     961470     0
Total [kmem_default]                                      4.86G 2034111601     0
Total [kmem_io_4G]                                        2.01M      15563     0
Total [bp_map]                                             512K      11732     0
Total [umem_np]                                              2M       3154     0
Total [id32]                                                 8K       1163     0
Total [zfs_file_data]                                     2.90G     232896     0
Total [zfs_file_data_buf]                                 24.1G   15182274     0
Total [segkp]                                             1.31M     591483     0
Total [ip_minor_arena_sa]                                    64      13570     0
Total [ip_minor_arena_la]                                   128      24136     0
Total [spdsock]                                              64         13     0
Total [namefs_inodes]                                       128        103     0
------------------------------ ----- --------- --------- ------ ---------- -----

vmem                              memory     memory    memory      alloc alloc 
name                              in use      total    import    succeed  fail 
------------------------------ --------- ---------- --------- ---------- ----- 
heap                               5.74G       971G         0    4764449     0 
    vmem_metadata                   193M       193M      193M      45887     0 
        vmem_seg                    179M       179M      179M      45709     0 
        vmem_hash                  14.2M      14.2M     14.2M         73     0 
        vmem_vmem                   363K       404K      368K        137     0 
    static                             0          0         0          0     0 
        static_alloc                   0          0         0          0     0 
    hat_memload                    10.8M      10.8M     10.8M       3679     0 
    kstat                          1.17M      1.20M     1.14M       6380     0 
    kmem_metadata                   271M       271M      271M      61863     0 
        kmem_msb                    240M       240M      240M      61415     0 
        kmem_cache                  690K       888K      888K        503     0 
        kmem_hash                  29.8M      29.8M     29.8M        527     0 
    kmem_log                        515K       516K      516K          6     0 
    kmem_firewall_va                398M       398M      398M      22136     0 
        kmem_firewall                  0          0         0          0     0 
        kmem_oversize               398M       398M      398M      22136     0 
    mod_sysfile                    1.22K         4K        4K         32     0 
    kmem_va                        4.86G      4.86G     4.86G      40373     0 
        kmem_default               4.86G      4.86G     4.86G     914955     0 
    kmem_io_64G                        0          0         0          0     0 
    kmem_io_4G                     2.01M      2.01M     2.01M        514     0 
    kmem_io_2G                       56K        56K       56K       1100     0 
    kmem_io_16M                        0          0         0          0     0 
    bp_map                          512K       512K      512K         92     0 
    umem_np                           2M         2M        2M        659     0 
    ksyms                          2.03M      2.09M     2.09M        705     0 
    ctf                            1.01M      1.03M     1.03M        301     0 
heap_core                           616K       888M         0         46     0 
    heaptext                       9.75M        64M         0        647     0 
        module_text                9.62M      9.88M     9.75M        737     0 
    id32                              8K         8K        8K          2     0 
    module_data                     779K       908K      608K       1272     0 
logminor_space                       278       256K         0       4137     0 
taskq_id_arena                       111      2.00G         0        295     0 
zfs_file_data                      24.3G      48.0G         0     213071     0 
    zfs_file_data_buf              24.1G      24.1G     24.1G     421784     0 
device                             2.29M         1G         0       2218     0 
segkp                              56.6M         2G         0      19271     0 
mac_minor_ids                         60       127K         0         61     0 
rctl_ids                              43      32.0K         0         43     0 
zoneid_space                          13      9.76K         0         13     0 
taskid_space                         207       977K         0       1427     0 
pool_ids                               0       977K         0          0     0 
contracts                            281      2.00G         0       3430     0 
ip_minor_arena_sa                     64       256K         0          1     0 
ip_minor_arena_la                    128      4.00G         0          2     0 
lib_va_32                          7.15M      1.99G         0         20     0 
tl_minor_space                       398       256K         0       2882     0 
keysock                                0      4.00G         0          0     0 
spdsock                               64      4.00G         0          1     0 
namefs_inodes                        128        64K         0          2     0 
lport-instances                        0        64K         0          0     0 
rport-instances                        0        64K         0          0     0 
lofi_minor_id                          1       256K         0         99     0 
lib_va_64                          60.8M       125T         0        203     0 
devfsadm_event_channel                 1        101         0          1     0 
devfsadm_event_channel                 2          2         0          3     0 
syseventconfd_door                     0        101         0          0     0 
syseventconfd_door                     2          2         0          3     0 
dtrace                             69.4K      4.00G         0     242395     0 
dtrace_minor                           0      4.00G         0         29     0 
logdmux_minor                          0        256         0          0     0 
ptms_minor                             3         16         0         71     0 
kvm_minor                              3      4.00G         0          4     0 
sppptun_minor                          0         16         0          0     0 
lmsysid_space                          1      16.0K         0          2     0 
ipmi_id_space                          2        127         0        201     0 
syseventd_channel                      1        101         0          1     0 
syseventd_channel                      1          2         0          1     0 
Hex0xffffff0d2ce32560_minor            0      4.00G         0          0     0 
Hex0xffffff0d2ce32568_minor            0      4.00G         0          0     0 
crypto                                 0         16         0       3530     0 
aggr_portids                           0      64.0K         0          0     0 
aggr_key_ids                           0      63.0K         0          0     0 
ds_minors                              0       256K         0          0     0 
ipnet_minor_space                     26       256K         0         26     0 
Hex0xffffff0d2d958560_minor            0      4.00G         0          0     0 
Hex0xffffff0d2d958568_minor            0      4.00G         0          0     0 
Hex0xffffff0d44175560_minor            0      4.00G         0          0     0 
Hex0xffffff0d44175568_minor            0      4.00G         0          0     0 
Hex0xffffff0d42d93560_minor            0      4.00G         0          0     0 
Hex0xffffff0d42d93568_minor            0      4.00G         0          0     0 
Hex0xffffff0d41b03560_minor            0      4.00G         0          0     0 
Hex0xffffff0d41b03568_minor            0      4.00G         0          0     0 
Hex0xffffff0d41c74560_minor            0      4.00G         0          0     0 
Hex0xffffff0d41c74568_minor            0      4.00G         0          0     0 
Hex0xffffff0d42b21560_minor            0      4.00G         0          0     0 
Hex0xffffff0d42b21568_minor            0      4.00G         0          0     0 
Hex0xffffff0d41c68560_minor            0      4.00G         0          0     0 
Hex0xffffff0d41c68568_minor            0      4.00G         0          0     0 
Hex0xffffff0d44171560_minor            0      4.00G         0          0     0 
Hex0xffffff0d44171568_minor            0      4.00G         0          0     0 
Hex0xffffff0d36740560_minor            0      4.00G         0          0     0 
Hex0xffffff0d36740568_minor            0      4.00G         0          0     0 
Hex0xffffff0d41c6c560_minor            0      4.00G         0          0     0 
Hex0xffffff0d41c6c568_minor            0      4.00G         0          0     0 
Hex0xffffff0d43633560_minor            0      4.00G         0          0     0 
Hex0xffffff0d43633568_minor            0      4.00G         0          0     0 
Hex0xffffff0d37df3560_minor            0      4.00G         0          0     0 
Hex0xffffff0d37df3568_minor            0      4.00G         0          0     0 
shmids                                 0         64         0          3     0 
------------------------------ --------- ---------- --------- ---------- -----

Also available in: Atom PDF