Project

General

Profile

Bug #1629

AVS slows down writes on a primary host

Added by Piotr Jasiukajtis almost 8 years ago. Updated 12 months ago.

Status:
Closed
Priority:
Low
Assignee:
-
Category:
-
Start date:
2011-10-12
Due date:
% Done:

0%

Estimated time:
Difficulty:
Tags:
needs-triage

Description

Not sure if this is a bug or feature report :)

I'm playing with AVS remote mirror on oi_151a and it seems enabling replication slows down writes on a primary host.

sndradm -d host1 /dev/zvol/rdsk/data/avs03 /dev/zvol/rdsk/data/bitmap03 host2 /dev/zvol/rdsk/data/avs03 /dev/zvol/rdsk/data/bitmap03 ip async
Disable Remote Mirror? (Y/N) [N]: y

dd if=/dev/zero of=/dev/zvol/rdsk/data/avs03 bs=1024k count=100100+0 records in
100+0 records out
104857600 bytes (105 MB) copied, 2.48679 s, 42.2 MB/s

sndradm -E host1 /dev/zvol/rdsk/data/avs03 /dev/zvol/rdsk/data/bitmap03 host2 /dev/zvol/rdsk/data/avs03 /dev/zvol/rdsk/data/bitmap03 ip async
Enable Remote Mirror? (Y/N) [N]: y

dd if=/dev/zero of=/dev/zvol/rdsk/data/avs03 bs=1024k count=1010+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 3.53222 s, 3.0 MB/s

# kstat sndr:2:setinfo
module: sndr                            instance: 2     
name:   setinfo                         class:    storedge
    async_block_hwm                 15829
    async_item_hwm                  147
    async_queue_blocks              0
    async_queue_items               0
    async_queue_type                memory
    async_throttle_delay            186
    autosync                        0
    bitmap                          /dev/zvol/rdsk/data/bitmap03
    bitsset                         0
    bmp_size                        204800
    bmpflags                        0
    crtime                          74092.363886499
    disk_status                     0
    flags                           2054
    if_down                         0
    if_rpc_version                  7
    maxqfbas                        65536
    maxqitems                       4096
    primary_host                    hosting-backup1.dc2
    primary_vol                     /dev/zvol/rdsk/data/avs03
    secondary_host                  cache01.dc2
    secondary_vol                   /dev/zvol/rdsk/data/avs03
    snaptime                        80400.684160156
    syncflags                       0
    syncpos                         40960
    type_flag                       5
    volsize                         104857600

/dev/zvol/rdsk/data/avs03    ->    host2:/dev/zvol/rdsk/data/avs03
autosync: off, max q writes: 4096, max q fbas: 65536, async threads: 100, mode: async, state: replicating

$ iostat -xenz 1 3
                            extended device statistics       ---- errors --- 
    r/s    w/s   kr/s   kw/s wait actv wsvc_t asvc_t  %w  %b s/w h/w trn tot device
    0.0    4.9    0.0    2.6  0.0  0.0    0.0    8.0   0   4   0   0   0   0 gsdbc
    0.1    1.9    1.4   20.2  0.0  0.0    0.0    1.2   0   0   0   0   0   0 c2t50014EE65678F920d0
    0.0    5.3    0.2   79.0  0.0  0.0    0.0    0.7   0   0   0   0   0   0 c2t50014EE0AD63C521d0
    0.0    5.2    0.2   77.7  0.0  0.0    0.0    0.7   0   0   0   0   0   0 c2t50014EE0AD6407B2d0
    0.0    5.3    0.2   77.7  0.0  0.0    0.0    0.7   0   0   0   0   0   0 c2t50014EE0AD642753d0
    0.0    5.3    0.2   77.2  0.0  0.0    0.0    0.7   0   0   0   0   0   0 c2t50014EE0AD640F36d0
    0.1    1.9    1.5   20.2  0.0  0.0    0.0    1.2   0   0   0   0   0   0 c2t50014EE65678F31Cd0
    0.0    5.3    0.2   79.0  0.0  0.0    0.0    0.7   0   0   0   0   0   0 c2t50014EE0AD79B77Cd0
    0.0    5.2    0.2   77.2  0.0  0.0    0.0    0.7   0   0   0   0   0   0 c2t50014EE0AD640AFDd0
    0.0    1.2    0.0    0.7  0.0  0.0    0.0    7.7   0   1   0   0   0   0 sdbc0
    0.0   19.3    0.0    9.8  0.0  0.2    0.0    8.2   0  16   0   0   0   0 sdbc1
    0.0    2.0    0.0    1.2  0.0  0.0    0.0    9.1   0   2   0   0   0   0 sdbc2
    1.0    0.1   32.6    1.5  0.0  0.0    0.0    4.3   0   0   0   0   0   0 sndr0
    0.0   18.9    0.0  483.7  0.1  0.1    4.3    5.9   1  10   0   0   0   0 sndr1
    0.0    2.0    0.0   54.7  0.1  0.0   52.3    5.4   0   1   0   0   0   0 sndr2
    0.0    1.2    0.0    0.7  0.0  0.0    0.0    7.7   0   1   0   0   0   0 sndrbmp0
    0.0   19.3    0.0    9.8  0.0  0.2    0.0    8.2   0  16   0   0   0   0 sndrbmp1
    0.0    2.0    0.0    1.2  0.0  0.0    0.0    9.1   0   2   0   0   0   0 sndrbmp2
                            extended device statistics       ---- errors --- 
    r/s    w/s   kr/s   kw/s wait actv wsvc_t asvc_t  %w  %b s/w h/w trn tot device
    0.0   88.9    0.0   44.4  0.0  0.8    0.0    9.4   0  83   0   0   0   0 gsdbc
    8.0   90.9 1022.8  986.9  0.0  0.0    0.0    0.3   0   3   0   0   0   0 c2t50014EE0AD63C521d0
    4.0   90.9  511.4  930.9  0.0  0.0    0.0    0.2   0   2   0   0   0   0 c2t50014EE0AD6407B2d0
    1.0   90.9    1.5  930.9  0.0  0.0    0.0    0.3   0   3   0   0   0   0 c2t50014EE0AD642753d0
    8.0   88.9 1022.8  927.0  0.0  0.0    0.0    0.4   0   3   0   0   0   0 c2t50014EE0AD640F36d0
    0.0   91.9    0.0  986.9  0.0  0.0    0.0    0.1   0   1   0   0   0   0 c2t50014EE0AD79B77Cd0
    0.0   88.9    0.0  927.0  0.0  0.0    0.0    0.1   0   1   0   0   0   0 c2t50014EE0AD640AFDd0
    0.0   88.9    0.0   44.4  0.0  0.8    0.0    9.4   0  83   0   0   0   0 sdbc2
    0.0   88.9    0.0 2458.7  0.0  0.4    0.0    4.2   0  38   0   0   0   0 sndr2
    0.0   89.9    0.0   44.9  0.0  0.8    0.0    9.3   0  83   0   0   0   0 sndrbmp2
                            extended device statistics       ---- errors --- 
    r/s    w/s   kr/s   kw/s wait actv wsvc_t asvc_t  %w  %b s/w h/w trn tot device
    0.0   87.0    0.0   43.5  0.0  0.8    0.0    9.6   0  84   0   0   0   0 gsdbc
    5.0   87.0  639.9  871.8  0.0  0.0    0.0    0.1   0   1   0   0   0   0 c2t50014EE0AD63C521d0
    2.0   88.0  256.0  927.8  0.0  0.0    0.0    0.1   0   1   0   0   0   0 c2t50014EE0AD6407B2d0
    3.0   88.0  383.9  927.8  0.0  0.0    0.0    0.3   0   3   0   0   0   0 c2t50014EE0AD642753d0
    1.0   88.0  128.0  955.8  0.0  0.0    0.0    0.4   0   3   0   0   0   0 c2t50014EE0AD640F36d0
    3.0   86.0  383.9  871.8  0.0  0.0    0.0    0.2   0   2   0   0   0   0 c2t50014EE0AD79B77Cd0
    4.0   88.0  511.9  955.8  0.0  0.0    0.0    0.3   0   3   0   0   0   0 c2t50014EE0AD640AFDd0
    0.0   87.0    0.0   43.5  0.0  0.8    0.0    9.6   0  84   0   0   0   0 sdbc2
    0.0   87.0    0.0 2412.5  0.0  0.4    0.0    4.2   0  36   0   0   0   0 sndr2
    0.0   87.0    0.0   43.5  0.0  0.8    0.0    9.6   0  84   0   0   0   0 sndrbmp2

History

#1

Updated by Peter Tribble 12 months ago

  • Status changed from New to Closed

avs has been removed from illumos

Also available in: Atom PDF