Project

General

Profile

Actions

Bug #13138

open

Very bad SMB small file/request performance on i40e, made faster by iftop

Added by Florian Manschwetus over 1 year ago. Updated over 1 year ago.

Status:
New
Priority:
High
Assignee:
-
Category:
networking
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:
Medium
Tags:
Gerrit CR:

Description

Copy of a build tree (lot of small and mid size files and only some very large, 20k files, close to 6GB in sum) takes to:
  • nvme with i40e
    • normal: close to 15 minutes
    • with iftop during small files copy phases: 3.7 minutes
    • local cp -r from local tmpfs: 6 seconds
  • Old Win2k12 system: 5 to 6 Minutes
  • ESXi OI VM: roughly 5 Minutes

The source is my Win10 workstation, the build output is stored on a ramdisk (imdisk)

Also deleting this files again takes much longer as on other systems, but is also faster than all other with iftop running.

But iftop reduces the max throughput to less than the half.


Files

mpstat.txt (6.39 KB) mpstat.txt Florian Manschwetus, 2020-09-14 07:03 AM
mpstat-iftop.txt (5.11 KB) mpstat-iftop.txt Florian Manschwetus, 2020-09-14 07:03 AM
send-wait-iftop.txt (6.88 KB) send-wait-iftop.txt Florian Manschwetus, 2020-09-14 07:03 AM
send-wait.txt (4.19 KB) send-wait.txt Florian Manschwetus, 2020-09-14 07:03 AM
sorecv-wait.txt (12.6 KB) sorecv-wait.txt Florian Manschwetus, 2020-09-14 07:03 AM
sorecv-wait-delete-scan.txt (8.75 KB) sorecv-wait-delete-scan.txt Florian Manschwetus, 2020-09-14 07:03 AM
sorecv-wait-delete-scan-iftop.txt (10.6 KB) sorecv-wait-delete-scan-iftop.txt Florian Manschwetus, 2020-09-14 07:03 AM
sorecv-wait-iftop.txt (23 KB) sorecv-wait-iftop.txt Florian Manschwetus, 2020-09-14 07:03 AM
genDataLoadZero.tbz (35.5 KB) genDataLoadZero.tbz tar bzip2 of generated dir tree Florian Manschwetus, 2020-09-28 09:43 AM
copy-item.ps1 (720 Bytes) copy-item.ps1 powershell script, defining functions to time Windows Explorer copy/remove operation Florian Manschwetus, 2020-09-28 09:46 AM
copyGenZeroTcpTP.pdf (1.75 MB) copyGenZeroTcpTP.pdf throughput normal Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroTcpdumpTcpTP.pdf (1.92 MB) copyGenZeroTcpdumpTcpTP.pdf throughput tcpdump Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroTcpdumpTcpRTT.pdf (679 KB) copyGenZeroTcpdumpTcpRTT.pdf RoundTripTime tcpdump Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroTcpRTT.pdf (1.22 MB) copyGenZeroTcpRTT.pdf RoundTripTime normal Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroTcpdumpPacketLengths.txt (1.95 KB) copyGenZeroTcpdumpPacketLengths.txt Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroPacketLengths.txt (1.95 KB) copyGenZeroPacketLengths.txt Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroTcpdumpIO.pdf (71.3 KB) copyGenZeroTcpdumpIO.pdf Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroIO.pdf (89.3 KB) copyGenZeroIO.pdf Florian Manschwetus, 2020-09-28 04:37 PM
copyGenZeroDtraceSMBServicetimes_compare.txt (4.03 KB) copyGenZeroDtraceSMBServicetimes_compare.txt internal RTT by dtrace smb2 Florian Manschwetus, 2020-09-30 09:31 AM
smb2-trace.d (2.83 KB) smb2-trace.d dtrace script used to get internal smb2 RTT Florian Manschwetus, 2020-09-30 09:32 AM
copyGenZeroDtraceSMBServicetimes_compare2.txt (2.61 KB) copyGenZeroDtraceSMBServicetimes_compare2.txt dtrace mesaured SMB2 service RTT, with time gap between requests measured Florian Manschwetus, 2020-09-30 11:00 AM
LAN Skizze.pdf (212 KB) LAN Skizze.pdf Florian Manschwetus, 2020-09-30 03:42 PM
Actions

Also available in: Atom PDF