Project

General

Profile

Bug #5269

zpool import slow

Added by Arne Jansen about 5 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
Category:
zfs - Zettabyte File System
Start date:
2015-06-04
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:
Medium
Tags:
needs-triage

Description

When importing a pool (at boot or with zpool import) with many filesystem, the process can take minutes. It doesn't matter whether the pool has been exported cleanly or uncleanly.
The problem is that each dataset has its own log chain. On import, all datasets have to be checked if there are logs to replay.
The idea is to speed up this process by paralellizing it.


Subtasks

Bug #5981: Deadlock in dmu_objset_find_dpClosed

Actions

History

#1

Updated by Bob Lu almost 5 years ago

Hello,
Does this issue fixed in latest zfs code?
I checked the mail loop, seems we already have got the solution.
Thanks.

#2

Updated by Arne Jansen almost 5 years ago

Not yet. There is a solution, but it still needs rigorous testing. I hope to get around to it in the next few weeks.

#3

Updated by Daniel Barney over 4 years ago

We see this all the time on our servers when they are booting. a long delay of more then several minutes, all while running the `zpool import -f zones` command.

We are interested in doing some testing, we just need to know where the code is to test it out is.

#4

Updated by Arne Jansen over 4 years ago

The latest version is here:

http://cr.illumos.org/~webrev/sensille/find_parallel_dp/

Please also check the mail thread:

http://www.listbox.com/member/archive/182191/2015/02/sort/thread/page/1/entry/5:30/20141031115710:8E498ED2-6116-11E4-B4AC-CE5F067FCD05/

The patch might need a rebase to the current version.

I myself will also start testing today.

#5

Updated by Electric Monk over 4 years ago

  • Status changed from New to Closed
  • % Done changed from 0 to 100

git commit 12380e1e701fda28c9e9f32d01cafb54af279eb5

commit  12380e1e701fda28c9e9f32d01cafb54af279eb5
Author: Arne Jansen <jansen@webgods.de>
Date:   2015-05-09T17:02:31.000Z

    5269 zpool import slow
    Reviewed by: Matthew Ahrens <mahrens@delphix.com>
    Reviewed by: George Wilson <george@delphix.com>
    Reviewed by: Dan McDonald <danmcd@omniti.com>
    Approved by: Dan McDonald <danmcd@omniti.com>

Also available in: Atom PDF