New deduplication hash algorithm
do you think it's possible to add a new deduplication hash algoritm less cpu intensive?
I mean sha 256 is really nice because you have a very very low probability of hash collision but in real world it's just to cpu consumming to use it.
Why don't implement another algorithm like sha-1 or md5? Plus you have the verify mode if a collision appear.
Updated by Anthony Glidic about 7 years ago
Hello that is not true,
actually fletcher4 is only usable for checksumming not for deduplication.
Today the only algorithm for deduplication is sha256 (and by the way when deduplication is on you should turn off checksumming, it's useless to calcul 2 hashs).
with a lower algorithm like sha1 (160 bits) it will lower the cpu load reduce the hash size so reduce the global size of ddt and kept a good security.
P.S: i talk about sha1 but i'm sure other new and better algorithm exist for that