filesystemszfs

Why do these 2 ZFS pools have different allocation and capacity, even thought they have the same files?


I have two zpools on ZFD:

The data is EXACTLY the same. I even ran diff -qr /top/zpool/ /bottom/zpool/ to confirm.

Why is it that ALLOC and CAP fields differ, if data is exactly duplicated?

enter image description here


Solution

  • So I figured out why the amount of space is different on two different ZPOOLs:

    Under normal circumstances 8 disks 2TB each is 16TB of storage in the first group of disks. And 4 disks 4TB each is also 16 TB of storage in the second group of disks. Because this is raidZ3 the parity across two pools is NOT the same. raidZ3 is designed to survive a loss of 3 disks from the Zpool. If the first ZPOOL loses 3 disks then it can remain mostly functional and have 5 disks of 2TB data on each. That is 10TB of readable data from the first Zpool. If the second Zpool suffers a loss of 3 disks at 4TB each then only one 4TB disk remains readable from the second Zpool. Because 4TB != 10TB there is a difference in capacity in ZFSRaidZ3 between the pools.