From john at johnrshannon.com Fri Dec 15 07:24:40 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 08:24:40 -0700 Subject: Maintenance of mirrored filesystem Message-ID: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> I setup hammer filesystems on identical disk drives. I created a number of PFS that are mirrored. Over time, the storage allocation on the MASTER has remained constant while it continues to grow on the SLAVE as shown in the following: MASTER 5588G 1456G 4132G 26% /master SLAVE 5588G 2775G 2813G 50% /slave /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns /master/pfs/@@-1:00001 5588G 1456G 4132G 26% /master/backups/colleen /master/pfs/@@-1:00003 5588G 1456G 4132G 26% /master/backups/domain0 /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master ... Am I missing a maintenance step that needs to be performed on the slave? My daily run output shows: HAMMER maintenance: cleanup / - handle PFS#0 using /var/hammer/root snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /build - handle PFS#0 using /var/hammer/build snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master - handle PFS#0 using /var/hammer/master snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /slave - handle PFS#0 using /var/hammer/slave snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master/backups/dns - handle PFS#2 using /var/hammer/master/backups/dns snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip ... (for each PFS) The mounts all represent the master PFS as the slave PFS are not mounted. -- John R. Shannon john at johnrshannon.com From t+dfbsd at timdarby.net Fri Dec 15 09:49:27 2017 From: t+dfbsd at timdarby.net (Tim Darby) Date: Fri, 15 Dec 2017 10:49:27 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon wrote: > I setup hammer filesystems on identical disk drives. I created a number > of PFS that are mirrored. Over time, the storage allocation on the > MASTER has remained constant while it continues to grow on the SLAVE as > shown in the following: > > MASTER 5588G 1456G 4132G 26% /master > SLAVE 5588G 2775G 2813G 50% /slave > /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns > /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > /master/backups/colleen > /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > /master/backups/domain0 > /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap > /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > > ... > > Am I missing a maintenance step that needs to be performed on the slave? ?By default, the daily periodic script for hammer cleanup only works on mounted volumes, so that's why your unmounted slaves are not being cleaned up. You can tell it to clean up unmounted volumes by adding this line to /etc/periodic.conf: daily_clean_hammer-pfslist="path_to_first_unmounted_pfs path_to_second_unmounted_pfs etc" The unfortunate side effect of this is that will cause it to stop cleaning up mounted PFSes, so I created a separate hammer cleanup script in /etc/periodic/daily that cleans up the mounted ones. Tim? -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 10:50:10 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 11:50:10 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Thank you. That got it. On 12/15/17 10:49, Tim Darby wrote: > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > wrote: > >> I setup hammer filesystems on identical disk drives. I created a number >> of PFS that are mirrored. Over time, the storage allocation on the >> MASTER has remained constant while it continues to grow on the SLAVE as >> shown in the following: >> >> MASTER 5588G 1456G 4132G 26% /master >> SLAVE 5588G 2775G 2813G 50% /slave >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> /master/backups/colleen >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> /master/backups/domain0 >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> ... >> >> Am I missing a maintenance step that needs to be performed on the slave? > > > ?By default, the daily periodic script for hammer cleanup only works on > mounted volumes, so that's why your unmounted slaves are not being cleaned > up. You can tell it to clean up unmounted volumes by adding this line to > /etc/periodic.conf: > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > path_to_second_unmounted_pfs etc" > > The unfortunate side effect of this is that will cause it to stop cleaning > up mounted PFSes, so I created a separate hammer cleanup script in > /etc/periodic/daily that cleans up the mounted ones. > > Tim? > -- John R. Shannon john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:24:51 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:24:51 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Also turning on dedup can save space On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: > Thank you. That got it. > > On 12/15/17 10:49, Tim Darby wrote: > > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > > wrote: > > > >> I setup hammer filesystems on identical disk drives. I created a number > >> of PFS that are mirrored. Over time, the storage allocation on the > >> MASTER has remained constant while it continues to grow on the SLAVE as > >> shown in the following: > >> > >> MASTER 5588G 1456G 4132G 26% /master > >> SLAVE 5588G 2775G 2813G 50% /slave > >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > /master/backups/dns > >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> /master/backups/colleen > >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> /master/backups/domain0 > >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > /master/backups/imap > >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> > >> ... > >> > >> Am I missing a maintenance step that needs to be performed on the slave? > > > > > > ?By default, the daily periodic script for hammer cleanup only works on > > mounted volumes, so that's why your unmounted slaves are not being > cleaned > > up. You can tell it to clean up unmounted volumes by adding this line to > > /etc/periodic.conf: > > > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > > path_to_second_unmounted_pfs etc" > > > > The unfortunate side effect of this is that will cause it to stop > cleaning > > up mounted PFSes, so I created a separate hammer cleanup script in > > /etc/periodic/daily that cleans up the mounted ones. > > > > Tim? > > > > -- > > John R. Shannon > john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kusumi.tomohiro at gmail.com Fri Dec 15 11:32:59 2017 From: kusumi.tomohiro at gmail.com (Tomohiro Kusumi) Date: Fri, 15 Dec 2017 21:32:59 +0200 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Note that using live dedup on H1 is not recommended (by Matt). I don't think anyone is really using it too. 2017-12-15 21:24 GMT+02:00 Zachary Crownover : > Also turning on dedup can save space > > On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: >> >> Thank you. That got it. >> >> On 12/15/17 10:49, Tim Darby wrote: >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon >> > wrote: >> > >> >> I setup hammer filesystems on identical disk drives. I created a number >> >> of PFS that are mirrored. Over time, the storage allocation on the >> >> MASTER has remained constant while it continues to grow on the SLAVE as >> >> shown in the following: >> >> >> >> MASTER 5588G 1456G 4132G 26% /master >> >> SLAVE 5588G 2775G 2813G 50% /slave >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% >> >> /master/backups/dns >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> >> /master/backups/colleen >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> >> /master/backups/domain0 >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% >> >> /master/backups/imap >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> >> >> ... >> >> >> >> Am I missing a maintenance step that needs to be performed on the >> >> slave? >> > >> > >> > By default, the daily periodic script for hammer cleanup only works on >> > mounted volumes, so that's why your unmounted slaves are not being >> > cleaned >> > up. You can tell it to clean up unmounted volumes by adding this line to >> > /etc/periodic.conf: >> > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs >> > path_to_second_unmounted_pfs etc" >> > >> > The unfortunate side effect of this is that will cause it to stop >> > cleaning >> > up mounted PFSes, so I created a separate hammer cleanup script in >> > /etc/periodic/daily that cleans up the mounted ones. >> > >> > Tim >> > >> >> -- >> >> John R. Shannon >> john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:36:08 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:36:08 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: if live dedup is uncommenting the section in the hammer config on each PFS, I've been doing it for years on every system. On Dec 15, 2017 11:33 AM, "Tomohiro Kusumi" wrote: > Note that using live dedup on H1 is not recommended (by Matt). > I don't think anyone is really using it too. > > 2017-12-15 21:24 GMT+02:00 Zachary Crownover >: > > Also turning on dedup can save space > > > > On Dec 15, 2017 10:50 AM, "John R. Shannon" > wrote: > >> > >> Thank you. That got it. > >> > >> On 12/15/17 10:49, Tim Darby wrote: > >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon < > john at johnrshannon.com> > >> > wrote: > >> > > >> >> I setup hammer filesystems on identical disk drives. I created a > number > >> >> of PFS that are mirrored. Over time, the storage allocation on the > >> >> MASTER has remained constant while it continues to grow on the SLAVE > as > >> >> shown in the following: > >> >> > >> >> MASTER 5588G 1456G 4132G 26% /master > >> >> SLAVE 5588G 2775G 2813G 50% /slave > >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > >> >> /master/backups/dns > >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> >> /master/backups/colleen > >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> >> /master/backups/domain0 > >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > >> >> /master/backups/imap > >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> >> > >> >> ... > >> >> > >> >> Am I missing a maintenance step that needs to be performed on the > >> >> slave? > >> > > >> > > >> > By default, the daily periodic script for hammer cleanup only works on > >> > mounted volumes, so that's why your unmounted slaves are not being > >> > cleaned > >> > up. You can tell it to clean up unmounted volumes by adding this line > to > >> > /etc/periodic.conf: > >> > > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > >> > path_to_second_unmounted_pfs etc" > >> > > >> > The unfortunate side effect of this is that will cause it to stop > >> > cleaning > >> > up mounted PFSes, so I created a separate hammer cleanup script in > >> > /etc/periodic/daily that cleans up the mounted ones. > >> > > >> > Tim > >> > > >> > >> -- > >> > >> John R. Shannon > >> john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 07:24:40 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 08:24:40 -0700 Subject: Maintenance of mirrored filesystem Message-ID: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> I setup hammer filesystems on identical disk drives. I created a number of PFS that are mirrored. Over time, the storage allocation on the MASTER has remained constant while it continues to grow on the SLAVE as shown in the following: MASTER 5588G 1456G 4132G 26% /master SLAVE 5588G 2775G 2813G 50% /slave /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns /master/pfs/@@-1:00001 5588G 1456G 4132G 26% /master/backups/colleen /master/pfs/@@-1:00003 5588G 1456G 4132G 26% /master/backups/domain0 /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master ... Am I missing a maintenance step that needs to be performed on the slave? My daily run output shows: HAMMER maintenance: cleanup / - handle PFS#0 using /var/hammer/root snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /build - handle PFS#0 using /var/hammer/build snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master - handle PFS#0 using /var/hammer/master snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /slave - handle PFS#0 using /var/hammer/slave snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master/backups/dns - handle PFS#2 using /var/hammer/master/backups/dns snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip ... (for each PFS) The mounts all represent the master PFS as the slave PFS are not mounted. -- John R. Shannon john at johnrshannon.com From t+dfbsd at timdarby.net Fri Dec 15 09:49:27 2017 From: t+dfbsd at timdarby.net (Tim Darby) Date: Fri, 15 Dec 2017 10:49:27 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon wrote: > I setup hammer filesystems on identical disk drives. I created a number > of PFS that are mirrored. Over time, the storage allocation on the > MASTER has remained constant while it continues to grow on the SLAVE as > shown in the following: > > MASTER 5588G 1456G 4132G 26% /master > SLAVE 5588G 2775G 2813G 50% /slave > /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns > /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > /master/backups/colleen > /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > /master/backups/domain0 > /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap > /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > > ... > > Am I missing a maintenance step that needs to be performed on the slave? ?By default, the daily periodic script for hammer cleanup only works on mounted volumes, so that's why your unmounted slaves are not being cleaned up. You can tell it to clean up unmounted volumes by adding this line to /etc/periodic.conf: daily_clean_hammer-pfslist="path_to_first_unmounted_pfs path_to_second_unmounted_pfs etc" The unfortunate side effect of this is that will cause it to stop cleaning up mounted PFSes, so I created a separate hammer cleanup script in /etc/periodic/daily that cleans up the mounted ones. Tim? -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 10:50:10 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 11:50:10 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Thank you. That got it. On 12/15/17 10:49, Tim Darby wrote: > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > wrote: > >> I setup hammer filesystems on identical disk drives. I created a number >> of PFS that are mirrored. Over time, the storage allocation on the >> MASTER has remained constant while it continues to grow on the SLAVE as >> shown in the following: >> >> MASTER 5588G 1456G 4132G 26% /master >> SLAVE 5588G 2775G 2813G 50% /slave >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> /master/backups/colleen >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> /master/backups/domain0 >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> ... >> >> Am I missing a maintenance step that needs to be performed on the slave? > > > ?By default, the daily periodic script for hammer cleanup only works on > mounted volumes, so that's why your unmounted slaves are not being cleaned > up. You can tell it to clean up unmounted volumes by adding this line to > /etc/periodic.conf: > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > path_to_second_unmounted_pfs etc" > > The unfortunate side effect of this is that will cause it to stop cleaning > up mounted PFSes, so I created a separate hammer cleanup script in > /etc/periodic/daily that cleans up the mounted ones. > > Tim? > -- John R. Shannon john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:24:51 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:24:51 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Also turning on dedup can save space On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: > Thank you. That got it. > > On 12/15/17 10:49, Tim Darby wrote: > > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > > wrote: > > > >> I setup hammer filesystems on identical disk drives. I created a number > >> of PFS that are mirrored. Over time, the storage allocation on the > >> MASTER has remained constant while it continues to grow on the SLAVE as > >> shown in the following: > >> > >> MASTER 5588G 1456G 4132G 26% /master > >> SLAVE 5588G 2775G 2813G 50% /slave > >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > /master/backups/dns > >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> /master/backups/colleen > >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> /master/backups/domain0 > >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > /master/backups/imap > >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> > >> ... > >> > >> Am I missing a maintenance step that needs to be performed on the slave? > > > > > > ?By default, the daily periodic script for hammer cleanup only works on > > mounted volumes, so that's why your unmounted slaves are not being > cleaned > > up. You can tell it to clean up unmounted volumes by adding this line to > > /etc/periodic.conf: > > > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > > path_to_second_unmounted_pfs etc" > > > > The unfortunate side effect of this is that will cause it to stop > cleaning > > up mounted PFSes, so I created a separate hammer cleanup script in > > /etc/periodic/daily that cleans up the mounted ones. > > > > Tim? > > > > -- > > John R. Shannon > john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kusumi.tomohiro at gmail.com Fri Dec 15 11:32:59 2017 From: kusumi.tomohiro at gmail.com (Tomohiro Kusumi) Date: Fri, 15 Dec 2017 21:32:59 +0200 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Note that using live dedup on H1 is not recommended (by Matt). I don't think anyone is really using it too. 2017-12-15 21:24 GMT+02:00 Zachary Crownover : > Also turning on dedup can save space > > On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: >> >> Thank you. That got it. >> >> On 12/15/17 10:49, Tim Darby wrote: >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon >> > wrote: >> > >> >> I setup hammer filesystems on identical disk drives. I created a number >> >> of PFS that are mirrored. Over time, the storage allocation on the >> >> MASTER has remained constant while it continues to grow on the SLAVE as >> >> shown in the following: >> >> >> >> MASTER 5588G 1456G 4132G 26% /master >> >> SLAVE 5588G 2775G 2813G 50% /slave >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% >> >> /master/backups/dns >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> >> /master/backups/colleen >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> >> /master/backups/domain0 >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% >> >> /master/backups/imap >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> >> >> ... >> >> >> >> Am I missing a maintenance step that needs to be performed on the >> >> slave? >> > >> > >> > By default, the daily periodic script for hammer cleanup only works on >> > mounted volumes, so that's why your unmounted slaves are not being >> > cleaned >> > up. You can tell it to clean up unmounted volumes by adding this line to >> > /etc/periodic.conf: >> > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs >> > path_to_second_unmounted_pfs etc" >> > >> > The unfortunate side effect of this is that will cause it to stop >> > cleaning >> > up mounted PFSes, so I created a separate hammer cleanup script in >> > /etc/periodic/daily that cleans up the mounted ones. >> > >> > Tim >> > >> >> -- >> >> John R. Shannon >> john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:36:08 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:36:08 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: if live dedup is uncommenting the section in the hammer config on each PFS, I've been doing it for years on every system. On Dec 15, 2017 11:33 AM, "Tomohiro Kusumi" wrote: > Note that using live dedup on H1 is not recommended (by Matt). > I don't think anyone is really using it too. > > 2017-12-15 21:24 GMT+02:00 Zachary Crownover >: > > Also turning on dedup can save space > > > > On Dec 15, 2017 10:50 AM, "John R. Shannon" > wrote: > >> > >> Thank you. That got it. > >> > >> On 12/15/17 10:49, Tim Darby wrote: > >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon < > john at johnrshannon.com> > >> > wrote: > >> > > >> >> I setup hammer filesystems on identical disk drives. I created a > number > >> >> of PFS that are mirrored. Over time, the storage allocation on the > >> >> MASTER has remained constant while it continues to grow on the SLAVE > as > >> >> shown in the following: > >> >> > >> >> MASTER 5588G 1456G 4132G 26% /master > >> >> SLAVE 5588G 2775G 2813G 50% /slave > >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > >> >> /master/backups/dns > >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> >> /master/backups/colleen > >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> >> /master/backups/domain0 > >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > >> >> /master/backups/imap > >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> >> > >> >> ... > >> >> > >> >> Am I missing a maintenance step that needs to be performed on the > >> >> slave? > >> > > >> > > >> > By default, the daily periodic script for hammer cleanup only works on > >> > mounted volumes, so that's why your unmounted slaves are not being > >> > cleaned > >> > up. You can tell it to clean up unmounted volumes by adding this line > to > >> > /etc/periodic.conf: > >> > > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > >> > path_to_second_unmounted_pfs etc" > >> > > >> > The unfortunate side effect of this is that will cause it to stop > >> > cleaning > >> > up mounted PFSes, so I created a separate hammer cleanup script in > >> > /etc/periodic/daily that cleans up the mounted ones. > >> > > >> > Tim > >> > > >> > >> -- > >> > >> John R. Shannon > >> john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 07:24:40 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 08:24:40 -0700 Subject: Maintenance of mirrored filesystem Message-ID: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> I setup hammer filesystems on identical disk drives. I created a number of PFS that are mirrored. Over time, the storage allocation on the MASTER has remained constant while it continues to grow on the SLAVE as shown in the following: MASTER 5588G 1456G 4132G 26% /master SLAVE 5588G 2775G 2813G 50% /slave /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns /master/pfs/@@-1:00001 5588G 1456G 4132G 26% /master/backups/colleen /master/pfs/@@-1:00003 5588G 1456G 4132G 26% /master/backups/domain0 /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master ... Am I missing a maintenance step that needs to be performed on the slave? My daily run output shows: HAMMER maintenance: cleanup / - handle PFS#0 using /var/hammer/root snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /build - handle PFS#0 using /var/hammer/build snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master - handle PFS#0 using /var/hammer/master snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /slave - handle PFS#0 using /var/hammer/slave snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master/backups/dns - handle PFS#2 using /var/hammer/master/backups/dns snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip ... (for each PFS) The mounts all represent the master PFS as the slave PFS are not mounted. -- John R. Shannon john at johnrshannon.com From t+dfbsd at timdarby.net Fri Dec 15 09:49:27 2017 From: t+dfbsd at timdarby.net (Tim Darby) Date: Fri, 15 Dec 2017 10:49:27 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon wrote: > I setup hammer filesystems on identical disk drives. I created a number > of PFS that are mirrored. Over time, the storage allocation on the > MASTER has remained constant while it continues to grow on the SLAVE as > shown in the following: > > MASTER 5588G 1456G 4132G 26% /master > SLAVE 5588G 2775G 2813G 50% /slave > /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns > /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > /master/backups/colleen > /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > /master/backups/domain0 > /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap > /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > > ... > > Am I missing a maintenance step that needs to be performed on the slave? ?By default, the daily periodic script for hammer cleanup only works on mounted volumes, so that's why your unmounted slaves are not being cleaned up. You can tell it to clean up unmounted volumes by adding this line to /etc/periodic.conf: daily_clean_hammer-pfslist="path_to_first_unmounted_pfs path_to_second_unmounted_pfs etc" The unfortunate side effect of this is that will cause it to stop cleaning up mounted PFSes, so I created a separate hammer cleanup script in /etc/periodic/daily that cleans up the mounted ones. Tim? -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 10:50:10 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 11:50:10 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Thank you. That got it. On 12/15/17 10:49, Tim Darby wrote: > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > wrote: > >> I setup hammer filesystems on identical disk drives. I created a number >> of PFS that are mirrored. Over time, the storage allocation on the >> MASTER has remained constant while it continues to grow on the SLAVE as >> shown in the following: >> >> MASTER 5588G 1456G 4132G 26% /master >> SLAVE 5588G 2775G 2813G 50% /slave >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> /master/backups/colleen >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> /master/backups/domain0 >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> ... >> >> Am I missing a maintenance step that needs to be performed on the slave? > > > ?By default, the daily periodic script for hammer cleanup only works on > mounted volumes, so that's why your unmounted slaves are not being cleaned > up. You can tell it to clean up unmounted volumes by adding this line to > /etc/periodic.conf: > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > path_to_second_unmounted_pfs etc" > > The unfortunate side effect of this is that will cause it to stop cleaning > up mounted PFSes, so I created a separate hammer cleanup script in > /etc/periodic/daily that cleans up the mounted ones. > > Tim? > -- John R. Shannon john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:24:51 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:24:51 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Also turning on dedup can save space On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: > Thank you. That got it. > > On 12/15/17 10:49, Tim Darby wrote: > > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > > wrote: > > > >> I setup hammer filesystems on identical disk drives. I created a number > >> of PFS that are mirrored. Over time, the storage allocation on the > >> MASTER has remained constant while it continues to grow on the SLAVE as > >> shown in the following: > >> > >> MASTER 5588G 1456G 4132G 26% /master > >> SLAVE 5588G 2775G 2813G 50% /slave > >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > /master/backups/dns > >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> /master/backups/colleen > >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> /master/backups/domain0 > >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > /master/backups/imap > >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> > >> ... > >> > >> Am I missing a maintenance step that needs to be performed on the slave? > > > > > > ?By default, the daily periodic script for hammer cleanup only works on > > mounted volumes, so that's why your unmounted slaves are not being > cleaned > > up. You can tell it to clean up unmounted volumes by adding this line to > > /etc/periodic.conf: > > > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > > path_to_second_unmounted_pfs etc" > > > > The unfortunate side effect of this is that will cause it to stop > cleaning > > up mounted PFSes, so I created a separate hammer cleanup script in > > /etc/periodic/daily that cleans up the mounted ones. > > > > Tim? > > > > -- > > John R. Shannon > john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kusumi.tomohiro at gmail.com Fri Dec 15 11:32:59 2017 From: kusumi.tomohiro at gmail.com (Tomohiro Kusumi) Date: Fri, 15 Dec 2017 21:32:59 +0200 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Note that using live dedup on H1 is not recommended (by Matt). I don't think anyone is really using it too. 2017-12-15 21:24 GMT+02:00 Zachary Crownover : > Also turning on dedup can save space > > On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: >> >> Thank you. That got it. >> >> On 12/15/17 10:49, Tim Darby wrote: >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon >> > wrote: >> > >> >> I setup hammer filesystems on identical disk drives. I created a number >> >> of PFS that are mirrored. Over time, the storage allocation on the >> >> MASTER has remained constant while it continues to grow on the SLAVE as >> >> shown in the following: >> >> >> >> MASTER 5588G 1456G 4132G 26% /master >> >> SLAVE 5588G 2775G 2813G 50% /slave >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% >> >> /master/backups/dns >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> >> /master/backups/colleen >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> >> /master/backups/domain0 >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% >> >> /master/backups/imap >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> >> >> ... >> >> >> >> Am I missing a maintenance step that needs to be performed on the >> >> slave? >> > >> > >> > By default, the daily periodic script for hammer cleanup only works on >> > mounted volumes, so that's why your unmounted slaves are not being >> > cleaned >> > up. You can tell it to clean up unmounted volumes by adding this line to >> > /etc/periodic.conf: >> > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs >> > path_to_second_unmounted_pfs etc" >> > >> > The unfortunate side effect of this is that will cause it to stop >> > cleaning >> > up mounted PFSes, so I created a separate hammer cleanup script in >> > /etc/periodic/daily that cleans up the mounted ones. >> > >> > Tim >> > >> >> -- >> >> John R. Shannon >> john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:36:08 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:36:08 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: if live dedup is uncommenting the section in the hammer config on each PFS, I've been doing it for years on every system. On Dec 15, 2017 11:33 AM, "Tomohiro Kusumi" wrote: > Note that using live dedup on H1 is not recommended (by Matt). > I don't think anyone is really using it too. > > 2017-12-15 21:24 GMT+02:00 Zachary Crownover >: > > Also turning on dedup can save space > > > > On Dec 15, 2017 10:50 AM, "John R. Shannon" > wrote: > >> > >> Thank you. That got it. > >> > >> On 12/15/17 10:49, Tim Darby wrote: > >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon < > john at johnrshannon.com> > >> > wrote: > >> > > >> >> I setup hammer filesystems on identical disk drives. I created a > number > >> >> of PFS that are mirrored. Over time, the storage allocation on the > >> >> MASTER has remained constant while it continues to grow on the SLAVE > as > >> >> shown in the following: > >> >> > >> >> MASTER 5588G 1456G 4132G 26% /master > >> >> SLAVE 5588G 2775G 2813G 50% /slave > >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > >> >> /master/backups/dns > >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> >> /master/backups/colleen > >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> >> /master/backups/domain0 > >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > >> >> /master/backups/imap > >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> >> > >> >> ... > >> >> > >> >> Am I missing a maintenance step that needs to be performed on the > >> >> slave? > >> > > >> > > >> > By default, the daily periodic script for hammer cleanup only works on > >> > mounted volumes, so that's why your unmounted slaves are not being > >> > cleaned > >> > up. You can tell it to clean up unmounted volumes by adding this line > to > >> > /etc/periodic.conf: > >> > > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > >> > path_to_second_unmounted_pfs etc" > >> > > >> > The unfortunate side effect of this is that will cause it to stop > >> > cleaning > >> > up mounted PFSes, so I created a separate hammer cleanup script in > >> > /etc/periodic/daily that cleans up the mounted ones. > >> > > >> > Tim > >> > > >> > >> -- > >> > >> John R. Shannon > >> john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 07:24:40 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 08:24:40 -0700 Subject: Maintenance of mirrored filesystem Message-ID: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> I setup hammer filesystems on identical disk drives. I created a number of PFS that are mirrored. Over time, the storage allocation on the MASTER has remained constant while it continues to grow on the SLAVE as shown in the following: MASTER 5588G 1456G 4132G 26% /master SLAVE 5588G 2775G 2813G 50% /slave /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns /master/pfs/@@-1:00001 5588G 1456G 4132G 26% /master/backups/colleen /master/pfs/@@-1:00003 5588G 1456G 4132G 26% /master/backups/domain0 /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master ... Am I missing a maintenance step that needs to be performed on the slave? My daily run output shows: HAMMER maintenance: cleanup / - handle PFS#0 using /var/hammer/root snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /build - handle PFS#0 using /var/hammer/build snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master - handle PFS#0 using /var/hammer/master snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /slave - handle PFS#0 using /var/hammer/slave snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master/backups/dns - handle PFS#2 using /var/hammer/master/backups/dns snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip ... (for each PFS) The mounts all represent the master PFS as the slave PFS are not mounted. -- John R. Shannon john at johnrshannon.com From t+dfbsd at timdarby.net Fri Dec 15 09:49:27 2017 From: t+dfbsd at timdarby.net (Tim Darby) Date: Fri, 15 Dec 2017 10:49:27 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon wrote: > I setup hammer filesystems on identical disk drives. I created a number > of PFS that are mirrored. Over time, the storage allocation on the > MASTER has remained constant while it continues to grow on the SLAVE as > shown in the following: > > MASTER 5588G 1456G 4132G 26% /master > SLAVE 5588G 2775G 2813G 50% /slave > /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns > /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > /master/backups/colleen > /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > /master/backups/domain0 > /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap > /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > > ... > > Am I missing a maintenance step that needs to be performed on the slave? ?By default, the daily periodic script for hammer cleanup only works on mounted volumes, so that's why your unmounted slaves are not being cleaned up. You can tell it to clean up unmounted volumes by adding this line to /etc/periodic.conf: daily_clean_hammer-pfslist="path_to_first_unmounted_pfs path_to_second_unmounted_pfs etc" The unfortunate side effect of this is that will cause it to stop cleaning up mounted PFSes, so I created a separate hammer cleanup script in /etc/periodic/daily that cleans up the mounted ones. Tim? -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 10:50:10 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 11:50:10 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Thank you. That got it. On 12/15/17 10:49, Tim Darby wrote: > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > wrote: > >> I setup hammer filesystems on identical disk drives. I created a number >> of PFS that are mirrored. Over time, the storage allocation on the >> MASTER has remained constant while it continues to grow on the SLAVE as >> shown in the following: >> >> MASTER 5588G 1456G 4132G 26% /master >> SLAVE 5588G 2775G 2813G 50% /slave >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> /master/backups/colleen >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> /master/backups/domain0 >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> ... >> >> Am I missing a maintenance step that needs to be performed on the slave? > > > ?By default, the daily periodic script for hammer cleanup only works on > mounted volumes, so that's why your unmounted slaves are not being cleaned > up. You can tell it to clean up unmounted volumes by adding this line to > /etc/periodic.conf: > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > path_to_second_unmounted_pfs etc" > > The unfortunate side effect of this is that will cause it to stop cleaning > up mounted PFSes, so I created a separate hammer cleanup script in > /etc/periodic/daily that cleans up the mounted ones. > > Tim? > -- John R. Shannon john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:24:51 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:24:51 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Also turning on dedup can save space On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: > Thank you. That got it. > > On 12/15/17 10:49, Tim Darby wrote: > > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > > wrote: > > > >> I setup hammer filesystems on identical disk drives. I created a number > >> of PFS that are mirrored. Over time, the storage allocation on the > >> MASTER has remained constant while it continues to grow on the SLAVE as > >> shown in the following: > >> > >> MASTER 5588G 1456G 4132G 26% /master > >> SLAVE 5588G 2775G 2813G 50% /slave > >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > /master/backups/dns > >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> /master/backups/colleen > >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> /master/backups/domain0 > >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > /master/backups/imap > >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> > >> ... > >> > >> Am I missing a maintenance step that needs to be performed on the slave? > > > > > > ?By default, the daily periodic script for hammer cleanup only works on > > mounted volumes, so that's why your unmounted slaves are not being > cleaned > > up. You can tell it to clean up unmounted volumes by adding this line to > > /etc/periodic.conf: > > > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > > path_to_second_unmounted_pfs etc" > > > > The unfortunate side effect of this is that will cause it to stop > cleaning > > up mounted PFSes, so I created a separate hammer cleanup script in > > /etc/periodic/daily that cleans up the mounted ones. > > > > Tim? > > > > -- > > John R. Shannon > john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kusumi.tomohiro at gmail.com Fri Dec 15 11:32:59 2017 From: kusumi.tomohiro at gmail.com (Tomohiro Kusumi) Date: Fri, 15 Dec 2017 21:32:59 +0200 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Note that using live dedup on H1 is not recommended (by Matt). I don't think anyone is really using it too. 2017-12-15 21:24 GMT+02:00 Zachary Crownover : > Also turning on dedup can save space > > On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: >> >> Thank you. That got it. >> >> On 12/15/17 10:49, Tim Darby wrote: >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon >> > wrote: >> > >> >> I setup hammer filesystems on identical disk drives. I created a number >> >> of PFS that are mirrored. Over time, the storage allocation on the >> >> MASTER has remained constant while it continues to grow on the SLAVE as >> >> shown in the following: >> >> >> >> MASTER 5588G 1456G 4132G 26% /master >> >> SLAVE 5588G 2775G 2813G 50% /slave >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% >> >> /master/backups/dns >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> >> /master/backups/colleen >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> >> /master/backups/domain0 >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% >> >> /master/backups/imap >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> >> >> ... >> >> >> >> Am I missing a maintenance step that needs to be performed on the >> >> slave? >> > >> > >> > By default, the daily periodic script for hammer cleanup only works on >> > mounted volumes, so that's why your unmounted slaves are not being >> > cleaned >> > up. You can tell it to clean up unmounted volumes by adding this line to >> > /etc/periodic.conf: >> > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs >> > path_to_second_unmounted_pfs etc" >> > >> > The unfortunate side effect of this is that will cause it to stop >> > cleaning >> > up mounted PFSes, so I created a separate hammer cleanup script in >> > /etc/periodic/daily that cleans up the mounted ones. >> > >> > Tim >> > >> >> -- >> >> John R. Shannon >> john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:36:08 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:36:08 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: if live dedup is uncommenting the section in the hammer config on each PFS, I've been doing it for years on every system. On Dec 15, 2017 11:33 AM, "Tomohiro Kusumi" wrote: > Note that using live dedup on H1 is not recommended (by Matt). > I don't think anyone is really using it too. > > 2017-12-15 21:24 GMT+02:00 Zachary Crownover >: > > Also turning on dedup can save space > > > > On Dec 15, 2017 10:50 AM, "John R. Shannon" > wrote: > >> > >> Thank you. That got it. > >> > >> On 12/15/17 10:49, Tim Darby wrote: > >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon < > john at johnrshannon.com> > >> > wrote: > >> > > >> >> I setup hammer filesystems on identical disk drives. I created a > number > >> >> of PFS that are mirrored. Over time, the storage allocation on the > >> >> MASTER has remained constant while it continues to grow on the SLAVE > as > >> >> shown in the following: > >> >> > >> >> MASTER 5588G 1456G 4132G 26% /master > >> >> SLAVE 5588G 2775G 2813G 50% /slave > >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > >> >> /master/backups/dns > >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> >> /master/backups/colleen > >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> >> /master/backups/domain0 > >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > >> >> /master/backups/imap > >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> >> > >> >> ... > >> >> > >> >> Am I missing a maintenance step that needs to be performed on the > >> >> slave? > >> > > >> > > >> > By default, the daily periodic script for hammer cleanup only works on > >> > mounted volumes, so that's why your unmounted slaves are not being > >> > cleaned > >> > up. You can tell it to clean up unmounted volumes by adding this line > to > >> > /etc/periodic.conf: > >> > > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > >> > path_to_second_unmounted_pfs etc" > >> > > >> > The unfortunate side effect of this is that will cause it to stop > >> > cleaning > >> > up mounted PFSes, so I created a separate hammer cleanup script in > >> > /etc/periodic/daily that cleans up the mounted ones. > >> > > >> > Tim > >> > > >> > >> -- > >> > >> John R. Shannon > >> john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 07:24:40 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 08:24:40 -0700 Subject: Maintenance of mirrored filesystem Message-ID: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> I setup hammer filesystems on identical disk drives. I created a number of PFS that are mirrored. Over time, the storage allocation on the MASTER has remained constant while it continues to grow on the SLAVE as shown in the following: MASTER 5588G 1456G 4132G 26% /master SLAVE 5588G 2775G 2813G 50% /slave /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns /master/pfs/@@-1:00001 5588G 1456G 4132G 26% /master/backups/colleen /master/pfs/@@-1:00003 5588G 1456G 4132G 26% /master/backups/domain0 /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master ... Am I missing a maintenance step that needs to be performed on the slave? My daily run output shows: HAMMER maintenance: cleanup / - handle PFS#0 using /var/hammer/root snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /build - handle PFS#0 using /var/hammer/build snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master - handle PFS#0 using /var/hammer/master snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /slave - handle PFS#0 using /var/hammer/slave snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master/backups/dns - handle PFS#2 using /var/hammer/master/backups/dns snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip ... (for each PFS) The mounts all represent the master PFS as the slave PFS are not mounted. -- John R. Shannon john at johnrshannon.com From t+dfbsd at timdarby.net Fri Dec 15 09:49:27 2017 From: t+dfbsd at timdarby.net (Tim Darby) Date: Fri, 15 Dec 2017 10:49:27 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon wrote: > I setup hammer filesystems on identical disk drives. I created a number > of PFS that are mirrored. Over time, the storage allocation on the > MASTER has remained constant while it continues to grow on the SLAVE as > shown in the following: > > MASTER 5588G 1456G 4132G 26% /master > SLAVE 5588G 2775G 2813G 50% /slave > /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns > /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > /master/backups/colleen > /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > /master/backups/domain0 > /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap > /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > > ... > > Am I missing a maintenance step that needs to be performed on the slave? ?By default, the daily periodic script for hammer cleanup only works on mounted volumes, so that's why your unmounted slaves are not being cleaned up. You can tell it to clean up unmounted volumes by adding this line to /etc/periodic.conf: daily_clean_hammer-pfslist="path_to_first_unmounted_pfs path_to_second_unmounted_pfs etc" The unfortunate side effect of this is that will cause it to stop cleaning up mounted PFSes, so I created a separate hammer cleanup script in /etc/periodic/daily that cleans up the mounted ones. Tim? -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 10:50:10 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 11:50:10 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Thank you. That got it. On 12/15/17 10:49, Tim Darby wrote: > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > wrote: > >> I setup hammer filesystems on identical disk drives. I created a number >> of PFS that are mirrored. Over time, the storage allocation on the >> MASTER has remained constant while it continues to grow on the SLAVE as >> shown in the following: >> >> MASTER 5588G 1456G 4132G 26% /master >> SLAVE 5588G 2775G 2813G 50% /slave >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> /master/backups/colleen >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> /master/backups/domain0 >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> ... >> >> Am I missing a maintenance step that needs to be performed on the slave? > > > ?By default, the daily periodic script for hammer cleanup only works on > mounted volumes, so that's why your unmounted slaves are not being cleaned > up. You can tell it to clean up unmounted volumes by adding this line to > /etc/periodic.conf: > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > path_to_second_unmounted_pfs etc" > > The unfortunate side effect of this is that will cause it to stop cleaning > up mounted PFSes, so I created a separate hammer cleanup script in > /etc/periodic/daily that cleans up the mounted ones. > > Tim? > -- John R. Shannon john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:24:51 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:24:51 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Also turning on dedup can save space On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: > Thank you. That got it. > > On 12/15/17 10:49, Tim Darby wrote: > > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > > wrote: > > > >> I setup hammer filesystems on identical disk drives. I created a number > >> of PFS that are mirrored. Over time, the storage allocation on the > >> MASTER has remained constant while it continues to grow on the SLAVE as > >> shown in the following: > >> > >> MASTER 5588G 1456G 4132G 26% /master > >> SLAVE 5588G 2775G 2813G 50% /slave > >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > /master/backups/dns > >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> /master/backups/colleen > >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> /master/backups/domain0 > >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > /master/backups/imap > >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> > >> ... > >> > >> Am I missing a maintenance step that needs to be performed on the slave? > > > > > > ?By default, the daily periodic script for hammer cleanup only works on > > mounted volumes, so that's why your unmounted slaves are not being > cleaned > > up. You can tell it to clean up unmounted volumes by adding this line to > > /etc/periodic.conf: > > > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > > path_to_second_unmounted_pfs etc" > > > > The unfortunate side effect of this is that will cause it to stop > cleaning > > up mounted PFSes, so I created a separate hammer cleanup script in > > /etc/periodic/daily that cleans up the mounted ones. > > > > Tim? > > > > -- > > John R. Shannon > john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kusumi.tomohiro at gmail.com Fri Dec 15 11:32:59 2017 From: kusumi.tomohiro at gmail.com (Tomohiro Kusumi) Date: Fri, 15 Dec 2017 21:32:59 +0200 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Note that using live dedup on H1 is not recommended (by Matt). I don't think anyone is really using it too. 2017-12-15 21:24 GMT+02:00 Zachary Crownover : > Also turning on dedup can save space > > On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: >> >> Thank you. That got it. >> >> On 12/15/17 10:49, Tim Darby wrote: >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon >> > wrote: >> > >> >> I setup hammer filesystems on identical disk drives. I created a number >> >> of PFS that are mirrored. Over time, the storage allocation on the >> >> MASTER has remained constant while it continues to grow on the SLAVE as >> >> shown in the following: >> >> >> >> MASTER 5588G 1456G 4132G 26% /master >> >> SLAVE 5588G 2775G 2813G 50% /slave >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% >> >> /master/backups/dns >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> >> /master/backups/colleen >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> >> /master/backups/domain0 >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% >> >> /master/backups/imap >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> >> >> ... >> >> >> >> Am I missing a maintenance step that needs to be performed on the >> >> slave? >> > >> > >> > By default, the daily periodic script for hammer cleanup only works on >> > mounted volumes, so that's why your unmounted slaves are not being >> > cleaned >> > up. You can tell it to clean up unmounted volumes by adding this line to >> > /etc/periodic.conf: >> > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs >> > path_to_second_unmounted_pfs etc" >> > >> > The unfortunate side effect of this is that will cause it to stop >> > cleaning >> > up mounted PFSes, so I created a separate hammer cleanup script in >> > /etc/periodic/daily that cleans up the mounted ones. >> > >> > Tim >> > >> >> -- >> >> John R. Shannon >> john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:36:08 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:36:08 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: if live dedup is uncommenting the section in the hammer config on each PFS, I've been doing it for years on every system. On Dec 15, 2017 11:33 AM, "Tomohiro Kusumi" wrote: > Note that using live dedup on H1 is not recommended (by Matt). > I don't think anyone is really using it too. > > 2017-12-15 21:24 GMT+02:00 Zachary Crownover >: > > Also turning on dedup can save space > > > > On Dec 15, 2017 10:50 AM, "John R. Shannon" > wrote: > >> > >> Thank you. That got it. > >> > >> On 12/15/17 10:49, Tim Darby wrote: > >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon < > john at johnrshannon.com> > >> > wrote: > >> > > >> >> I setup hammer filesystems on identical disk drives. I created a > number > >> >> of PFS that are mirrored. Over time, the storage allocation on the > >> >> MASTER has remained constant while it continues to grow on the SLAVE > as > >> >> shown in the following: > >> >> > >> >> MASTER 5588G 1456G 4132G 26% /master > >> >> SLAVE 5588G 2775G 2813G 50% /slave > >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > >> >> /master/backups/dns > >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> >> /master/backups/colleen > >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> >> /master/backups/domain0 > >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > >> >> /master/backups/imap > >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> >> > >> >> ... > >> >> > >> >> Am I missing a maintenance step that needs to be performed on the > >> >> slave? > >> > > >> > > >> > By default, the daily periodic script for hammer cleanup only works on > >> > mounted volumes, so that's why your unmounted slaves are not being > >> > cleaned > >> > up. You can tell it to clean up unmounted volumes by adding this line > to > >> > /etc/periodic.conf: > >> > > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > >> > path_to_second_unmounted_pfs etc" > >> > > >> > The unfortunate side effect of this is that will cause it to stop > >> > cleaning > >> > up mounted PFSes, so I created a separate hammer cleanup script in > >> > /etc/periodic/daily that cleans up the mounted ones. > >> > > >> > Tim > >> > > >> > >> -- > >> > >> John R. Shannon > >> john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 07:24:40 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 08:24:40 -0700 Subject: Maintenance of mirrored filesystem Message-ID: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> I setup hammer filesystems on identical disk drives. I created a number of PFS that are mirrored. Over time, the storage allocation on the MASTER has remained constant while it continues to grow on the SLAVE as shown in the following: MASTER 5588G 1456G 4132G 26% /master SLAVE 5588G 2775G 2813G 50% /slave /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns /master/pfs/@@-1:00001 5588G 1456G 4132G 26% /master/backups/colleen /master/pfs/@@-1:00003 5588G 1456G 4132G 26% /master/backups/domain0 /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master ... Am I missing a maintenance step that needs to be performed on the slave? My daily run output shows: HAMMER maintenance: cleanup / - handle PFS#0 using /var/hammer/root snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /build - handle PFS#0 using /var/hammer/build snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master - handle PFS#0 using /var/hammer/master snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /slave - handle PFS#0 using /var/hammer/slave snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master/backups/dns - handle PFS#2 using /var/hammer/master/backups/dns snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip ... (for each PFS) The mounts all represent the master PFS as the slave PFS are not mounted. -- John R. Shannon john at johnrshannon.com From t+dfbsd at timdarby.net Fri Dec 15 09:49:27 2017 From: t+dfbsd at timdarby.net (Tim Darby) Date: Fri, 15 Dec 2017 10:49:27 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon wrote: > I setup hammer filesystems on identical disk drives. I created a number > of PFS that are mirrored. Over time, the storage allocation on the > MASTER has remained constant while it continues to grow on the SLAVE as > shown in the following: > > MASTER 5588G 1456G 4132G 26% /master > SLAVE 5588G 2775G 2813G 50% /slave > /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns > /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > /master/backups/colleen > /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > /master/backups/domain0 > /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap > /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > > ... > > Am I missing a maintenance step that needs to be performed on the slave? ?By default, the daily periodic script for hammer cleanup only works on mounted volumes, so that's why your unmounted slaves are not being cleaned up. You can tell it to clean up unmounted volumes by adding this line to /etc/periodic.conf: daily_clean_hammer-pfslist="path_to_first_unmounted_pfs path_to_second_unmounted_pfs etc" The unfortunate side effect of this is that will cause it to stop cleaning up mounted PFSes, so I created a separate hammer cleanup script in /etc/periodic/daily that cleans up the mounted ones. Tim? -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 10:50:10 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 11:50:10 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Thank you. That got it. On 12/15/17 10:49, Tim Darby wrote: > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > wrote: > >> I setup hammer filesystems on identical disk drives. I created a number >> of PFS that are mirrored. Over time, the storage allocation on the >> MASTER has remained constant while it continues to grow on the SLAVE as >> shown in the following: >> >> MASTER 5588G 1456G 4132G 26% /master >> SLAVE 5588G 2775G 2813G 50% /slave >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> /master/backups/colleen >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> /master/backups/domain0 >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> ... >> >> Am I missing a maintenance step that needs to be performed on the slave? > > > ?By default, the daily periodic script for hammer cleanup only works on > mounted volumes, so that's why your unmounted slaves are not being cleaned > up. You can tell it to clean up unmounted volumes by adding this line to > /etc/periodic.conf: > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > path_to_second_unmounted_pfs etc" > > The unfortunate side effect of this is that will cause it to stop cleaning > up mounted PFSes, so I created a separate hammer cleanup script in > /etc/periodic/daily that cleans up the mounted ones. > > Tim? > -- John R. Shannon john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:24:51 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:24:51 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Also turning on dedup can save space On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: > Thank you. That got it. > > On 12/15/17 10:49, Tim Darby wrote: > > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > > wrote: > > > >> I setup hammer filesystems on identical disk drives. I created a number > >> of PFS that are mirrored. Over time, the storage allocation on the > >> MASTER has remained constant while it continues to grow on the SLAVE as > >> shown in the following: > >> > >> MASTER 5588G 1456G 4132G 26% /master > >> SLAVE 5588G 2775G 2813G 50% /slave > >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > /master/backups/dns > >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> /master/backups/colleen > >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> /master/backups/domain0 > >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > /master/backups/imap > >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> > >> ... > >> > >> Am I missing a maintenance step that needs to be performed on the slave? > > > > > > ?By default, the daily periodic script for hammer cleanup only works on > > mounted volumes, so that's why your unmounted slaves are not being > cleaned > > up. You can tell it to clean up unmounted volumes by adding this line to > > /etc/periodic.conf: > > > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > > path_to_second_unmounted_pfs etc" > > > > The unfortunate side effect of this is that will cause it to stop > cleaning > > up mounted PFSes, so I created a separate hammer cleanup script in > > /etc/periodic/daily that cleans up the mounted ones. > > > > Tim? > > > > -- > > John R. Shannon > john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kusumi.tomohiro at gmail.com Fri Dec 15 11:32:59 2017 From: kusumi.tomohiro at gmail.com (Tomohiro Kusumi) Date: Fri, 15 Dec 2017 21:32:59 +0200 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Note that using live dedup on H1 is not recommended (by Matt). I don't think anyone is really using it too. 2017-12-15 21:24 GMT+02:00 Zachary Crownover : > Also turning on dedup can save space > > On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: >> >> Thank you. That got it. >> >> On 12/15/17 10:49, Tim Darby wrote: >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon >> > wrote: >> > >> >> I setup hammer filesystems on identical disk drives. I created a number >> >> of PFS that are mirrored. Over time, the storage allocation on the >> >> MASTER has remained constant while it continues to grow on the SLAVE as >> >> shown in the following: >> >> >> >> MASTER 5588G 1456G 4132G 26% /master >> >> SLAVE 5588G 2775G 2813G 50% /slave >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% >> >> /master/backups/dns >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> >> /master/backups/colleen >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> >> /master/backups/domain0 >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% >> >> /master/backups/imap >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> >> >> ... >> >> >> >> Am I missing a maintenance step that needs to be performed on the >> >> slave? >> > >> > >> > By default, the daily periodic script for hammer cleanup only works on >> > mounted volumes, so that's why your unmounted slaves are not being >> > cleaned >> > up. You can tell it to clean up unmounted volumes by adding this line to >> > /etc/periodic.conf: >> > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs >> > path_to_second_unmounted_pfs etc" >> > >> > The unfortunate side effect of this is that will cause it to stop >> > cleaning >> > up mounted PFSes, so I created a separate hammer cleanup script in >> > /etc/periodic/daily that cleans up the mounted ones. >> > >> > Tim >> > >> >> -- >> >> John R. Shannon >> john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:36:08 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:36:08 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: if live dedup is uncommenting the section in the hammer config on each PFS, I've been doing it for years on every system. On Dec 15, 2017 11:33 AM, "Tomohiro Kusumi" wrote: > Note that using live dedup on H1 is not recommended (by Matt). > I don't think anyone is really using it too. > > 2017-12-15 21:24 GMT+02:00 Zachary Crownover >: > > Also turning on dedup can save space > > > > On Dec 15, 2017 10:50 AM, "John R. Shannon" > wrote: > >> > >> Thank you. That got it. > >> > >> On 12/15/17 10:49, Tim Darby wrote: > >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon < > john at johnrshannon.com> > >> > wrote: > >> > > >> >> I setup hammer filesystems on identical disk drives. I created a > number > >> >> of PFS that are mirrored. Over time, the storage allocation on the > >> >> MASTER has remained constant while it continues to grow on the SLAVE > as > >> >> shown in the following: > >> >> > >> >> MASTER 5588G 1456G 4132G 26% /master > >> >> SLAVE 5588G 2775G 2813G 50% /slave > >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > >> >> /master/backups/dns > >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> >> /master/backups/colleen > >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> >> /master/backups/domain0 > >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > >> >> /master/backups/imap > >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> >> > >> >> ... > >> >> > >> >> Am I missing a maintenance step that needs to be performed on the > >> >> slave? > >> > > >> > > >> > By default, the daily periodic script for hammer cleanup only works on > >> > mounted volumes, so that's why your unmounted slaves are not being > >> > cleaned > >> > up. You can tell it to clean up unmounted volumes by adding this line > to > >> > /etc/periodic.conf: > >> > > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > >> > path_to_second_unmounted_pfs etc" > >> > > >> > The unfortunate side effect of this is that will cause it to stop > >> > cleaning > >> > up mounted PFSes, so I created a separate hammer cleanup script in > >> > /etc/periodic/daily that cleans up the mounted ones. > >> > > >> > Tim > >> > > >> > >> -- > >> > >> John R. Shannon > >> john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 07:24:40 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 08:24:40 -0700 Subject: Maintenance of mirrored filesystem Message-ID: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> I setup hammer filesystems on identical disk drives. I created a number of PFS that are mirrored. Over time, the storage allocation on the MASTER has remained constant while it continues to grow on the SLAVE as shown in the following: MASTER 5588G 1456G 4132G 26% /master SLAVE 5588G 2775G 2813G 50% /slave /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns /master/pfs/@@-1:00001 5588G 1456G 4132G 26% /master/backups/colleen /master/pfs/@@-1:00003 5588G 1456G 4132G 26% /master/backups/domain0 /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master ... Am I missing a maintenance step that needs to be performed on the slave? My daily run output shows: HAMMER maintenance: cleanup / - handle PFS#0 using /var/hammer/root snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /build - handle PFS#0 using /var/hammer/build snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master - handle PFS#0 using /var/hammer/master snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /slave - handle PFS#0 using /var/hammer/slave snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip cleanup /master/backups/dns - handle PFS#2 using /var/hammer/master/backups/dns snapshots - run prune - run rebalance - run.. reblock - run.... recopy - skip ... (for each PFS) The mounts all represent the master PFS as the slave PFS are not mounted. -- John R. Shannon john at johnrshannon.com From t+dfbsd at timdarby.net Fri Dec 15 09:49:27 2017 From: t+dfbsd at timdarby.net (Tim Darby) Date: Fri, 15 Dec 2017 10:49:27 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon wrote: > I setup hammer filesystems on identical disk drives. I created a number > of PFS that are mirrored. Over time, the storage allocation on the > MASTER has remained constant while it continues to grow on the SLAVE as > shown in the following: > > MASTER 5588G 1456G 4132G 26% /master > SLAVE 5588G 2775G 2813G 50% /slave > /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns > /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > /master/backups/colleen > /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > /master/backups/domain0 > /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap > /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > > ... > > Am I missing a maintenance step that needs to be performed on the slave? ?By default, the daily periodic script for hammer cleanup only works on mounted volumes, so that's why your unmounted slaves are not being cleaned up. You can tell it to clean up unmounted volumes by adding this line to /etc/periodic.conf: daily_clean_hammer-pfslist="path_to_first_unmounted_pfs path_to_second_unmounted_pfs etc" The unfortunate side effect of this is that will cause it to stop cleaning up mounted PFSes, so I created a separate hammer cleanup script in /etc/periodic/daily that cleans up the mounted ones. Tim? -------------- next part -------------- An HTML attachment was scrubbed... URL: From john at johnrshannon.com Fri Dec 15 10:50:10 2017 From: john at johnrshannon.com (John R. Shannon) Date: Fri, 15 Dec 2017 11:50:10 -0700 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Thank you. That got it. On 12/15/17 10:49, Tim Darby wrote: > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > wrote: > >> I setup hammer filesystems on identical disk drives. I created a number >> of PFS that are mirrored. Over time, the storage allocation on the >> MASTER has remained constant while it continues to grow on the SLAVE as >> shown in the following: >> >> MASTER 5588G 1456G 4132G 26% /master >> SLAVE 5588G 2775G 2813G 50% /slave >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% /master/backups/dns >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> /master/backups/colleen >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> /master/backups/domain0 >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% /master/backups/imap >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> ... >> >> Am I missing a maintenance step that needs to be performed on the slave? > > > ?By default, the daily periodic script for hammer cleanup only works on > mounted volumes, so that's why your unmounted slaves are not being cleaned > up. You can tell it to clean up unmounted volumes by adding this line to > /etc/periodic.conf: > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > path_to_second_unmounted_pfs etc" > > The unfortunate side effect of this is that will cause it to stop cleaning > up mounted PFSes, so I created a separate hammer cleanup script in > /etc/periodic/daily that cleans up the mounted ones. > > Tim? > -- John R. Shannon john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:24:51 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:24:51 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Also turning on dedup can save space On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: > Thank you. That got it. > > On 12/15/17 10:49, Tim Darby wrote: > > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon > > wrote: > > > >> I setup hammer filesystems on identical disk drives. I created a number > >> of PFS that are mirrored. Over time, the storage allocation on the > >> MASTER has remained constant while it continues to grow on the SLAVE as > >> shown in the following: > >> > >> MASTER 5588G 1456G 4132G 26% /master > >> SLAVE 5588G 2775G 2813G 50% /slave > >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > /master/backups/dns > >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> /master/backups/colleen > >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> /master/backups/domain0 > >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > /master/backups/imap > >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> > >> ... > >> > >> Am I missing a maintenance step that needs to be performed on the slave? > > > > > > ?By default, the daily periodic script for hammer cleanup only works on > > mounted volumes, so that's why your unmounted slaves are not being > cleaned > > up. You can tell it to clean up unmounted volumes by adding this line to > > /etc/periodic.conf: > > > > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > > path_to_second_unmounted_pfs etc" > > > > The unfortunate side effect of this is that will cause it to stop > cleaning > > up mounted PFSes, so I created a separate hammer cleanup script in > > /etc/periodic/daily that cleans up the mounted ones. > > > > Tim? > > > > -- > > John R. Shannon > john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kusumi.tomohiro at gmail.com Fri Dec 15 11:32:59 2017 From: kusumi.tomohiro at gmail.com (Tomohiro Kusumi) Date: Fri, 15 Dec 2017 21:32:59 +0200 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: Note that using live dedup on H1 is not recommended (by Matt). I don't think anyone is really using it too. 2017-12-15 21:24 GMT+02:00 Zachary Crownover : > Also turning on dedup can save space > > On Dec 15, 2017 10:50 AM, "John R. Shannon" wrote: >> >> Thank you. That got it. >> >> On 12/15/17 10:49, Tim Darby wrote: >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon >> > wrote: >> > >> >> I setup hammer filesystems on identical disk drives. I created a number >> >> of PFS that are mirrored. Over time, the storage allocation on the >> >> MASTER has remained constant while it continues to grow on the SLAVE as >> >> shown in the following: >> >> >> >> MASTER 5588G 1456G 4132G 26% /master >> >> SLAVE 5588G 2775G 2813G 50% /slave >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% >> >> /master/backups/dns >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% >> >> /master/backups/colleen >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% >> >> /master/backups/domain0 >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% >> >> /master/backups/imap >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master >> >> >> >> ... >> >> >> >> Am I missing a maintenance step that needs to be performed on the >> >> slave? >> > >> > >> > By default, the daily periodic script for hammer cleanup only works on >> > mounted volumes, so that's why your unmounted slaves are not being >> > cleaned >> > up. You can tell it to clean up unmounted volumes by adding this line to >> > /etc/periodic.conf: >> > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs >> > path_to_second_unmounted_pfs etc" >> > >> > The unfortunate side effect of this is that will cause it to stop >> > cleaning >> > up mounted PFSes, so I created a separate hammer cleanup script in >> > /etc/periodic/daily that cleans up the mounted ones. >> > >> > Tim >> > >> >> -- >> >> John R. Shannon >> john at johnrshannon.com From zachary.crownover at gmail.com Fri Dec 15 11:36:08 2017 From: zachary.crownover at gmail.com (Zachary Crownover) Date: Fri, 15 Dec 2017 11:36:08 -0800 Subject: Maintenance of mirrored filesystem In-Reply-To: References: <5ee26108-aa8e-5161-fccc-aa1da4893fba@johnrshannon.com> Message-ID: if live dedup is uncommenting the section in the hammer config on each PFS, I've been doing it for years on every system. On Dec 15, 2017 11:33 AM, "Tomohiro Kusumi" wrote: > Note that using live dedup on H1 is not recommended (by Matt). > I don't think anyone is really using it too. > > 2017-12-15 21:24 GMT+02:00 Zachary Crownover >: > > Also turning on dedup can save space > > > > On Dec 15, 2017 10:50 AM, "John R. Shannon" > wrote: > >> > >> Thank you. That got it. > >> > >> On 12/15/17 10:49, Tim Darby wrote: > >> > On Fri, Dec 15, 2017 at 8:24 AM, John R. Shannon < > john at johnrshannon.com> > >> > wrote: > >> > > >> >> I setup hammer filesystems on identical disk drives. I created a > number > >> >> of PFS that are mirrored. Over time, the storage allocation on the > >> >> MASTER has remained constant while it continues to grow on the SLAVE > as > >> >> shown in the following: > >> >> > >> >> MASTER 5588G 1456G 4132G 26% /master > >> >> SLAVE 5588G 2775G 2813G 50% /slave > >> >> /master/pfs/@@-1:00002 5588G 1456G 4132G 26% > >> >> /master/backups/dns > >> >> /master/pfs/@@-1:00001 5588G 1456G 4132G 26% > >> >> /master/backups/colleen > >> >> /master/pfs/@@-1:00003 5588G 1456G 4132G 26% > >> >> /master/backups/domain0 > >> >> /master/pfs/@@-1:00004 5588G 1456G 4132G 26% > >> >> /master/backups/imap > >> >> /master/pfs/@@-1:00005 5588G 1456G 4132G 26% /master > >> >> > >> >> ... > >> >> > >> >> Am I missing a maintenance step that needs to be performed on the > >> >> slave? > >> > > >> > > >> > By default, the daily periodic script for hammer cleanup only works on > >> > mounted volumes, so that's why your unmounted slaves are not being > >> > cleaned > >> > up. You can tell it to clean up unmounted volumes by adding this line > to > >> > /etc/periodic.conf: > >> > > >> > daily_clean_hammer-pfslist="path_to_first_unmounted_pfs > >> > path_to_second_unmounted_pfs etc" > >> > > >> > The unfortunate side effect of this is that will cause it to stop > >> > cleaning > >> > up mounted PFSes, so I created a separate hammer cleanup script in > >> > /etc/periodic/daily that cleans up the mounted ones. > >> > > >> > Tim > >> > > >> > >> -- > >> > >> John R. Shannon > >> john at johnrshannon.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: