Unable to recover hammer FS.

jscottkasten at yahoo.com jscottkasten at yahoo.com
Sun Jan 15 04:53:00 PST 2017


Hi guys,
First off, many kudos, been a DragonFly user for 4 months and absolutely love what you guys have done.
I have a 2TB USB Drive that I setup with GPT and a dm-crypt slice which was then formatted with hammer.  Spent nearly a week mirroring various things to the drive, then at some point the laptop just completely locked up and I had to do a forced power off.
When I brought everything back up, I found that there are a few folders on the hammer FS that are corrupted (CRC errors).  Unfortunately, I'm not able to recover from this situation back to a usable state for the drive.  I cannot delete these corrupted folders.  Anytime the corrupted Inodes are seen, the hammer FS driver remounts the drive as Read Only.
I've searched in vein to find out how I'm supposed to remove the corrupted data.  There's about 1.5TB of good data, and about 100MB of "questionable" data (and I know which folders are affected).  Would like bring the file system back into a consistent state so I can move forward.  Surely there is some tool that does that, but for the life of me I'm not finding it through the documentation.
Any help would be appreciated.
Here's some kernel logs if that's of any interest:
umass0: detachedugen0.7: <Seagate> at usbus0umass0: <Seagate BUP Slim BK, class 0/0, rev 3.00/1.08, addr 10> on usbus0da8 at umass-sim0 bus 0 target 0 lun 0da8: <Seagate BUP Slim BK 0108> Fixed Direct Access SCSI-6 device da8: Serial Number NA96Z8KMda8: 400.000MB/s transfersda8: 1907729MB (3907029167 512 byte sectors: 255H 63S/T 243201C)dm_target_crypt: Setting min/max mpipe buffers: 2/39dm_target_crypt: Setting min/max mpipe buffers: 2/39HAMMER(BACKUP-DRIVE-2TB) recovery check seqno=01eca6fdHAMMER(BACKUP-DRIVE-2TB) recovery range 3000000032dfc660-300000003304dcf8HAMMER(BACKUP-DRIVE-2TB) recovery nexto 3000000032f39cd0 endseqno=01ecbb3eHAMMER(BACKUP-DRIVE-2TB) recovery undo  3000000032dfc660-300000003304dcf8 (2430616 bytes)(RW)HAMMER(BACKUP-DRIVE-2TB) recovery completehammer_btree_extract: CRC DATA @ 9000000a4a1f3280/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3280/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3000/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3000/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3080/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3080/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3200/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3200/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3180/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3180/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2f80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2f80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3100/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3100/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2e80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2e80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2f00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2f00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3680/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3680/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f38a0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f38a0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3920/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3920/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2400/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2400/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2880/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2880/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2680/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2680/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2580/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2580/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2780/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2780/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2800/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2800/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2700/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2700/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2480/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2480/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2500/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2500/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2900/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2900/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2600/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2600/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1b80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1b80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2180/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2180/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2200/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2200/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2100/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2100/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1f80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1f80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2000/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2000/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1b00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1b00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2080/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2080/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1e80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1e80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1c80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1c80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1e00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1e00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2280/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2280/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1d00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1d00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2300/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2300/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1c00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1c00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1a80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1a80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1d80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1d80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1f00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f1f00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3dc0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3dc0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3e40/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3e40/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3ec0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3ec0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3f40/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3f40/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2b80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2b80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2980/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2980/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2a80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2a80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2a00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2a00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2b00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2b00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2c00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2c00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2c80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f2c80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3380/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3380/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3300/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3300/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3480/34 FAILEDhammer_load_node: CRC B-TREE NODE @ 8000010434e5f000/4096 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f35e0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f35e0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3560/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3560/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3760/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3760/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3820/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3820/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3a00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3a00/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3ac0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3ac0/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3b80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3b80/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3c40/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3c40/128 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f3700/22 FAILEDhammer_btree_extract: CRC DATA @ 9000000a4a1f39a0/22 FAILEDhammer_load_node: CRC B-TREE NODE @ 8000010434e5e000/4096 FAILEDhammer_load_node: CRC B-TREE NODE @ 8000010434e5d000/4096 FAILEDHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927081 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Forcing read-only modeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927093 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927094 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927096 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927097 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927102 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927103 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927114 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927115 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927123 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927081 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927093 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927094 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927096 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927097 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927102 error=5 while syncing inodeHAMMER(BACKUP-DRIVE-2TB) Critical error inode=4563927103 error=5 while syncing inode
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.dragonflybsd.org/pipermail/hammer/attachments/20170115/c7e898b1/attachment.htm>


More information about the Hammer mailing list