CRC failures
PeerCorps Trust Fund
ipc at peercorpstrust.org
Wed Nov 23 08:17:32 PST 2016
Very insightful clarifications.
Thanks T. Kusumi and M. Dillon.
On 11/23/2016 05:43 PM, Matthew Dillon wrote:
> I split issues into two categories - corrupted media and software bugs.
> CRC failures are generally related to corrupted media and ideally we would
> not want those to cause panics. Software bugs we want to cause panics as
> quickly as possible so we can track down and fix them. What HAMMER1 is
> missing here is a recovery mechanism to delete the corruption to allow the
> filesystem to continue to be used.
>
> Media corruption appears to most often be associated with system panics and
> unexpected power loss. System panics are not supposed to cause filesystem
> corruption at all and I'm still scratching my head and why it happens
> sometimes (it would be a good area to work on with HAMMER1). Unexpected
> power loss can cause media corruption no matter what the filesystem does.
> Owing to how hard drives work these days, sectors completely unrelated to
> the sectors being written at the time of the power failure can become
> corrupt. Most consumer SSDs can also have similar failure modes when an
> unexpected power loss occurs.
>
> -Matt
>
> On Wed, Nov 23, 2016 at 6:05 AM, Tomohiro Kusumi <kusumi.tomohiro at gmail.com>
> wrote:
>
>> CRC failure stuff in hammer1 is basically a mismatch between ondisk
>> CRC vs whatever data's CRC when that data is read from a disk, so it's
>> likely that either was corrupted.
>>
>> Many of the CRC failures end up calling panic() which leads to kernel
>> panic (but not this one). There was a discussion on irc a few weeks
>> ago about how fs should handle CRC failure, because some users would
>> rather prefer to leave the fs as it is without going into panic so the
>> fs is at least usable at the moment with broken data or meta data.
>>
>> (I wouldn't go far as to make any change with regards to consequence
>> of CRC failure. It's a design level stuff which should be up to
>> dillon at .)
>>
>>
>> 2016-11-23 17:43 GMT+09:00 PeerCorps Trust Fund <ipc at peercorpstrust.org>:
>>> Hi all,
>>>
>>> I don't think I have seen anywhere else in past mailing lists an example
>> of
>>> corruption on a HAMMER filesystem. But I loaded an old disk today with
>> some
>>> nonessential files and began copying them off to another machine. Towards
>>> the end of the copy operation the console printed out the the below.
>>>
>>> Perhaps this may be useful information to someone who someday finds
>>> something similar in their console.
>>>
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390269000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026a000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026e000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026d000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390268000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026b000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026f000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e39026c000/4096 FAILED
>>> hammer_load_node: CRC B-TREE NODE @ 800000e390267000/4096 FAILED
>>>
>>> --
>>> Michael
>>>
>>
>
More information about the Users
mailing list