[DragonFlyBSD - Bug #3131] master on Ryzen 5 2400G: java freezes system -- smp_invltlb 2: waited too long

[bugtracker-admin at leaf.dragonflybsd.org]

Issue #3131 has been updated by dillon.


Ok, lets leave the bug report open.  I can reproduce it trivially and it really looks like a hyperthread issue with Zen gen-1.  So far I can't reproduce it at all in Zen+ (2700X), only in the 2400G (which even though it has a '2', is actually gen-1 and not Zen+ from what I understand).

The temporary workaround is to run all the cpus flat out by disabling HLT in the scheduler, via sysctl machdep.cpu_idle_hlt=0.  Note that this will cause the system to run how, as I mentioned before.  But java won't lockup either.

I've forward the bug to AMD along with all the information I've been able to gather.  No guarantees of a fast response, though.  I'm continuing to mess with it myself to try to make sure it isn't a DragonFlyBSD bug.

FreeBSD's java binary has different run-time characteristics than ours.  I couldn't lock it up on the 2400G in FreeBSD, but that doesn't really mean anything.  From close examination of the state of the locked up CPUs (using a non locked-up core to probe the locked up core), insofar as I can tell it isn't a DragonFlyBSD bug.  But I'll keep it in my thoughts.

-Matt

----------------------------------------
Bug #3131: master on Ryzen 5 2400G: java freezes system -- smp_invltlb 2: waited too long
http://bugs.dragonflybsd.org/issues/3131#change-13425

* Author: peeter
* Status: New
* Priority: Immediate
* Assignee: dillon
* Category: 
* Target version: 
----------------------------------------
The Ryzen 2400G has been an amazing desktop machine. Fast with NVME SSD drive and rock solid with an uptime of 28 days until I hit this: tried to compile a java program and the machine froze. It turns out that trying to start java VM leads to a loop and the machine becomes unresponsive.

Intel does not seem affected, java runs fine on an Intel Skylake i7 machine.

On Ryzen 2400G, it is 100% reproducible. Try compiling HelloWorld.java (javac HelloWorld.java) or just invoke

% java -version

and the machine becomes unresponsive with this in /var/log/messages:

---
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000059/00000000
smp_invltlb 7: waited too long inv=00000003 smurf=00000003 in=00000004 idle=00000059/00000000
smp_invltlb 2: waited too long inv=00000003 smurf=00000003 in=00000080 idle=00000059/00000000
smp_invltlb: giving up
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=00000003 in=00000004 idle=000000d9/00000000
pminvl 2->2 00000007 00000007 mode=1
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=000000c3 in=00000004 idle=000000d9/00000000
pminvl 2->2 00000007 00000007 mode=1
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=00000003 in=00000004 idle=000000d9/00000000
pminvl 2->2 00000007 00000007 mode=1
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=00000003 in=00000004 idle=000000d9/00000000
pminvl 2->2 00000007 00000007 mode=1
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=00000003 in=00000004 idle=000000d9/00000000
pminvl 2->2 00000007 00000007 mode=1
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=00000003 in=00000004 idle=000000d9/00000000
pminvl 2->2 00000007 00000007 mode=1
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=00000003 in=00000004 idle=000000d9/00000000
pminvl 2->2 00000007 00000007 mode=1
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=000000d5/00000000
smp_invltlb: giving up
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb: giving up
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb: giving up
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb: giving up
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb: giving up
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb 3: waited too long inv=00000003 smurf=00000003 in=00000000 idle=00000095/00000000
smp_invltlb: giving up
---


Or another instance: 

---
smp_inval_intr 2 inv=00000004 tlbm=00000000 smurf=000000c0 in=00000004 idle=0000007a/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 2 inv=00000004 tlbm=000000c0 smurf=000000c0 in=00000024 idle=0000005b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000004 idle=0000005b/00000000
smp_inval_intr 2 inv=00000004 tlbm=000000c0 smurf=000000c0 in=00000024 idle=0000005b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000004 idle=0000005b/00000000
smp_inval_intr 2 inv=00000004 tlbm=000000c0 smurf=000000c0 in=00000024 idle=0000005b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000004 idle=0000005b/00000000
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_inval_intr 4 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000014 idle=0000004a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_inval_intr 4 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_inval_intr 4 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000014 idle=0000004a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_inval_intr 4 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_inval_intr 4 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000014 idle=0000004a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_inval_intr 4 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_inval_intr 4 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000014 idle=0000004a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=000000c0 smurf=000000c0 in=00000034 idle=0000004b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_invltlb 5: waited too long inv=000000c0 smurf=000000c0 in=00000014 idle=0000004b/00000000
smp_invltlb: giving up
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006a/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
smp_inval_intr 4 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 4->4 000000d0 000000d0 mode=1
smp_inval_intr 2 inv=00000014 tlbm=00000000 smurf=000000c0 in=00000014 idle=0000006b/00000000
pminvl 2->2 000000c4 000000c4 mode=1
---




-- 
You have received this notification because you have either subscribed to it, or are involved in it.
To change your notification preferences, please click here: http://bugs.dragonflybsd.org/my/account