[issue2053] panic: assertion: sb->sb_mb == NULL in sbunlinkmbuf

Francois Tigeot (via DragonFly issue tracker) sinknull at leaf.dragonflybsd.org
Sat Apr 23 02:43:47 PDT 2011


New submission from Francois Tigeot <ftigeot at wolfpond.org>:

This crash occured on a gateway running ppp, pf and sendmail.

Kernel and core dump files are available here:
http://dl.wolfpond.org/crash.assertion_sbunlinkmbuf/

----------
files: core.5.txt
keyword: kernel
messages: 9837
nosy: ftigeot
priority: bug
status: unread
title: panic: assertion: sb->sb_mb == NULL in sbunlinkmbuf

_____________________________________________________
DragonFly issue tracker <bugs at lists.dragonflybsd.org>
<http://bugs.dragonflybsd.org/issue2053>
_____________________________________________________pizza.zefyris.com dumped core - see /var/crash/vmcore.5

Sat Apr 23 10:59:49 CEST 2011

Version String: DragonFly v2.10.0.3.g216c0-RELEASE #0: Wed Apr 20 11:01:37 CEST 2011 ftigeot at pizza.zefyris.com:/usr/obj/usr/src/sys/GENERIC_SMP

panic: assertion: sb->sb_mb == NULL in sbunlinkmbuf

GNU gdb (GDB) 7.0
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "i386-dragonfly".
For bug reporting instructions, please see:
<http://bugs.dragonflybsd.org/>...
Reading symbols from /boot/kernel/kernel...done.

Unread portion of the kernel message buffer:
panic: assertion: sb->sb_mb == NULL in sbunlinkmbuf
cpuid = 1
Trace beginning at frame 0xd9cccb50
panic(ffffffff,1,c067243b,d9cccb84,d6a257d8) at panic+0x19d
panic(c067243b,c06917d5,c0652b97,c4913600,c4a02c00) at panic+0x19d
sbunlinkmbuf(c491364c,c4a02c00,d9cccbec,1,c4913670) at sbunlinkmbuf+0xb9
soreceive(c4913600,d9cccc7c,d9cccc88,0,0) at soreceive+0x63c
kern_recvmsg(1,d9cccc7c,d9cccc88,0,d9cccd0c) at kern_recvmsg+0x13c
sys_recvfrom(d9ccccf0,d9cccd00,18,ff809a6c,ff809000) at sys_recvfrom+0xd1
syscall2(d9cccd40) at syscall2+0x26f
Xint0x80_syscall() at Xint0x80_syscall+0x36
Debugger("panic")

CPU1 stopping CPUs: 0x00000001
 stopped
Physical memory: 2037 MB
Dumping 217 MB: 202 186 170 154 138 122 106 90 74 58 42 26 10

Reading symbols from /boot/kernel/acpi.ko...done.
Loaded symbols for /boot/kernel/acpi.ko
Reading symbols from /boot/kernel/ahci.ko...done.
Loaded symbols for /boot/kernel/ahci.ko
Reading symbols from /boot/kernel/ehci.ko...done.
Loaded symbols for /boot/kernel/ehci.ko
Reading symbols from /boot/kernel/netgraph.ko...done.
Loaded symbols for /boot/kernel/netgraph.ko
Reading symbols from /boot/kernel/ng_ksocket.ko...done.
Loaded symbols for /boot/kernel/ng_ksocket.ko
Reading symbols from /boot/kernel/ng_ether.ko...done.
Loaded symbols for /boot/kernel/ng_ether.ko
Reading symbols from /boot/kernel/ng_pppoe.ko...done.
Loaded symbols for /boot/kernel/ng_pppoe.ko
Reading symbols from /boot/kernel/ng_socket.ko...done.
Loaded symbols for /boot/kernel/ng_socket.ko
Reading symbols from /boot/kernel/pf.ko...done.
Loaded symbols for /boot/kernel/pf.ko
_get_mycpu (di=0xc07d7f80) at ./machine/thread.h:79
79	    __asm ("movl %%fs:globaldata,%0" : "=r" (gd) : "m"(__mycpu__dummy));
(kgdb) #0  _get_mycpu (di=0xc07d7f80) at ./machine/thread.h:79
#1  md_dumpsys (di=0xc07d7f80)
    at /usr/src/sys/platform/pc32/i386/dump_machdep.c:264
#2  0xc0369288 in dumpsys () at /usr/src/sys/kern/kern_shutdown.c:893
#3  0xc018794a in db_fncall (dummy1=-1067473886, dummy2=0, dummy3=-1072135887, 
    dummy4=0xd9ccc9e4 "\224g_\300oXg\300") at /usr/src/sys/ddb/db_command.c:542
#4  0xc0187e2f in db_command () at /usr/src/sys/ddb/db_command.c:344
#5  db_command_loop () at /usr/src/sys/ddb/db_command.c:470
#6  0xc018a8ae in db_trap (type=3, code=0) at /usr/src/sys/ddb/db_trap.c:71
#7  0xc05fa789 in kdb_trap (type=3, code=0, regs=0xd9cccb00)
    at /usr/src/sys/platform/pc32/i386/db_interface.c:152
#8  0xc062403b in trap (frame=0xd9cccb00)
    at /usr/src/sys/platform/pc32/i386/trap.c:830
#9  0xc05fbc57 in calltrap ()
    at /usr/src/sys/platform/pc32/i386/exception.s:787
#10 0xc05fa422 in breakpoint (msg=0xc068eb22 "panic") at ./cpu/cpufunc.h:73
#11 Debugger (msg=0xc068eb22 "panic")
    at /usr/src/sys/platform/pc32/i386/db_interface.c:334
#12 0xc0369adb in panic (fmt=0xc067243b "assertion: %s in %s")
    at /usr/src/sys/kern/kern_shutdown.c:790
#13 0xc03aa9f5 in sbunlinkmbuf (sb=0xc06a4c89, m=0x0, free_chain=0xd9cccbec)
    at /usr/src/sys/kern/uipc_sockbuf.c:552
#14 0xc03ae2ba in soreceive (so=0xc4913600, psa=0xd9cccc7c, uio=0xd9cccc88, 
    sio=0x0, controlp=0x0, flagsp=0xd9cccd0c)
    at /usr/src/sys/kern/uipc_socket.c:1096
#15 0xc03b04c0 in so_pru_soreceive (s=1, sa=0xd9cccc7c, auio=0xd9cccc88, 
    control=0x0, flags=0xd9cccd0c, res=0xd9ccccf0)
    at /usr/src/sys/sys/socketops.h:73
#16 kern_recvmsg (s=1, sa=0xd9cccc7c, auio=0xd9cccc88, control=0x0, 
    flags=0xd9cccd0c, res=0xd9ccccf0) at /usr/src/sys/kern/uipc_syscalls.c:857
#17 0xc03b08f9 in sys_recvfrom (uap=0xd9ccccf0)
    at /usr/src/sys/kern/uipc_syscalls.c:913
#18 0xc06245fc in syscall2 (frame=0xd9cccd40)
    at /usr/src/sys/platform/pc32/i386/trap.c:1323
#19 0xc05fbd06 in Xint0x80_syscall ()
    at /usr/src/sys/platform/pc32/i386/exception.s:878
#20 0x0000001f in ?? ()
Backtrace stopped: previous frame inner to this frame (corrupt stack?)
(kgdb) (kgdb) 
Token           flags      collisions owner      stallpc
pmap_token      0x00000000          0 not held
dev_token       0x00000000          0 not held
vm_token        0x00000000     340635 0xc07a2894 0x00000000
vmspace_token   0x00000000       3548 not held
kvm_token       0x00000000          0 not held
proc_token      0x00000000         15 not held
tty_token       0x00000000        139 not held
vnode_token     0x00000000          0 not held
vmobj_token     0x00000000       3728 not held
(kgdb) 
cpu  pid    thread    flags comm               wchan    wmesg
  0    -1 ff800528 00000004 idle_0             00000000
  0     0 c079db80 00020080 swapper            c083e580 nowork
  0    -1 c07e7234 00010402 softclock 0        00000000
  0    -1 c07d5e80 00010400 ithread emerg      00000000
  0    -1 c07c8fe4 00010400 ithread 196        00000000
  0    -1 c07db904 00000400 dsched 0           00000000
  0    -1 c07d8420 00000400 usched 0           00000000
  0    -1 d6a3cad8 00040600 devfs_msg_core     00000000 waitport
  0    -1 c0802760 00040402 netisr_cpu 0       00000000 waitport
  0    -1 d6a3ce58 00040600 disk_msg_core      00000000 waitport
  0    -1 c07fd040 00040400 ifnet 0            00000000 waitport
  0    -1 d6a3d1d8 00020680 taskq_cpu 0        c4762ea0 tqthr
  0    -1 d6a3d8d8 00020680 firmware taskq     c4762f00 tqthr
  0    -1 d6a3dc58 04020e80 crypto 0           c086e160 crypto_wait
  0    -1 d6a3e358 00020e80 crypto returns     c086e4e0 crypto_ret_wait
  0    -1 c07c9354 00010400 ithread 197        00000000
  0    -1 d6a3e6d8 00020e80 xpt_thrd           c077b794 ccb_scanq
  0    -1 c07c8c74 00010400 ithread 195        00000000
  0    -1 d6a3ea58 00040e00 acpi_task          00000000 waitport
  0    -1 c07a0d14 00010400 ithread 9          00000000
  0    -1 c07a2524 00010402 ithread 16         00000000 mp_token
  0    -1 c07a2894 00010403 ithread 17         00000000
  0    -1 c07a32e4 00010400 ithread 20         00000000
  0    -1 c07a1e44 00010400 ithread 14         00000000
  0    -1 c07a21b4 00010400 ithread 15         00000000
  0    -1 c07a3654 00010400 ithread 21         00000000
  0    -1 d6a3edd8 00020e80 usb0               d6c06a60 usbevt
  0    -1 d6a3f158 00020e80 usbtask-hc         c086ab40 usbtsk
  0    -1 d6a3f4d8 00020e80 usbtask-dr         c086ab54 usbtsk
  0    -1 d6a3f858 00020e80 usb1               d6c07760 usbevt
  0    -1 d6a3fbd8 00020e80 usb2               d6c08460 usbevt
  0    -1 d6a20058 00020e80 usb3               d6c09160 usbevt
  0    -1 d6a203d8 00020e80 usb4               d6c82060 usbevt
  0    -1 d6a20758 00020e80 acpi_thermal       c09ea978 tzpoll
  0    -1 d6a20ad8 00020e80 acpi_cooling0      c49b8a84 cooling
  0    -1 c07c8224 00010400 ithread 192        00000000
  0    -1 c079fbe4 00010400 ithread 4          00000000
  0    -1 c079f194 00010400 ithread 1          00000000
  0    -1 c07a1764 00010400 ithread 12         00000000
  0    -1 d6a20e58 00020e80 sensors            c0748d40 timeout
  0    -1 d6a211d8 00020680 random             d6a211d8 rwait
  0    -1 d6a21558 00040600 rtable_cpu 0       00000000 waitport
  0    -1 d6a21c58 00020680 hammer-M           d72500fc hmrwwa
  0    -1 d6a21fd8 00020680 hammer-S0          d4e98eb8 hmrssw
  0    -1 d6a22358 00020680 hammer-S1          d4e990f8 hmrssw
  0    -1 d6a226d8 00020680 hammer-S2          d4e99338 hmrssw
  0    -1 d6a22a58 00020680 hammer-S3          d4e99578 hmrssw
  0    -1 d6a22dd8 00020f80 pagedaemon         c086a88c psleep
  0    -1 d6a23158 00020f80 swapcached         c086a900 csleep
  0    -1 d6a234d8 00020e80 vmdaemon           c086a8dc psleep
  0    -1 d6a23bd8 00020f80 bufdaemon_hw       c07eb7c8 psleep
  0    -1 d6a23f58 00020f80 bufdaemon          c07eb7c4 psleep
  0    -1 d6a242d8 00020e80 vnlru              d6a242d8 vlruwt
  0    -1 d6a24658 00020e80 syncer             c07e4130 syncer
  0    -1 d6a249d8 00020f80 consttyd           d6a249d8 waiting
  0   771 d9c3ce58 00820680 sendmail           d9c1b850 pause
  0   786 d9c3d1d8 00820680 cron               c07e71fc nanslp
  0   902 d9c3edd8 00820680 getty              d9b174f0 ttyin
  0   896 d9c3c058 00820680 getty              c4920e10 ttyin
  0   897 d9c3c3d8 00820680 getty              d9b16f50 ttyin
  0   899 d9c3f158 00820680 getty              d9b17190 ttyin
  0   900 d9c3d558 00820680 getty              d9b172b0 ttyin
  0   898 d6a25ed8 00820680 getty              d9b17070 ttyin
  0  1487 d6a2a858 00020680 screen-4.0.3       d9c06e50 pause
  0   820 d6a27058 00820680 perl               d9e8c974 kqread
  0   435 d6a24d58 00820680 syslogd            d9aa21f4 kqread
  0   833 d9c3dfd8 00820680 named              48f1f11c umtxsl
  0   812 d6a265d8 00020680 milter-greylist    d9e84634 kqread
  0   833 d9c3e358 00820680 named              48f1f11c umtxsl
  1    -1 ff809528 00000000 idle_1             00000000
  1    -1 c07e758c 00010400 softclock 1        00000000
  1    -1 c07dbc50 00000400 dsched 1           00000000
  1    -1 c07d876c 00000400 usched 1           00000000
  1    -1 c0802aa4 00040400 netisr_cpu 1       00000000 waitport
  1    -1 c07fd384 00040400 ifnet 1            00000000 waitport
  1    -1 d6a3d558 00020680 taskq_cpu 1        c4762ed0 tqthr
  1    -1 d6a3dfd8 04020e80 crypto 1           c086e198 crypto_wait
  1    -1 d6a218d8 00040600 rtable_cpu 1       00000000 waitport
  1     1 d6a3c758 00020680 init               d69e0a60 wait
  1    -1 d6a23858 00020e80 pagezero           c086ab04 pgzero
  1    -1 d6a250d8 00020e80 pfpurge            da11d25f pftm
  1   755 d9c3c758 00820680 sshd               d9aa44f4 kqread
  1   812 d6a26cd8 00020680 milter-greylist    d69e5084 sigwt
  1   833 d9c3d8d8 00820680 named              d9af0e84 sigwt
  1   883 d6a273d8 00020680 inetd              d9aad0f4 kqread
  1   901 d6a27758 00820680 getty              d9b173d0 ttyin
  1   903 d9c3f4d8 00820680 getty              d9b17610 ttyin
  1   802 d9c3dc58 00820680 dhcpd              d9aa75b4 kqread
  1   812 d6a26958 00020680 milter-greylist    4491f114 umtxsl
  1  1474 d6a27ad8 00820680 sshd               c491974c sbwait
  1  1477 d6a29a58 00820680 zsh                d6a1d950 pause
  1  1489 d9c203d8 00820680 zsh                d9c0bb50 pause
  1   767 d6a25458 00820680 sendmail           d9aa5534 kqread
  1  1476 d6a281d8 00820680 sshd               d9e939f4 kqread
  1  1488 d6a28fd8 00020680 screen-4.0.3       da6e0674 kqread
  1   700 d9c3cad8 00020680 rtadvd             d9aa3734 kqread
  1   812 d6a26258 00820680 milter-greylist    443dd104 umtxsl
  1  1492 d6a288d8 00020680 tail               c472c6f8 kqread
  1   833 d9c3e6d8 00020680 named              48f1f0ec umtxsl
  1   833 d9c3ea58 00020680 named              d9aab1b4 kqread
  1   291 d6a257d8 00800603 ppp                00000000
  1   638 d6a25b58 00820680 dntpd              c07e71fc nanslp
(kgdb) 
cpu    curthread    wchan
0    ithread 17    00000000
1           ppp    00000000
(kgdb) 
Filesystem      Refs    Flags
tmpfs           1       0x00000000
mfs             0       0x00000000
null            2       0x00100000
msdos           0       0x00000000
cd9660          0       0x00040000
procfs          0       0x00080000
devfs           2       0x00080000
ufs             1       0x00000000
hammer          1       0x00000000
nfs             0       0x00020000
(kgdb) Filesystem: tmpfs, Refs: 1, Flags: 0x00000000
VFS ops: 
$1 = {
  vfs_mount = 0xc05591e7 <tmpfs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc0558d98 <tmpfs_unmount>, 
  vfs_root = 0xc0558c19 <tmpfs_root>, 
  vfs_quotactl = 0xc03c3b7a <vfs_stdquotactl>, 
  vfs_statfs = 0xc0559161 <tmpfs_statfs>, 
  vfs_sync = 0xc03c3b84 <vfs_stdsync>, 
  vfs_vget = 0xc03c3b98 <vfs_stdvget>, 
  vfs_fhtovp = 0xc055906f <tmpfs_fhtovp>, 
  vfs_checkexp = 0xc03c3bac <vfs_stdcheckexp>, 
  vfs_vptofh = 0xc03c3b66 <vfs_stdvptofh>, 
  vfs_init = 0xc03c3bb6 <vfs_stdinit>, 
  vfs_uninit = 0xc03c3bc0 <vfs_stduninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: mfs, Refs: 0, Flags: 0x00000000
VFS ops: 
$2 = {
  vfs_mount = 0xc0515af4 <mfs_mount>, 
  vfs_start = 0xc051582f <mfs_start>, 
  vfs_unmount = 0xc051362b <ffs_unmount>, 
  vfs_root = 0xc0519881 <ufs_root>, 
  vfs_quotactl = 0xc0519830 <ufs_quotactl>, 
  vfs_statfs = 0xc051553e <mfs_statfs>, 
  vfs_sync = 0xc0513420 <ffs_sync>, 
  vfs_vget = 0xc051308b <ffs_vget>, 
  vfs_fhtovp = 0xc0513010 <ffs_fhtovp>, 
  vfs_checkexp = 0xc051983a <ufs_check_export>, 
  vfs_vptofh = 0xc0512aec <ffs_vptofh>, 
  vfs_init = 0xc0515534 <mfs_init>, 
  vfs_uninit = 0xc03c3bc0 <vfs_stduninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: null, Refs: 2, Flags: 0x00100000
VFS ops: 
$3 = {
  vfs_mount = 0xc03de34d <nullfs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc03de2d0 <nullfs_unmount>, 
  vfs_root = 0xc03de29e <nullfs_root>, 
  vfs_quotactl = 0xc03de267 <nullfs_quotactl>, 
  vfs_statfs = 0xc03de173 <nullfs_statfs>, 
  vfs_sync = 0xc03c3b84 <vfs_stdsync>, 
  vfs_vget = 0xc03c3b98 <vfs_stdvget>, 
  vfs_fhtovp = 0xc03de143 <nullfs_fhtovp>, 
  vfs_checkexp = 0xc03de0fc <nullfs_checkexp>, 
  vfs_vptofh = 0xc03de0e2 <nullfs_vptofh>, 
  vfs_init = 0xc03c3bb6 <vfs_stdinit>, 
  vfs_uninit = 0xc03c3bc0 <vfs_stduninit>, 
  vfs_extattrctl = 0xc03de0a4 <nullfs_extattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: msdos, Refs: 0, Flags: 0x00000000
VFS ops: 
$4 = {
  vfs_mount = 0xc03e7208 <msdosfs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc03e70dd <msdosfs_unmount>, 
  vfs_root = 0xc03e6ece <msdosfs_root>, 
  vfs_quotactl = 0xc03c3b7a <vfs_stdquotactl>, 
  vfs_statfs = 0xc03e7041 <msdosfs_statfs>, 
  vfs_sync = 0xc03e6f70 <msdosfs_sync>, 
  vfs_vget = 0xc03c3b98 <vfs_stdvget>, 
  vfs_fhtovp = 0xc03e6e81 <msdosfs_fhtovp>, 
  vfs_checkexp = 0xc03e6e37 <msdosfs_checkexp>, 
  vfs_vptofh = 0xc03e6e10 <msdosfs_vptofh>, 
  vfs_init = 0xc03e40c4 <msdosfs_init>, 
  vfs_uninit = 0xc03e3260 <msdosfs_uninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: cd9660, Refs: 0, Flags: 0x00040000
VFS ops: 
$5 = {
  vfs_mount = 0xc0339b26 <cd9660_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc0339146 <cd9660_unmount>, 
  vfs_root = 0xc033a51a <cd9660_root>, 
  vfs_quotactl = 0xc03c3b7a <vfs_stdquotactl>, 
  vfs_statfs = 0xc03390ce <cd9660_statfs>, 
  vfs_sync = 0xc03c3b84 <vfs_stdsync>, 
  vfs_vget = 0xc033a4e2 <cd9660_vget>, 
  vfs_fhtovp = 0xc033905e <cd9660_fhtovp>, 
  vfs_checkexp = 0xc0339017 <cd9660_checkexp>, 
  vfs_vptofh = 0xc0338ff0 <cd9660_vptofh>, 
  vfs_init = 0xc0337d9a <cd9660_init>, 
  vfs_uninit = 0xc0337a5c <cd9660_uninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: procfs, Refs: 0, Flags: 0x00080000
VFS ops: 
$6 = {
  vfs_mount = 0xc03e094d <procfs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc03e08f1 <procfs_unmount>, 
  vfs_root = 0xc03e0a25 <procfs_root>, 
  vfs_quotactl = 0xc03c3b7a <vfs_stdquotactl>, 
  vfs_statfs = 0xc03e0854 <procfs_statfs>, 
  vfs_sync = 0xc03c3b84 <vfs_stdsync>, 
  vfs_vget = 0xc03c3b98 <vfs_stdvget>, 
  vfs_fhtovp = 0xc03c3ba2 <vfs_stdfhtovp>, 
  vfs_checkexp = 0xc03c3bac <vfs_stdcheckexp>, 
  vfs_vptofh = 0xc03c3b66 <vfs_stdvptofh>, 
  vfs_init = 0xc03c3bb6 <vfs_stdinit>, 
  vfs_uninit = 0xc03c3bc0 <vfs_stduninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: devfs, Refs: 2, Flags: 0x00080000
VFS ops: 
$7 = {
  vfs_mount = 0xc0523ab7 <devfs_vfs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc05239fc <devfs_vfs_unmount>, 
  vfs_root = 0xc0523ce2 <devfs_vfs_root>, 
  vfs_quotactl = 0xc03c3b7a <vfs_stdquotactl>, 
  vfs_statfs = 0xc0523945 <devfs_vfs_statfs>, 
  vfs_sync = 0xc03c3b84 <vfs_stdsync>, 
  vfs_vget = 0xc052390f <devfs_vfs_vget>, 
  vfs_fhtovp = 0xc05238c6 <devfs_vfs_fhtovp>, 
  vfs_checkexp = 0xc03c3bac <vfs_stdcheckexp>, 
  vfs_vptofh = 0xc052388c <devfs_vfs_vptofh>, 
  vfs_init = 0xc03c3bb6 <vfs_stdinit>, 
  vfs_uninit = 0xc03c3bc0 <vfs_stduninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: ufs, Refs: 1, Flags: 0x00000000
VFS ops: 
$8 = {
  vfs_mount = 0xc051402f <ffs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc051362b <ffs_unmount>, 
  vfs_root = 0xc0519881 <ufs_root>, 
  vfs_quotactl = 0xc0519830 <ufs_quotactl>, 
  vfs_statfs = 0xc0512b4a <ffs_statfs>, 
  vfs_sync = 0xc0513420 <ffs_sync>, 
  vfs_vget = 0xc051308b <ffs_vget>, 
  vfs_fhtovp = 0xc0513010 <ffs_fhtovp>, 
  vfs_checkexp = 0xc051983a <ufs_check_export>, 
  vfs_vptofh = 0xc0512aec <ffs_vptofh>, 
  vfs_init = 0xc0512b1e <ffs_init>, 
  vfs_uninit = 0xc051696d <ufs_uninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc03c3c3d <vfs_stdstatvfs>
}
Filesystem: hammer, Refs: 1, Flags: 0x00000000
VFS ops: 
$9 = {
  vfs_mount = 0xc054e0a9 <hammer_vfs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc054e036 <hammer_vfs_unmount>, 
  vfs_root = 0xc054dd0b <hammer_vfs_root>, 
  vfs_quotactl = 0xc03c3b7a <vfs_stdquotactl>, 
  vfs_statfs = 0xc054d884 <hammer_vfs_statfs>, 
  vfs_sync = 0xc054dd3d <hammer_vfs_sync>, 
  vfs_vget = 0xc054dc2e <hammer_vfs_vget>, 
  vfs_fhtovp = 0xc054db1f <hammer_vfs_fhtovp>, 
  vfs_checkexp = 0xc054daae <hammer_vfs_checkexp>, 
  vfs_vptofh = 0xc054da46 <hammer_vfs_vptofh>, 
  vfs_init = 0xc054d97e <hammer_vfs_init>, 
  vfs_uninit = 0xc03c3bc0 <vfs_stduninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc054d770 <hammer_vfs_statvfs>
}
Filesystem: nfs, Refs: 0, Flags: 0x00020000
VFS ops: 
$10 = {
  vfs_mount = 0xc0496aec <nfs_mount>, 
  vfs_start = 0xc03c3b70 <vfs_stdstart>, 
  vfs_unmount = 0xc0495d25 <nfs_unmount>, 
  vfs_root = 0xc0495821 <nfs_root>, 
  vfs_quotactl = 0xc03c3b7a <vfs_stdquotactl>, 
  vfs_statfs = 0xc0495533 <nfs_statfs>, 
  vfs_sync = 0xc0495434 <nfs_sync>, 
  vfs_vget = 0xc03c3b98 <vfs_stdvget>, 
  vfs_fhtovp = 0xc03c3ba2 <vfs_stdfhtovp>, 
  vfs_checkexp = 0xc03c3bac <vfs_stdcheckexp>, 
  vfs_vptofh = 0xc03c3b66 <vfs_stdvptofh>, 
  vfs_init = 0xc0492aca <nfs_init>, 
  vfs_uninit = 0xc0492a93 <nfs_uninit>, 
  vfs_extattrctl = 0xc03c3bca <vfs_stdextattrctl>, 
  vfs_statvfs = 0xc04950d5 <nfs_statvfs>
}
(kgdb) $11 = {mnt_list = {tqe_next = 0xd9aef060, tqe_prev = 0xc074fac0}, 
  mnt_op = 0xc0766fa0, mnt_vfc = 0xc0766f60, mnt_namecache_gen = 0, 
  mnt_syncer = 0xc495a0b8, mnt_nvnodelist = {tqh_first = 0xc4959e38, 
    tqh_last = 0xc495a104}, mnt_lock = {lk_spinlock = {lock = 0}, 
    lk_flags = 0, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 0, 
    lk_unused1 = 0, lk_wmesg = 0xc0693006 "vfslock", lk_timo = 6, 
    lk_lockholder = 0xffffffff}, mnt_flag = 20480, mnt_kern_flag = 138346496, 
  mnt_maxsymlinklen = 255, mnt_stat = {f_spare2 = 0, f_bsize = 16384, 
    f_iosize = 16384, f_blocks = 6983680, f_bfree = 6443087, 
    f_bavail = 6443087, f_files = 302356, f_ffree = 0, f_fsid = {val = {
        -126792100, 46466}}, f_owner = 0, f_type = 9, f_flags = 20480, 
    f_syncwrites = 412, f_asyncwrites = 6508, 
    f_fstypename = "hammer\000\000\000\000\000\000\000\000\000", 
    f_mntonname = "/", '\000' <repeats 78 times>, f_syncreads = 0, 
    f_asyncreads = 1289, f_spares1 = 0, 
    f_mntfromname = "PIZZA_120G\000A8C2508466.s1d", '\000' <repeats 54 times>, 
    f_spares2 = 0, f_spare = {0, 0}}, mnt_vstat = {f_bsize = 16384, 
    f_frsize = 16384, f_blocks = 6983680, f_bfree = 6444622, 
    f_bavail = 6444622, f_files = 302356, f_ffree = 0, f_favail = 0, 
    f_fsid = 2458163415, f_flag = 0, f_namemax = 0, f_owner = 0, f_type = 0, 
    f_syncreads = 0, f_syncwrites = 0, f_asyncreads = 0, f_asyncwrites = 0, 
    f_fsid_uuid = {time_low = 2055807384, time_mid = 26672, 
      time_hi_and_version = 4576, clock_seq_hi_and_reserved = 156 '\234', 
      clock_seq_low = 24 '\030', node = "\001\016\f\241\252{"}, f_uid_uuid = {
      time_low = 0, time_mid = 0, time_hi_and_version = 0, 
      clock_seq_hi_and_reserved = 0 '\000', clock_seq_low = 0 '\000', 
      node = "\000\000\000\000\000"}}, mnt_data = 0xd7250000, mnt_time = 0, 
  mnt_iosize_max = 131072, mnt_reservedvnlist = {tqh_first = 0x0, 
    tqh_last = 0xd69e45c4}, mnt_nvnodelistsize = 1267, 
  mnt_vn_use_ops = 0xc4921940, mnt_vn_coherency_ops = 0x0, 
  mnt_vn_journal_ops = 0x0, mnt_vn_norm_ops = 0xc4921940, 
  mnt_vn_spec_ops = 0xc4921a60, mnt_vn_fifo_ops = 0xc4921b80, mnt_ncmountpt = {
    ncp = 0xd7303318, mount = 0xd69e43e0}, mnt_ncmounton = {ncp = 0x0, 
    mount = 0x0}, mnt_refs = 84, mnt_token = {t_ref = 0x0, t_flags = 0, 
    t_collisions = 0, t_collmask = 0, t_desc = 0xc069300e "permnt"}, 
  mnt_jlist = {tqh_first = 0x0, tqh_last = 0xd69e4610}, mnt_jbitmap = 0x0, 
  mnt_streamid = 0, mnt_bioops = 0x0}
$12 = {mnt_list = {tqe_next = 0xd69e39e0, tqe_prev = 0xd69e43e0}, 
  mnt_op = 0xc0765ba0, mnt_vfc = 0xc0765b60, mnt_namecache_gen = 672, 
  mnt_syncer = 0xd9ab46b8, mnt_nvnodelist = {tqh_first = 0xd9ab4a78, 
    tqh_last = 0xd9ab4704}, mnt_lock = {lk_spinlock = {lock = 0}, 
    lk_flags = 0, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 0, 
    lk_unused1 = 0, lk_wmesg = 0xc0693006 "vfslock", lk_timo = 0, 
    lk_lockholder = 0xffffffff}, mnt_flag = 4096, mnt_kern_flag = 272564224, 
  mnt_maxsymlinklen = 0, mnt_stat = {f_spare2 = 0, f_bsize = 512, 
    f_iosize = 512, f_blocks = 2, f_bfree = 0, f_bavail = 0, f_files = 663, 
    f_ffree = 0, f_fsid = {val = {117505793, 7}}, f_owner = 0, f_type = 7, 
    f_flags = 4096, f_syncwrites = 0, f_asyncwrites = 0, 
    f_fstypename = "devfs\000\000\000\000\000\000\000\000\000\000", 
    f_mntonname = "/dev", '\000' <repeats 75 times>, f_syncreads = 0, 
    f_asyncreads = 0, f_spares1 = 0, 
    f_mntfromname = "devfs", '\000' <repeats 74 times>, f_spares2 = 0, 
    f_spare = {0, 0}}, mnt_vstat = {f_bsize = 512, f_frsize = 512, 
    f_blocks = 2, f_bfree = 0, f_bavail = 0, f_files = 663, f_ffree = 0, 
    f_favail = 0, f_fsid = 0, f_flag = 0, f_namemax = 0, f_owner = 0, 
    f_type = 0, f_syncreads = 0, f_syncwrites = 0, f_asyncreads = 0, 
    f_asyncwrites = 0, f_fsid_uuid = {time_low = 0, time_mid = 0, 
      time_hi_and_version = 0, clock_seq_hi_and_reserved = 0 '\000', 
      clock_seq_low = 0 '\000', node = "\000\000\000\000\000"}, f_uid_uuid = {
      time_low = 0, time_mid = 0, time_hi_and_version = 0, 
      clock_seq_hi_and_reserved = 0 '\000', clock_seq_low = 0 '\000', 
      node = "\000\000\000\000\000"}}, mnt_data = 0xd47808c0, mnt_time = 0, 
  mnt_iosize_max = 65536, mnt_reservedvnlist = {tqh_first = 0x0, 
    tqh_last = 0xd9aef244}, mnt_nvnodelistsize = 87, 
  mnt_vn_use_ops = 0xd9b16880, mnt_vn_coherency_ops = 0x0, 
  mnt_vn_journal_ops = 0x0, mnt_vn_norm_ops = 0xd9b16880, 
  mnt_vn_spec_ops = 0xd9b169a0, mnt_vn_fifo_ops = 0x0, mnt_ncmountpt = {
    ncp = 0xd7303408, mount = 0xd9aef060}, mnt_ncmounton = {ncp = 0xd7303368, 
    mount = 0xd69e43e0}, mnt_refs = 45, mnt_token = {t_ref = 0x0, t_flags = 0, 
    t_collisions = 0, t_collmask = 0, t_desc = 0xc069300e "permnt"}, 
  mnt_jlist = {tqh_first = 0x0, tqh_last = 0xd9aef290}, mnt_jbitmap = 0x0, 
  mnt_streamid = 0, mnt_bioops = 0x0}
$13 = {mnt_list = {tqe_next = 0xd69e3c60, tqe_prev = 0xd9aef060}, 
  mnt_op = 0xc0764720, mnt_vfc = 0xc07646e0, mnt_namecache_gen = 0, 
  mnt_syncer = 0xd9e98f38, mnt_nvnodelist = {tqh_first = 0xd9e9b738, 
    tqh_last = 0xd9e98f84}, mnt_lock = {lk_spinlock = {lock = 0}, 
    lk_flags = 0, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 0, 
    lk_unused1 = 0, lk_wmesg = 0xc0693006 "vfslock", lk_timo = 0, 
    lk_lockholder = 0xffffffff}, mnt_flag = 4096, mnt_kern_flag = 134217728, 
  mnt_maxsymlinklen = 60, mnt_stat = {f_spare2 = 0, f_bsize = 2048, 
    f_iosize = 16384, f_blocks = 387047, f_bfree = 276200, f_bavail = 245237, 
    f_files = 97278, f_ffree = 96165, f_fsid = {val = {1302961739, 
        1874618124}}, f_owner = 0, f_type = 8, f_flags = 4096, 
    f_syncwrites = 0, f_asyncwrites = 4, 
    f_fstypename = "ufs", '\000' <repeats 12 times>, 
    f_mntonname = "/boot", '\000' <repeats 74 times>, f_syncreads = 0, 
    f_asyncreads = 37, f_spares1 = 0, 
    f_mntfromname = "/dev/serno/WD-WMA8C2508466.s1a", '\000' <repeats 49 times>, f_spares2 = 0, f_spare = {0, 0}}, mnt_vstat = {f_bsize = 0, f_frsize = 0, 
    f_blocks = 0, f_bfree = 0, f_bavail = 0, f_files = 0, f_ffree = 0, 
    f_favail = 0, f_fsid = 0, f_flag = 0, f_namemax = 0, f_owner = 0, 
    f_type = 0, f_syncreads = 0, f_syncwrites = 0, f_asyncreads = 0, 
    f_asyncwrites = 0, f_fsid_uuid = {time_low = 0, time_mid = 0, 
      time_hi_and_version = 0, clock_seq_hi_and_reserved = 0 '\000', 
      clock_seq_low = 0 '\000', node = "\000\000\000\000\000"}, f_uid_uuid = {
      time_low = 0, time_mid = 0, time_hi_and_version = 0, 
      clock_seq_hi_and_reserved = 0 '\000', clock_seq_low = 0 '\000', 
      node = "\000\000\000\000\000"}}, mnt_data = 0xc4990cf0, mnt_time = 0, 
  mnt_iosize_max = 65536, mnt_reservedvnlist = {tqh_first = 0x0, 
    tqh_last = 0xd69e3bc4}, mnt_nvnodelistsize = 10, 
  mnt_vn_use_ops = 0xc4921ca0, mnt_vn_coherency_ops = 0x0, 
  mnt_vn_journal_ops = 0x0, mnt_vn_norm_ops = 0xc4921ca0, 
  mnt_vn_spec_ops = 0xc4921dc0, mnt_vn_fifo_ops = 0xc4921ee0, mnt_ncmountpt = {
    ncp = 0xc47abe28, mount = 0xd69e39e0}, mnt_ncmounton = {ncp = 0xd7304d08, 
    mount = 0xd69e43e0}, mnt_refs = 1, mnt_token = {t_ref = 0x0, t_flags = 0, 
    t_collisions = 0, t_collmask = 0, t_desc = 0xc069300e "permnt"}, 
  mnt_jlist = {tqh_first = 0x0, tqh_last = 0xd69e3c10}, mnt_jbitmap = 0x0, 
  mnt_streamid = 0, mnt_bioops = 0x0}
$14 = {mnt_list = {tqe_next = 0xd69e4160, tqe_prev = 0xd69e39e0}, 
  mnt_op = 0xc07675e0, mnt_vfc = 0xc07675a0, mnt_namecache_gen = 0, 
  mnt_syncer = 0xd9e991b8, mnt_nvnodelist = {tqh_first = 0xd9aa3278, 
    tqh_last = 0xd9e99204}, mnt_lock = {lk_spinlock = {lock = 0}, 
    lk_flags = 0, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 0, 
    lk_unused1 = 0, lk_wmesg = 0xc0693006 "vfslock", lk_timo = 0, 
    lk_lockholder = 0xffffffff}, mnt_flag = 4096, mnt_kern_flag = 539885568, 
  mnt_maxsymlinklen = 0, mnt_stat = {f_spare2 = 0, f_bsize = 4096, 
    f_iosize = 4096, f_blocks = 651954, f_bfree = 651954, f_bavail = 651954, 
    f_files = 2607819, f_ffree = 2607818, f_fsid = {val = {16842498, 1}}, 
    f_owner = 0, f_type = 1, f_flags = 4096, f_syncwrites = 0, 
    f_asyncwrites = 0, 
    f_fstypename = "tmpfs\000\000\000\000\000\000\000\000\000\000", 
    f_mntonname = "/tmp", '\000' <repeats 75 times>, f_syncreads = 0, 
    f_asyncreads = 0, f_spares1 = 0, 
    f_mntfromname = "tmpfs", '\000' <repeats 74 times>, f_spares2 = 0, 
    f_spare = {0, 0}}, mnt_vstat = {f_bsize = 0, f_frsize = 0, f_blocks = 0, 
    f_bfree = 0, f_bavail = 0, f_files = 0, f_ffree = 0, f_favail = 0, 
    f_fsid = 0, f_flag = 0, f_namemax = 0, f_owner = 0, f_type = 0, 
    f_syncreads = 0, f_syncwrites = 0, f_asyncreads = 0, f_asyncwrites = 0, 
    f_fsid_uuid = {time_low = 0, time_mid = 0, time_hi_and_version = 0, 
      clock_seq_hi_and_reserved = 0 '\000', clock_seq_low = 0 '\000', 
      node = "\000\000\000\000\000"}, f_uid_uuid = {time_low = 0, 
      time_mid = 0, time_hi_and_version = 0, 
      clock_seq_hi_and_reserved = 0 '\000', clock_seq_low = 0 '\000', 
      node = "\000\000\000\000\000"}}, mnt_data = 0xd6b5d8d8, mnt_time = 0, 
  mnt_iosize_max = 65536, mnt_reservedvnlist = {tqh_first = 0x0, 
    tqh_last = 0xd69e3e44}, mnt_nvnodelistsize = 6, 
  mnt_vn_use_ops = 0xc4922000, mnt_vn_coherency_ops = 0x0, 
  mnt_vn_journal_ops = 0x0, mnt_vn_norm_ops = 0xc4922000, 
  mnt_vn_spec_ops = 0x0, mnt_vn_fifo_ops = 0xc4922120, mnt_ncmountpt = {
    ncp = 0xc47abf18, mount = 0xd69e3c60}, mnt_ncmounton = {ncp = 0xd7304cb8, 
    mount = 0xd69e43e0}, mnt_refs = 2, mnt_token = {t_ref = 0x0, t_flags = 0, 
    t_collisions = 0, t_collmask = 0, t_desc = 0xc069300e "permnt"}, 
  mnt_jlist = {tqh_first = 0x0, tqh_last = 0xd69e3e90}, mnt_jbitmap = 0x0, 
  mnt_streamid = 0, mnt_bioops = 0x0}
$15 = {mnt_list = {tqe_next = 0xd69e1460, tqe_prev = 0xd69e3c60}, 
  mnt_op = 0xc0750620, mnt_vfc = 0xc07505e0, mnt_namecache_gen = 0, 
  mnt_syncer = 0xd9e99938, mnt_nvnodelist = {tqh_first = 0xd9e99938, 
    tqh_last = 0xd9e99984}, mnt_lock = {lk_spinlock = {lock = 0}, 
    lk_flags = 0, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 0, 
    lk_unused1 = 0, lk_wmesg = 0xc0693006 "vfslock", lk_timo = 0, 
    lk_lockholder = 0xffffffff}, mnt_flag = 4096, mnt_kern_flag = 12517376, 
  mnt_maxsymlinklen = 0, mnt_stat = {f_spare2 = 0, f_bsize = 16384, 
    f_iosize = 16384, f_blocks = 6983680, f_bfree = 6444623, 
    f_bavail = 6444623, f_files = 302356, f_ffree = 0, f_fsid = {val = {
        -126792100, -1532868234}}, f_owner = 0, f_type = 9, f_flags = 4096, 
    f_syncwrites = 0, f_asyncwrites = 0, 
    f_fstypename = "null", '\000' <repeats 11 times>, 
    f_mntonname = "/usr", '\000' <repeats 75 times>, f_syncreads = 0, 
    f_asyncreads = 0, f_spares1 = 0, 
    f_mntfromname = "/pfs/@@-1:00001", '\000' <repeats 64 times>, 
    f_spares2 = 0, f_spare = {0, 0}}, mnt_vstat = {f_bsize = 0, f_frsize = 0, 
    f_blocks = 0, f_bfree = 0, f_bavail = 0, f_files = 0, f_ffree = 0, 
    f_favail = 0, f_fsid = 0, f_flag = 0, f_namemax = 0, f_owner = 0, 
    f_type = 0, f_syncreads = 0, f_syncwrites = 0, f_asyncreads = 0, 
    f_asyncwrites = 0, f_fsid_uuid = {time_low = 0, time_mid = 0, 
      time_hi_and_version = 0, clock_seq_hi_and_reserved = 0 '\000', 
      clock_seq_low = 0 '\000', node = "\000\000\000\000\000"}, f_uid_uuid = {
      time_low = 0, time_mid = 0, time_hi_and_version = 0, 
      clock_seq_hi_and_reserved = 0 '\000', clock_seq_low = 0 '\000', 
      node = "\000\000\000\000\000"}}, mnt_data = 0xd9e997f8, mnt_time = 0, 
  mnt_iosize_max = 65536, mnt_reservedvnlist = {tqh_first = 0x0, 
    tqh_last = 0xd69e4344}, mnt_nvnodelistsize = 1, 
  mnt_vn_use_ops = 0xc4922240, mnt_vn_coherency_ops = 0x0, 
  mnt_vn_journal_ops = 0x0, mnt_vn_norm_ops = 0xc4922240, 
  mnt_vn_spec_ops = 0x0, mnt_vn_fifo_ops = 0x0, mnt_ncmountpt = {
    ncp = 0xc47ac148, mount = 0xd69e4160}, mnt_ncmounton = {ncp = 0xc47ab338, 
    mount = 0xd69e43e0}, mnt_refs = 31, mnt_token = {t_ref = 0x0, t_flags = 0, 
    t_collisions = 0, t_collmask = 0, t_desc = 0xc069300e "permnt"}, 
  mnt_jlist = {tqh_first = 0x0, tqh_last = 0xd69e4390}, mnt_jbitmap = 0x0, 
  mnt_streamid = 0, mnt_bioops = 0x0}
$16 = {mnt_list = {tqe_next = 0x0, tqe_prev = 0xd69e4160}, 
  mnt_op = 0xc0750620, mnt_vfc = 0xc07505e0, mnt_namecache_gen = 0, 
  mnt_syncer = 0xd9e99e38, mnt_nvnodelist = {tqh_first = 0xd9e99e38, 
    tqh_last = 0xd9e99e84}, mnt_lock = {lk_spinlock = {lock = 0}, 
    lk_flags = 0, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 0, 
    lk_unused1 = 0, lk_wmesg = 0xc0693006 "vfslock", lk_timo = 0, 
    lk_lockholder = 0xffffffff}, mnt_flag = 4096, mnt_kern_flag = 12517376, 
  mnt_maxsymlinklen = 0, mnt_stat = {f_spare2 = 0, f_bsize = 16384, 
    f_iosize = 16384, f_blocks = 6983680, f_bfree = 6444623, 
    f_bavail = 6444623, f_files = 302356, f_ffree = 0, f_fsid = {val = {
        -126792100, 1311020052}}, f_owner = 0, f_type = 9, f_flags = 4096, 
    f_syncwrites = 0, f_asyncwrites = 0, 
    f_fstypename = "null", '\000' <repeats 11 times>, 
    f_mntonname = "/usr/obj", '\000' <repeats 71 times>, f_syncreads = 0, 
    f_asyncreads = 0, f_spares1 = 0, 
    f_mntfromname = "/pfs/@@-1:00002", '\000' <repeats 64 times>, 
    f_spares2 = 0, f_spare = {0, 0}}, mnt_vstat = {f_bsize = 0, f_frsize = 0, 
    f_blocks = 0, f_bfree = 0, f_bavail = 0, f_files = 0, f_ffree = 0, 
    f_favail = 0, f_fsid = 0, f_flag = 0, f_namemax = 0, f_owner = 0, 
    f_type = 0, f_syncreads = 0, f_syncwrites = 0, f_asyncreads = 0, 
    f_asyncwrites = 0, f_fsid_uuid = {time_low = 0, time_mid = 0, 
      time_hi_and_version = 0, clock_seq_hi_and_reserved = 0 '\000', 
      clock_seq_low = 0 '\000', node = "\000\000\000\000\000"}, f_uid_uuid = {
      time_low = 0, time_mid = 0, time_hi_and_version = 0, 
      clock_seq_hi_and_reserved = 0 '\000', clock_seq_low = 0 '\000', 
      node = "\000\000\000\000\000"}}, mnt_data = 0xd9e99cf8, mnt_time = 0, 
  mnt_iosize_max = 65536, mnt_reservedvnlist = {tqh_first = 0x0, 
    tqh_last = 0xd69e1644}, mnt_nvnodelistsize = 1, 
  mnt_vn_use_ops = 0xc4922360, mnt_vn_coherency_ops = 0x0, 
  mnt_vn_journal_ops = 0x0, mnt_vn_norm_ops = 0xc4922360, 
  mnt_vn_spec_ops = 0x0, mnt_vn_fifo_ops = 0x0, mnt_ncmountpt = {
    ncp = 0xc47ac328, mount = 0xd69e1460}, mnt_ncmounton = {ncp = 0xd7305078, 
    mount = 0xd69e4160}, mnt_refs = 1, mnt_token = {t_ref = 0x0, t_flags = 0, 
    t_collisions = 0, t_collmask = 0, t_desc = 0xc069300e "permnt"}, 
  mnt_jlist = {tqh_first = 0x0, tqh_last = 0xd69e1690}, mnt_jbitmap = 0x0, 
  mnt_streamid = 0, mnt_bioops = 0x0}
(kgdb) 
Id Refs Address    Size     Name
 1   13 0xc0100000 88c2a0   kernel
 2    1 0xc098d000 71e20    acpi.ko
 3    1 0xc09ff000 11b28    ahci.ko
 4    1 0xc0a11000 91cc     ehci.ko
 5    1 0xd9cd1000 9000     netgraph.ko
 6    1 0xd9cda000 4000     ng_ksocket.ko
 7    1 0xd9e72000 3000     ng_ether.ko
 8    1 0xd9e75000 4000     ng_pppoe.ko
 9    1 0xd9e79000 3000     ng_socket.ko
10    1 0xda104000 37000    pf.ko
(kgdb) 

------------------------------------------------------------------------
ps -axl

Bus error (core dumped)

------------------------------------------------------------------------
vmstat -s

   157736 cpu context switches
    77641 device interrupts
     2630 software interrupts
    40106 traps
  9912451 system calls
        1 kernel threads created
      463  fork() calls
        2 vfork() calls
        0 rfork() calls
      318 exec() calls
        0 swap pager pageins
        0 swap pager pages paged in
        0 swap pager pageouts
        0 swap pager pages paged out
      496 vnode pager pageins
      496 vnode pager pages paged in
        0 vnode pager pageouts
        0 vnode pager pages paged out
        0 page daemon wakeups
        0 pages examined by the page daemon
        0 pages reactivated
     9592 copy-on-write faults
        0 copy-on-write optimized faults
    26381 zero fill pages zeroed
    26138 zero fill pages prezeroed
       83 intransit blocking page faults
   109912 total VM faults taken
        0 pages affected by kernel thread creation
    25929 pages affected by  fork()
      123 pages affected by vfork()
        0 pages affected by rfork()
   434105 pages freed
        0 pages freed by daemon
    22971 pages freed by exiting processes
    10247 pages active
    82383 pages inactive
      104 pages in VM cache
    68832 pages wired down
   349163 pages free
     4096 bytes per page
    52221 global smp invltlbs
     3252 total path lookups
     8553 total component lookups
          cache hits (82% pos + 9% neg)
          deletions 0%, falsehits 0%

------------------------------------------------------------------------
vmstat -m


Memory statistics by type                          Type  Kern
              Type   InUse  MemUse HighUse   Limit  Requests  Limit Limit
              pf_if     11      5K      0K  104858K        11    0     0
             pfsync      1      1K      0K  104858K         1    0     0
           netgraph     22      1K      0K  104858K        49    0     0
    tmpfs name zone      3      1K      0K  104858K         6    0     0
       tmpfs dirent      4      1K      0K  104858K         4    0     0
         tmpfs node      5      1K      0K  417659K         5    0     0
      HAMMER-inodes   1266    871K      0K 1048576K      1378    0     0
      HAMMER-others   1622    180K      0K  104858K      6123    0     0
            acpipwr      1      1K      0K  104858K         1    0     0
            acpidev     86      3K      0K  104858K        86    0     0
           pci_link     24      2K      0K  104858K        24    0     0
            acpisem     16      1K      0K  104858K        16    0     0
           acpitask      0      0K      0K  104858K         3    0     0
             acpica    310     11K      0K  104858K    105418    0     0
         CAM periph      2      1K      0K  104858K         8    0     0
           atkbddev      2      1K      0K  104858K         2    0     0
           objcache     67      7K      0K  104858K        67    0     0
  objcache magazine    983    359K      0K  104858K       983    0     0
              lockf      3      1K      0K  104858K     10062    0     0
          legacydrv      1      1K      0K  104858K         1    0     0
         uc_devlist     34      2K      0K  104858K        34    0     0
           nexusdev      5      1K      0K  104858K         5    0     0
          proc-args     28      2K      0K  104858K      4592    0     0
              lwbuf     21      1K      0K  104858K        21    0     0
            syscons     41    166K      0K  104858K        41    0     0
              xform      0      0K      0K  104858K        20    0     0
             crypto      1      1K      0K  104858K         1    0     0
           propstng   1320     31K      0K  104858K      1320    0     0
        prop string   1320     11K      0K  104858K      1360    0     0
           propnmbr   1585     62K      0K  104858K      1585    0     0
            pdict16     16      1K      0K  104858K        16    0     0
           propdict    655    123K      0K  104858K       655    0     0
    prop dictionary    655     82K      0K  104858K       674    0     0
             kbdmux      6      7K      0K  104858K         6    0     0
             isadev     29      2K      0K  104858K        29    0     0
                USB     79      6K      0K  104858K        89    0     0
             USBdev     21      7K      0K  104858K        21    0     0
               ZONE     29      4K      0K  104858K        56    0     0
          exec-args      8   2080K      0K  104858K         8    0     0
             kqueue     41      3K      0K  104858K    229379    0     0
               kenv     19      3K      0K  104858K        19    0     0
            vmspace     49     16K      0K  104858K        49    0     0
          file desc     32     20K      0K  104858K      2829    0     0
        tmpfs mount      1      1K      0K  104858K         1    0     0
       HAMMER-mount      1     40K      0K  104858K         1    0     0
              devfs   3580    357K      0K  104858K      6366    0     0
               file    111      8K      0K  104858K     15684    0     0
        UFS dirhash      7      5K      0K  104858K         7    0     0
          UFS mount      3      5K      0K  104858K         3    0     0
          UFS ihash      1    512K      0K  104858K         1    0     0
           FFS node      9      3K      0K 1048576K         9    0     0
            pagedep      1    128K      0K  104858K         1    0     0
           inodedep      1    512K      0K  104858K         1    0     0
             newblk      1      1K      0K  104858K         1    0     0
           p1003.1b      1      1K      0K  104858K         1    0     0
              sigio      1      1K      0K  104858K         1    0     0
                kld    121    361K      0K  104858K       205    0     0
             module    357     20K      0K  104858K       357    0     0
             varsym    260      8K      0K  104858K       270    0     0
      CAM dev queue      5      1K      0K  104858K         5    0     0
               CCMS   1491     94K      0K  104858K      1491    0     0
                agp      1      1K      0K  104858K         1    0     0
            CAM XPT     37      8K      0K  104858K       142    0     0
         NFS daemon      1      1K      0K  104858K         1    0     0
           NFS hash      1    512K      0K  104858K         1    0     0
       ip6_moptions      1      1K      0K  104858K         1    0     0
           syncache      2     12K      0K  104858K        59    0     0
            tcptemp     25      2K      0K  104858K        25    0     0
               sblk      0      0K      0K  104858K         1    0     0
                ipq     50      2K      0K  104858K        50    0     0
           in_multi     23      1K      0K  104858K        24    0     0
        ISOFS mount      1    512K      0K  104858K         1    0     0
           routetbl    548     55K      0K  104858K       917    0     0
                tun      1      1K      0K  104858K         1    0     0
              faith      1      1K      0K  104858K         1    0     0
              clone      5     13K      0K  104858K         5    0     0
             ifaddr    110     17K      0K  104858K       118    0     0
        ether_multi     74      3K      0K  104858K        76    0     0
                BPF     12      9K      0K  104858K        12    0     0
               altq     26      6K      0K  104858K        26    0     0
      MSDOSFS mount      1    512K      0K  104858K         1    0     0
       NULLFS mount      2      1K      0K  104858K         2    0     0
          Fifo info      1      1K      0K  104858K         2    0     0
             vnodes   1491    466K      0K 1048576K      1491    0     0
           vnodeops     14      4K      0K  104858K        14    0     0
          nameibufs     10     10K      0K  104858K        10    0     0
              mount      7      5K      0K  104858K        10    0     0
           vfscache   4426    715K      0K  104858K      4486    0     0
         BIO buffer      0      0K      0K  104858K         8    0     0
              unpcb     15      3K      0K  104858K       203    0     0
             socket     41     11K      0K  104858K      2157    0     0
             soname      4      1K      0K  104858K    577444    0     0
                pcb     53     23K      0K  104858K      3566    0     0
                tag      0      0K      0K  104858K     13352    0     0
               mbuf    872    436K      0K  140904K      2199    0     0
             mbufcl    475    950K      0K  104858K       475    0     0
            mclmeta    475      4K      0K  104858K       475    0     0
               ptys    258     81K      0K  104858K       259    0     0
               ttys    809    103K      0K  104858K      1709    0     0
                shm      1      9K      0K  104858K         1    0     0
          CAM queue     15      1K      0K  104858K       115    0     0
                sem      3      5K      0K  104858K         3    0     0
                msg      4     24K      0K  104858K         4    0     0
            MD disk      2      1K      0K  104858K         2    0     0
               rman    100      6K      0K  104858K       494    0     0
               pipe     25      4K      0K  104858K      2699    0     0
           ioctlops      0      0K      0K  104858K      1218    0     0
             select      2      1K      0K  104858K     16504    0     0
          taskqueue      8      1K      0K  104858K         8    0     0
               sbuf      0      0K      0K  104858K         2    0     0
               SWAP      2   1097K      0K  104858K         2    0     0
               kobj    246    277K      0K  104858K       246    0     0
       eventhandler     35      2K      0K  104858K        35    0     0
               disk      1      1K      0K  104858K         1    0     0
            ata_cam      4      3K      0K  104858K         8    0     0
                bus   1205     92K      0K  104858K      9604    0     0
          ar_driver      0      0K      0K  104858K         5    0     0
            callout      2   2048K      0K  104858K         2    0     0
             sysctl      0      0K      0K  104858K      7825    0     0
          sysctloid    532     13K      0K  104858K       532    0     0
            tslpque      1      8K      0K  104858K         1    0     0
             dsched    500     93K      0K  104858K       500    0     0
       lwkt message     10      1K      0K  104858K      7611    0     0
            ata_dma      4      1K      0K  104858K         4    0     0
             thread     94     83K      0K  104858K        94    0     0
          ad_driver      1      1K      0K  104858K         1    0     0
            memdesc      1      3K      0K  104858K         1    0     0
        MPipe Array      2      1K      0K  104858K         2    0     0
              cache   3719    216K      0K  104858K      3848    0     0
             devbuf    319    179K      0K  104858K       760    0     0
               temp    304     11K      0K  104858K     22369    0     0
             ip6opt      2      1K      0K  104858K      1874    0     0
             ip6ndp     15      2K      0K  104858K        21    0     0
        ata_generic    101     18K      0K  104858K       101    0     0
            uidinfo      5      3K      0K  104858K        39    0     0
               cred     20      3K      0K  104858K       240    0     0
               pgrp     28      3K      0K  104858K       436    0     0
            session     26      2K      0K  104858K       424    0     0
               proc     31     35K      0K  104858K      2825    0     0
                lwp     36     12K      0K  104858K      2855    0     0
            subproc     44     84K      0K  104858K      2888    0     0
            CAM SIM      5      1K      0K  104858K         5    0     0

Memory Totals:  In Use    Free    Requests
                14898K      0K     1086996

------------------------------------------------------------------------
vmstat -z


ITEM            SIZE     LIMIT    USED    FREE  REQUESTS

SWAPMETA:        160,   255364,      0,     25,        1
PV ENTRY:         32,  1400000,  15896, 508199,   142685
MAP ENTRY:        60,        0,    250,   1798,     3046
MAP:             140,        0,      0,     10,        0
VM OBJECT:       108,        0,    420,     95,     7174


------------------------------------------------------------------------
vmstat -i

interrupt                           total       rate
atkbd0                                  3          0
sio0                                    0          0
acpi0                                   0          0
psm0                                    0          0
ata0                                11524          1
ata1                                    0          0
em0                                   210          0
xl0                                   244          0
atapci0                                 0          0
uhci0/uhci1/uhci2/uhci3/ehci0           0          0
swi_siopoll                             0          0
swi_cambio                             18          0
swi_vm                                  0          0
swi_mp_taskq/swi_taskq              11523          1
Total                               23522          2

------------------------------------------------------------------------
pstat -T

111/98624 files
0M/4095M swap space

------------------------------------------------------------------------
pstat -s

Device          512-blocks     Used    Avail Capacity  Type
/dev/ad0s1b        8388352        0  8388352     0%    Interleaved

------------------------------------------------------------------------
ipcs -a

Message Queues:
T     ID     KEY        MODE       OWNER    GROUP  CREATOR   CGROUP CBYTES  QNUM QBYTES LSPID LRPID   STIME    RTIME    CTIME

Shared Memory:
T     ID     KEY        MODE       OWNER    GROUP  CREATOR   CGROUP NATTCH  SEGSZ  CPID  LPID   ATIME    DTIME    CTIME

Semaphores:
T     ID     KEY        MODE       OWNER    GROUP  CREATOR   CGROUP NSEMS   OTIME    CTIME


------------------------------------------------------------------------
ipcs -T

msginfo:
	msgmax:  16384	(max characters in a message)
	msgmni:     40	(# of message queues)
	msgmnb:   2048	(max characters in a message queue)
	msgtql:     40	(max # of messages in system)
	msgssz:      8	(size of a message segment)
	msgseg:   2048	(# of message segments in system)

shminfo:
	shmmax: 33554432	(max shared memory segment size)
	shmmin:       1	(min shared memory segment size)
	shmmni:     192	(max number of shared memory identifiers)
	shmseg:     128	(max shared memory segments per process)
	shmall:    8192	(max amount of shared memory in pages)

seminfo:
	semmap:     30	(# of entries in semaphore map)
	semmni:     10	(# of semaphore identifiers)
	semmnu:     30	(# of undo structures in system)
	semmsl:     60	(max # of semaphores per id)
	semopm:    100	(max # of operations per semop call)
	semume:     10	(max # of undo entries per process)
	semusz:     92	(size in bytes of undo structure)
	semvmx:  32767	(semaphore maximum value)
	semaem:  16384	(adjust on exit max value)


------------------------------------------------------------------------
nfsstat

Client Info:
Rpc Counts:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
        0         0         0         0         0         0         0         0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
        0         0         0         0         0         0         0         0
    Mknod    Fsstat    Fsinfo  PathConf    Commit    GLease    Vacate     Evict
        0         0         0         0         0         0         0         0
Rpc Info:
 TimedOut   Invalid X Replies   Retries  Requests
        0         0         0         0         0
Cache Info:
Attr Hits    Misses Lkup Hits    Misses BioR Hits    Misses BioW Hits    Misses
        0         0         0         0         0         0         0         0
BioRLHits    Misses BioD Hits    Misses DirE Hits    Misses
        0         0         0         0         0         0

Server Info:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
        0         0         0         0         0         0         0         0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
        0         0         0         0         0         0         0         0
    Mknod    Fsstat    Fsinfo  PathConf    Commit    GLease    Vacate     Evict
        0         0         0         0         0         0         0         0
Server Ret-Failed
                0
Server Faults
            0
Server Cache Stats:
   Inprog      Idem  Non-idem    Misses
        0         0         0         0
Server Lease Stats:
   Leases     PeakL   GLeases
        0         0         0
Server Write Gathering:
 WriteOps  WriteRPC   Opsaved
        0         0         0

------------------------------------------------------------------------
netstat -s

tcp:
	0 packets sent
		0 data packets (0 bytes)
		0 data packets (0 bytes) retransmitted
		0 Fast Retransmits (0 early)
		0 packets sent by Limited Transmit
		0 spurious RTO retransmits
		0 spurious Fast Retransmits (0 early)
		0 Eifel-detected spurious retransmits
		0 RTT-detected spurious retransmits
		0 resends initiated by MTU discovery
		0 ack-only packets (0 delayed)
		0 URG only packets
		0 window probe packets
		0 window update packets
		0 control packets
	4 packets received
		0 acks (for 0 bytes)
		0 duplicate acks
		0 acks for unsent data
		0 packets (0 bytes) received in-sequence
		0 completely duplicate packets (0 bytes)
		0 old duplicate packets
		0 packets with some dup. data (0 bytes duped)
		0 out-of-order packets (0 bytes)
		0 packets (0 bytes) of data after window
		0 window probes
		0 window update packets
		0 packets received after close
		0 discarded for bad checksums
		0 discarded for bad header offset fields
		0 discarded because packet too short
	0 connection requests
	0 connection accepts
	0 bad connection attempts
	0 listen queue overflows
	0 connections established (including accepts)
	0 connections closed (including 0 drops)
		0 connections updated cached RTT on close
		0 connections updated cached RTT variance on close
		0 connections updated cached ssthresh on close
	0 embryonic connections dropped
	0 segments updated rtt (of 0 attempts)
	0 retransmit timeouts
		0 connections dropped by rexmit timeout
	0 persist timeouts
		0 connections dropped by persist timeout
	0 keepalive timeouts
		0 keepalive probes sent
		0 connections dropped by keepalive
	0 correct ACK header predictions
	0 correct data packet header predictions
	0 syncache entries added
		0 retransmitted
		0 dupsyn
		0 dropped
		0 completed
		0 bucket overflow
		0 cache overflow
		0 reset
		0 stale
		0 aborted
		0 badack
		0 unreach
		0 zone failures
	0 cookies sent
	0 cookies received
udp:
	64 datagrams received
	0 with incomplete header
	0 with bad data length field
	0 with bad checksum
	0 with no checksum
	54 dropped due to no socket
	10 broadcast/multicast datagrams dropped due to no socket
	0 dropped due to full socket buffers
	0 not for hashed pcb
	0 delivered
	8 datagrams output
ip:
	231 total packets received
	0 bad header checksums
	0 with size smaller than minimum
	0 with data size < data length
	0 with ip length > max ip packet size
	0 with header length < data size
	0 with data length < header length
	0 with bad options
	0 with incorrect version number
	0 fragments received
	0 fragments dropped (dup or out of space)
	0 fragments dropped after timeout
	0 packets reassembled ok
	38 packets for this host
	0 packets for unknown/unsupported protocol
	132 packets forwarded (0 packets fast forwarded)
	5 packets not forwardable
	0 packets received for unknown multicast group
	0 redirects sent
	88 packets sent from this host
	0 packets sent with fabricated ip header
	0 output packets dropped due to no bufs, etc.
	4 output packets discarded due to no route
	0 output datagrams fragmented
	0 fragments created
	0 datagrams that can't be fragmented
	0 tunneling packets that can't find gif
	0 datagrams with bad address in header
icmp:
	80 calls to icmp_error
	0 errors not generated 'cuz old message was icmp
	Output histogram:
		destination unreachable: 80
	0 messages with bad code fields
	0 messages < minimum length
	0 bad checksums
	0 messages with bad length
	0 multicast echo requests ignored
	0 multicast timestamp requests ignored
	0 message responses generated
	0 invalid return addresses
	0 no return routes
	ICMP address mask responses are disabled
igmp:
	0 messages received
	0 messages received with too few bytes
	0 messages received with bad checksum
	0 membership queries received
	0 membership queries received with invalid field(s)
	0 membership reports received
	0 membership reports received with invalid field(s)
	0 membership reports received for groups to which we belong
	0 membership reports sent
ip6:
	59 total packets received
	0 with size smaller than minimum
	0 with data size < data length
	0 with bad options
	0 with incorrect version number
	0 fragments received
	0 fragments dropped (dup or out of space)
	0 fragments dropped after timeout
	0 fragments that exceeded limit
	0 packets reassembled ok
	30 packets for this host
	0 packets forwarded
	4 packets not forwardable
	0 redirects sent
	73 packets sent from this host
	0 packets sent with fabricated ip header
	0 output packets dropped due to no bufs, etc.
	0 output packets discarded due to no route
	0 output datagrams fragmented
	0 fragments created
	0 datagrams that can't be fragmented
	0 packets that violated scope rules
	4 multicast packets which we don't join
	Input histogram:
		hop by hop: 6
		UDP: 30
		ICMP6: 23
	Mbuf statistics:
		23 one mbuf
		two or more mbuf:
			faith0= 2
		34 one ext mbuf
		0 two or more ext mbuf
	0 packets whose headers are not continuous
	0 tunneling packets that can't find gif
	0 packets discarded due to too may headers
	0 failures of source address selection
	source addresses on an outgoing I/F
		4 node-locals
	source addresses of same scope
		4 node-locals
	47 forward cache hit
	1 forward cache miss
icmp6:
	30 calls to icmp_error
	0 errors not generated because old message was icmp error or so
	0 errors not generated because rate limitation
	Output histogram:
		unreach: 30
		echo reply: 10
		multicast listener report: 17
		neighbor solicitation: 9
		neighbor advertisement: 3
	0 messages with bad code fields
	0 messages < minimum length
	0 bad checksums
	0 messages with bad length
	Input histogram:
		unreach: 4
		echo: 10
		multicast listener report: 2
		neighbor solicitation: 4
		neighbor advertisement: 5
	Histogram of error messages to be generated:
		0 no route
		0 administratively prohibited
		0 beyond scope
		0 address unreachable
		30 port unreachable
		0 packet too big
		0 time exceed transit
		0 time exceed reassembly
		0 erroneous header field
		0 unrecognized next header
		0 unrecognized option
		0 redirect
		0 unknown
	10 message responses generated
	0 messages with too many ND options
	0 messages with bad ND options
	0 bad neighbor solicitation messages
	0 bad neighbor advertisement messages
	0 bad router solicitation messages
	0 bad router advertisement messages
	0 bad redirect messages
	0 path MTU changes

------------------------------------------------------------------------
netstat -m

18/111936 mbufs in use (current/max):
432/6656 mbuf clusters in use (current/max)
	447 mbufs and mbuf clusters allocated to data
	3 mbufs and mbuf clusters allocated to socket names and addresses
873 Kbytes allocated to network (1% of mb_map in use)
0 requests for memory denied
0 requests for memory delayed
0 calls to protocol drain routines

------------------------------------------------------------------------
netstat -id

Name    Mtu   Network       Address            Ipkts Ierrs    Opkts Oerrs  Coll Drop
em0     1500  <Link#1>    00:0e:0c:a1:aa:7b   227472     0   325991     0     0   0
em0     1500  192.168.2     192.168.2.253       3427     -     1391     -     -   -
em0     1500  fe80:1::20e fe80:1::20e:cff:f        0     -       34     -     -   -
em0     1500  pizza.zefyr 2001:7a8:bd07:2::     7267     -     2975     -     -   -
xl0     1500  <Link#2>    00:04:76:f2:b4:a2   337081     4   230190     0   741   0
xl0     1500  192.168.0     192.168.0.253          0     -        0     -     -   -
xl0     1500  fe80:2::204 fe80:2::204:76ff:        0     -        3     -     -   -
faith0  1500  <Link#3>                             2     0        2     0     0   0
faith0  1500  fe80:3::20e fe80:3::20e:cff:f        0     -        2     -     -   -
lo0     16384 <Link#4>                           962     0      962     0     0   0
lo0     16384 your-net      localhost              0     -        0     -     -   -
lo0     16384 localhost   ::1                    962     -      962     -     -   -
lo0     16384 fe80:4::1   fe80:4::1                0     -        0     -     -   -
ppp0*   1500  <Link#5>                             0     0        0     0     0   0
sl0*    552   <Link#6>                             0     0        0     0     0   0
tun0    1492  <Link#7>                        336076     0   229251     0    18   0
tun0    1492  fe80:7::20e fe80:7::20e:cff:f        1     -     6554     -     -   -
tun0    1492  gw/32         gw                  2081     -     2073     -     -   -
pfsync0 1940  <Link#8>                             0     0        0     0     0   0
pflog0* 33548 <Link#9>                             0     0        0     0     0   0

------------------------------------------------------------------------
netstat -anr

Routing tables

Internet:
Destination        Gateway            Flags    Refs      Use  Netif Expire
default            62.4.16.234        UGSc        6    49122   tun0       
62.4.16.70         62.4.16.234        UGHW3       0      992   tun0   2158
62.4.16.80         62.4.16.234        UGHW        1       48   tun0       
62.4.16.234        213.41.253.7       UH          6        0   tun0       
127.0.0.1          127.0.0.1          UH          0        0    lo0       
131.252.210.177    62.4.16.234        UGHW3       0       24   tun0
192.168.0          link#2             UC          0        0    xl0
192.168.2          link#1             UC          7        0    em0
192.168.2.5        00:13:d3:b7:1d:b3  UHLW        0     5869    em0
192.168.2.8        00:30:48:d5:c1:80  UHLW        1      683    em0
192.168.2.10       00:14:bf:4e:69:bd  UHLW        0       53    em0
192.168.2.12       00:19:d1:81:0e:03  UHLW        0    25140    em0
192.168.2.13       00:19:d1:81:0e:03  UHLW        0    10695    em0
192.168.2.18       00:25:90:05:71:40  UHLW        0      331    em0
192.168.2.20       00:14:85:44:92:98  UHLW        2    50684    em0
209.85.214.51      62.4.16.234        UGHW3       0       30   tun0   1271
213.215.11.28      62.4.16.234        UGHW3       0     1271   tun0   2400

Internet6:
Destination                       Gateway                       Flags      Netif Expire
::/96                             fe80::20e:d6ff:fe98:a01b%tun0 UGRSc      tun0        =>
default                           fe80::20e:d6ff:fe98:a01b%tun0 UGSc       tun0       
::1                               ::1                           UH          lo0       
::ffff:0.0.0.0/96                 ::1                           UGRSc       lo0       
2001:218:2007:1::3dd5:bd7b        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2359
2001:2f0:104:e002::2              fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:c01:2::ccc9:a04a         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2124
2001:418:c01:3::c668:c84a         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2148
2001:418:c01:4::cc02:91c9         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2129
2001:418:1001:3::9dee:5b62        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2374
2001:418:1401::a5fe:357a          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2071
2001:418:1401:1::a5fe:5c53        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2333
2001:418:1401:2::a5fe:9519        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:1401:3::a5fe:2a0         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2245
2001:418:1401:4::a5fe:7f7c        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:1401:5::cc02:c453        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2244
2001:418:1401:6::a5fe:227a        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2127
2001:418:1c01::8cae:184a          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2186
2001:418:1c01:1::8cae:b62         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2187
2001:418:2007:1::a88f:f128        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2297
2001:418:2401::cc02:e463          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2091
2001:418:2401:1::c63f:c262        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2185
2001:418:2401:2::c63f:e704        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2309
2001:418:2401:3::c6ad:1552        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2149
2001:418:2401:4::c63f:c462        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2360
2001:418:2401:5::cf98:7c51        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2167
2001:418:2401:6::c63f:cb53        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2106
2001:418:2401:7::c6ad:273         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   1976
2001:418:3801::cc02:d753          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2167
2001:418:3801:1::cc02:d83b        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2387
2001:418:3801:2::cc00:3b4a        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2385
2001:418:3801:3::cc02:d080        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2137
2001:418:3801:4::cc00:381         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:3801:4::cc00:383         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2253
2001:418:3801:5::cc00:5653        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:4000:7::cc01:892d        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   1602
2001:418:4001::cc02:a653          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2369
2001:418:4001:1::cc02:ab23        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2337
2001:418:4001:2::6011:9b78        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2182
2001:418:4001:3::c657:b0c4        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2322
2001:418:4001:4::cc02:a478        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2114
2001:418:4001:5::9dee:c553        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2071
2001:418:4001:6::c6ad:a0e2        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:5401::cc02:f388          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2203
2001:418:5401:1::cc02:fe4a        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2203
2001:418:5401:1::cc02:fe53        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:5401:2::6011:a253        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2228
2001:418:5403::c0cc:318           fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2050
2001:418:8001:2::cc02:b34a        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2152
2001:418:8001:3::a88f:f2c3        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0    921
2001:418:8007::cc02:bb6b          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2285
2001:418:8404::cc02:a0b6          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2352
2001:418:8404:1::80f1:da7e        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2197
2001:418:8404:2::cc02:854a        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:418:8404:2::cc02:8553        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2276
2001:418:8404:3::cc02:8853        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2232
2001:418:8404:4::80f1:d972        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2391
2001:418:8404:5::6011:a753        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2077
2001:418:8404:6::c657:36c4        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2254
2001:418:9803::c657:3312          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2266
2001:428:c02:1ff::3fea:f87b       fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2146
2001:428:1802:301::d1d3:c97b      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2359
2001:428:2001:205::3feb:14cb      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2057
2001:428:2002::d8ce:1e6e          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2314
2001:428:2402:5::3feb:2483        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2352
2001:428:4c02:1::4171:1feb        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2274
2001:428:7000:2::3feb:1ccb        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2262
2001:428:7006::3f92:466e          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2303
2001:450:2002:da::d032:7078       fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2071
2001:450:2002:2a5::40d1:2411      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2303
2001:450:2002:2e9::40d2:6442      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2145
2001:450:2002:2e9::40d2:6443      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:450:2002:2ea::40d3:cb32      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2351
2001:450:2002:2eb::40d0:f13a      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2208
2001:450:2002:2fc::40d0:9f31      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2127
2001:450:2002:30b::9252:228       fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2293
2001:450:2002:30d::d030:11aa      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2254
2001:450:2002:30e::40d7:9edb      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2275
2001:450:2002:317::9252:c0fb      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2353
2001:450:2002:319::ccf5:651       fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2395
2001:450:2002:319::ccf5:682       fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:450:2002:31b::d032:51a8      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:450:2002:31b::d032:51aa      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2243
2001:450:2002:31d::40d3:904a      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2336
2001:450:2002:345::40d0:7e4a      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2127
2001:450:2002:3a0::d032:4f80      fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2164
2001:450:2025:1::d033:dd53        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2325
2001:450:2030::ccf5:176f          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2293
2001:470:1:211::4131:4a43         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2362
2001:470:1:212::4131:5c78         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2250
2001:470:1:213::4131:5a4a         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2243
2001:470:1:214::d842:84a          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2051
2001:470:1:215::d842:1f53         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2278
2001:4f8:fff6::35                 fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:500:2f::f                    fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:503:c27::2:30                fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:503:a83e::2:30               fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:559:0:40::6011:4b81          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2337
2001:559:0:41::6011:6faf          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0     77
2001:559:0:42::6011:a4b9          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:559:0:43::6011:a882          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2069
2001:559:0:44::6011:ab79          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:559:0:44::6011:ab83          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2066
2001:559:0:45::6011:955b          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2174
2001:559:0:46::6006:2d42          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2195
2001:559:0:47::6011:441c          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:559:0:48::6011:4883          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2258
2001:559:0:49::6011:4983          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2384
2001:559:0:4a::6011:a073          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2102
2001:559:0:4b::6011:977a          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2166
2001:559:0:4c::6011:927a          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2285
2001:559:0:4d::6011:934a          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2389
2001:559:0:4f::6011:4d50          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2364
2001:559:0:50::6011:967a          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2372
2001:559:0:51::6006:2cd7          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2127
2001:559:0:52::6011:6c83          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   1366
2001:559:0:54::6011:9478          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   1979
2001:559:0:301::6011:6d72         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2212
2001:590:0:2::d8f6:7acb           fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2055
2001:590:1:100::451f:6a04         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2320
2001:590:1:101::4516:9a73         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2217
2001:590:1:202::451f:1033         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2320
2001:590:1:300::451f:4c2a         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2254
2001:590:1:400::451f:487b         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2260
2001:590:1:501::42ab:e083         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2258
2001:590:1:601::4516:964a         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2154
2001:590:1001::451f:1433          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2344
2001:590:2001::451f:77ef          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2080
2001:590:2001::d030:6e            fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2320
2001:648:2000:de::230             fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:668:106::d5fe:f535           fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2391
2001:680:12:100::3e29:35e         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2164
2001:680:12:200::3e29:3e70        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2385
2001:680:12:210::3e29:806         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2245
2001:680:12:320::3e29:1233        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2259
2001:688:1::5a54:3382             fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0    848
2001:7a8:1:1::70                  fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:7a8:600:1:219:d1ff:fe81:28   fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2399
2001:7a8:bd07:2::253              00:0e:0c:a1:aa:7b             UHL         lo0       
2001:7a8:bd07:2::dead:beef        00:25:90:02:77:ed             UHL         em0       
2001:7a8:bd07:2:213:d3ff:feb7:1db3 00:13:d3:b7:1d:b3             UHL         em0       
2001:7a8:bd07:2:219:d1ff:fe81:e03 00:19:d1:81:0e:03             UHL         em0       
2001:7a8:bd07:2:240:63ff:fed9:1f06 fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2394
2001:7fd::1                       fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:8b0:114:1::2                 fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:978:1:20::1a                 fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:c38:5000:302::3d13:c43       fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2375
2001:d30:3::2301                  fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:41a8:24:5::c316:c84a         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2387
2001:41a8:44:3::4f8c:5e43         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2175
2001:44b8:4020::3ba7:c00c         fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2362
2001:48a8:6880:68::116:162        fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:48c8:7:6::2                  fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0    261
2001:4c48:2::1:3                  fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:5000:402::c33b:2ba6          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   1610
2001:5000:402::c33b:2c32          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2001:5000:402::c33b:2c38          fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2183
2002:5b79:5fdd::1                 fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2600:1404::48f6:379e              fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   2308
2607:fcd0:1337:82::2              fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0   1495
2620:0:2820:22::41                fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2a01:240:fe6a::1                  fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2a01:488::53:283                  fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
2a01:4f8:131:23c2::1              fe80::20e:d6ff:fe98:a01b%tun0 UGHW3      tun0
fe80::/10                         ::1                           UGRSc       lo0       
fe80::%em0/64                     link#1                        UC          em0       
fe80::20e:cff:fea1:aa7b%em0       00:0e:0c:a1:aa:7b             UHL         lo0       
fe80::225:90ff:fe05:7140%em0      00:25:90:05:71:40             UHLW        em0       
fe80::%xl0/64                     link#2                        UC          xl0       
fe80::204:76ff:fef2:b4a2%xl0      00:04:76:f2:b4:a2             UHL         lo0       
fe80::20e:cff:fea1:aa7b%faith0    link#3                        UHL         lo0       
fe80::%lo0/64                     fe80::1%lo0                   Uc          lo0       
fe80::1%lo0                       link#4                        UHL         lo0       
fe80::%tun0/64                    fe80::20e:cff:fea1:aa7b%tun0  Uc         tun0       
fe80::20e:cff:fea1:aa7b%tun0      link#7                        UHL         lo0       
ff01::/32                         ::1                           U           lo0       
ff02::/16                         ::1                           UGRS        lo0       
ff02::%em0/32                     link#1                        UC          em0       
ff02::%xl0/32                     link#2                        UC          xl0       
ff02::%faith0/32                  fe80::20e:cff:fea1:aa7b%faith0 UC       faith0       
ff02::%lo0/32                     ::1                           UC          lo0       
ff02::%tun0/32                    fe80::20e:cff:fea1:aa7b%tun0  UC         tun0       

------------------------------------------------------------------------
netstat -anA

Active UNIX domain sockets
Address  Type   Recv-Q Send-Q    Inode     Conn     Refs  Nextref Addr
c484eed0 dgram       0      0        0 d9cd4150        0        0
d9cd4150 dgram       0      0 d9aa6978        0 c484eed0        0 /var/run/logpriv
d9cd4010 dgram       0      0 d9aa6838        0        0        0 /var/run/log

------------------------------------------------------------------------
netstat -aL


------------------------------------------------------------------------
fstat

Bus error

------------------------------------------------------------------------
dmesg

Copyright (c) 2003-2011 The DragonFly Project.
Copyright (c) 1992-2003 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
MPTABLE: warning duplicated PCI int entry for bus 0, dev 16, pin 0
MPTABLE: warning duplicated PCI int entry for bus 0, dev 16, pin 1
DragonFly v2.10.0.3.g216c0-RELEASE #0: Wed Apr 20 11:01:37 CEST 2011
    ftigeot at pizza.zefyris.com:/usr/obj/usr/src/sys/GENERIC_SMP
TSC clock: 2000023997 Hz, i8254 clock: 1193154 Hz
CPU: Dual Core AMD Opteron(tm) Processor 170 (2000.08-MHz 686-class CPU)
  Origin = "AuthenticAMD"  Id = 0x20f32  Stepping = 2
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x1<SSE3>
  AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
  AMD Features2=0x3<LAHF,CMP>
  Cores per package: 2
real memory  = 2145907712 (2046 MB)
avail memory = 2060570624 (1965 MB)
lapic: at 0xfee00000
lapic: divisor index 0, frequency 100004172 Hz
DragonFly/MP: Multiprocessor motherboard
 cpu0 (BSP): apic id:  0, version: 0x00040010
 cpu1 (AP):  apic id:  1, version: 0x00040010
module_register: module pci/ahci already exists!
Module pci/ahci failed to register: 17
FQ scheduler policy version 1.0 loaded
disk scheduler: set policy of md0 to noop
md0: Malloc disk
kbd1 at kbdmux0
ACPI: RSDP 0xf7910 00014 (v0 K8T890)
ACPI: RSDT 0x7fee3040 00034 (v1 K8T890 AWRDACPI 42302E31 AWRD 00000000)
ACPI: FACP 0x7fee30c0 00074 (v1 K8T890 AWRDACPI 42302E31 AWRD 00000000)
ACPI: DSDT 0x7fee3180 07932 (v1 K8T890 AWRDACPI 00001000 MSFT 0100000E)
ACPI: FACS 0x7fee0000 00040
ACPI: SSDT 0x7feeabc0 00188 (v1 PTLTD  POWERNOW 00000001  LTP 00000001)
ACPI: MCFG 0x7feeadc0 0003C (v1 K8T890 AWRDACPI 42302E31 AWRD 00000000)
ACPI: APIC 0x7feeab00 00074 (v1 K8T890 AWRDACPI 42302E31 AWRD 00000000)
npx0: <math processor> on motherboard
npx0: INT 16 interface
Using XMM optimized bcopy/copyin/copyout
cryptosoft0: <software crypto> on motherboard
acpi0: <K8T890 AWRDACPI> on motherboard
ACPI FADT: SCI testing interrupt mode ...
ACPI FADT: SCI select level/low
objcache_reclaimlist
objcache_reclaimlist
objcache_reclaimlist
objcache_reclaimlist
acpi0: Power Button (fixed)
Warning: ACPI is disabling APM's device.  You can't run both
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <VIA 3238 host to PCI bridge> mem 0xd0000000-0xd7ffffff at device 0.0 on pci0
pci0: <base peripheral, interrupt controller> (vendor 0x1106, dev 0x5238) at device 0.5
pcib1: <MPTABLE PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 27 at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib2
vgapci0: <VGA-compatible display> port 0xa000-0xa0ff mem 0xd9000000-0xd900ffff,0xc0000000-0xcfffffff irq 24 at device 0.0 on pci2
vgapci1: <VGA-compatible display> mem 0xd9010000-0xd901ffff at device 0.1 on pci2
pcib3: <ACPI PCI-PCI bridge> irq 31 at device 3.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 35 at device 3.1 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 39 at device 3.2 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 43 at device 3.3 on pci0
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection 82541GI_LF 6.9.6> port 0xb000-0xb03f mem 0xdb000000-0xdb01ffff,0xdb020000-0xdb03ffff irq 16 at device 11.0 on pci0
em0: MAC address: 00:0e:0c:a1:aa:7b
xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xb400-0xb47f mem 0xdb040000-0xdb04007f irq 17 at device 12.0 on pci0
miibus0: <MII bus> on xl0
xlphy0: <Broadcom 3C905C internal PHY> on miibus0
xlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
xl0: MAC address: 00:04:76:f2:b4:a2
atapci0: <VIA 6420 SATA150 controller> port 0xcc00-0xccff,0xc800-0xc80f,0xc400-0xc403,0xc000-0xc007,0xbc00-0xbc03,0xb800-0xb807 irq 20 at device 15.0 on pci0
ata2: <ATA channel 0> on atapci0
ata3: <ATA channel 1> on atapci0
atapci1: <VIA 8237 UDMA133 controller> port 0xd000-0xd00f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 15.1 on pci0
ata0: <ATA channel 0> on atapci1
disk scheduler: set policy of ad0 to noop
ad0: 114440MB <WDC WD1200JB-75CRA0 16.06V16> at ata0-master UDMA100
ata1: <ATA channel 1> on atapci1
uhci0: <VIA 83C572 USB controller> port 0xd400-0xd41f irq 21 at device 16.0 on pci0
usb0: <VIA 83C572 USB controller> on uhci0
usb0: USB revision 1.0
uhub0: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <VIA 83C572 USB controller> port 0xd800-0xd81f irq 21 at device 16.1 on pci0
usb1: <VIA 83C572 USB controller> on uhci1
usb1: USB revision 1.0
uhub1: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <VIA 83C572 USB controller> port 0xdc00-0xdc1f irq 21 at device 16.2 on pci0
usb2: <VIA 83C572 USB controller> on uhci2
usb2: USB revision 1.0
uhub2: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
uhci3: <VIA 83C572 USB controller> port 0xe000-0xe01f irq 21 at device 16.3 on pci0
usb3: <VIA 83C572 USB controller> on uhci3
usb3: USB revision 1.0
uhub3: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb3
uhub3: 2 ports with 2 removable, self powered
ehci0: <VIA VT6202 USB 2.0 controller> mem 0xdb041000-0xdb0410ff irq 21 at device 16.4 on pci0
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <VIA VT6202 USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: <VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb4
uhub4: 8 ports with 8 removable, self powered
isab0: <PCI-ISA bridge> at device 17.0 on pci0
isa0: <ISA bus> on isab0
acpi_tz0: <Thermal Zone> on acpi0
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 on acpi0
sio0: type 16550A
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: model IntelliMouse Explorer, device ID 4
cpu0: <ACPI CPU> on acpi0
cpu_cst0: <ACPI CPU C-State> on cpu0
cpu_pst0: <ACPI CPU P-State> on cpu0
cpu1: <ACPI CPU> on acpi0
cpu_cst1: <ACPI CPU C-State> on cpu1
cpu_pst1: <ACPI CPU P-State> on cpu1
orm0: <Option ROMs> at iomem 0xc0000-0xcffff,0xd0000-0xd0fff,0xd1000-0xd17ff on isa0
pmtimer0 on isa0
fdc0: ready for input in output
fdc0: cmd 3 failed at out byte 1 of 3
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
lm0: <Winbond W83627EHF Hardware Monitor> at port 0x290-0x297 on isa0
wbsio0: <Winbond LPC Super I/O W83627EHF rev 0x63> at port 0x2e-0x2f on isa0
wbsio0: hardware monitor iobase is 0x290
wbsio0: lm0 is already attached at 0x290
sio2: can't drain, serial port might not exist, disabling
ppc0: parallel port not found.
cpu1: only one P-State is supported
ACPI: domain1 P-State configuration check failed
cpu0: only one P-State is supported
ACPI: domain0 P-State configuration check failed
CAM: Configuring 4 busses
CAM: finished configuring all busses
Mounting root from hammer:serno/WD-WMA8C2508466.s1d
tryroot serno/WD-WMA8C2508466.s1d
HAMMER(PIZZA_120G) recovery check seqno=0141d3d9
HAMMER(PIZZA_120G) recovery range 3000000006d02238-3000000006d023f0
HAMMER(PIZZA_120G) recovery nexto 3000000006d02238 endseqno=0141d3dc
HAMMER(PIZZA_120G) recovery undo  3000000006d02238-3000000006d023f0 (440 bytes)(RW)
HAMMER(PIZZA_120G) Found REDO_SYNC 3000000006d02238
HAMMER(PIZZA_120G) recovery complete
HAMMER(PIZZA_120G) recovery redo  3000000006d02238-3000000006d023f0 (440 bytes)(RW)
HAMMER(PIZZA_120G) Embedded extended redo 3000000006d02238, 0 extbytes
HAMMER(PIZZA_120G) End redo recovery
Mounting devfs
/etc/rc: WARNING: $udevd_early is not set properly - see rc.conf(5).
Loading configuration files.
Loading devfs rules:
 /etc/defaults/devfs.conf
. 
dumpon: crash dumps to /dev/serno/WD-WMA8C2508466.s1b (19, 0x20001)
swapon: adding /dev/serno/WD-WMA8C2508466.s1b as swap device
Starting file system checks:
/dev/serno/WD-WMA8C2508466.s1a: 
1113 files, 110847 used, 276200 free 
(656 frags, 34443 blocks, 0.2% fragmentation)
Setting hostname: pizza.zefyris.com.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384
	options=3<RXCSUM,TXCSUM>
	inet 127.0.0.1 netmask 0xff000000 
	inet6 ::1 prefixlen 128 
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING>
	inet 192.168.2.253 netmask 0xffffff00 broadcast 192.168.2.255
	inet6 fe80::20e:cff:fea1:aa7b%em0 prefixlen 64 tentative scopeid 0x1 
	ether 00:0e:0c:a1:aa:7b
	media: Ethernet autoselect
	status: no carrier
xl0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	options=8<VLAN_MTU>
	inet 192.168.0.253 netmask 0xffffff00 broadcast 192.168.0.255
	inet6 fe80::204:76ff:fef2:b4a2%xl0 prefixlen 64 tentative scopeid 0x2 
	ether 00:04:76:f2:b4:a2
	media: Ethernet autoselect (10baseT/UTP)
	status: active
Starting ppp as "root"
Additional routing options:
 IP gateway=YES
. 
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
net.inet6.ip6.forwarding: 
0
 -> 
1

net.inet6.ip6.accept_rtadv: 
0
 -> 
0

em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING>
	inet6 fe80::20e:cff:fea1:aa7b%em0 prefixlen 64 scopeid 0x1 
	inet6 2001:7a8:bd07:2::253 prefixlen 64 tentative 
xl0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	options=8<VLAN_MTU>
	inet6 fe80::204:76ff:fef2:b4a2%xl0 prefixlen 64 scopeid 0x2 
faith0: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
	inet6 fe80::20e:cff:fea1:aa7b%faith0 prefixlen 64 scopeid 0x3 
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384
	options=3<RXCSUM,TXCSUM>
	inet6 ::1 prefixlen 128 
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 
ppp0: flags=8010<POINTOPOINT,MULTICAST> mtu 1500
sl0: flags=c010<POINTOPOINT,LINK2,MULTICAST> mtu 552
tun0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1500
	Opened by PID 291
add net fe80::: gateway ::1
add net ff02::: gateway ::1
IPv4 mapped IPv6 address support=NO
hw.bus.devctl_disable: 
0
 -> 
1

Mounting NFS file systems:
. 
Building databases...
Starting syslogd.
Apr 23 08:05:29 pizza syslogd: kernel boot file is /boot/kernel/kernel
Apr 23 08:05:29 pizza ppp[291]: Error: rt_Set: Cannot add a route with gateway 0.0.0.0
No core dumps found.
. 
ELF ldconfig path: /usr/lib /usr/lib/gcc41 /usr/lib/gcc44 /usr/lib/compat /usr/pkg/lib /usr/local/lib
/etc/rc: INFO: pf module loaded.
Enabling pf.
pf enabled
Starting dntpd.
Starting local daemons:
. 
Updating motd.
Starting rtadvd.
Configuring syscons:
 keymap
 blanktime
. 
Starting sshd.
Starting sendmail.
Additional ABI support:
. 
Starting cron.
Local package initialization:
Starting dhcpd.
Internet Systems Consortium DHCP Server 4.2.1-P1

Copyright 2004-2011 Internet Systems Consortium.

All rights reserved.

For info, please visit https://www.isc.org/software/dhcp/

Wrote 0 deleted host decls to leases file.

Wrote 0 new dynamic host decls to leases file.

Wrote 3 leases to leases file.



No subnet declaration for faith0 (no IPv4 addresses).
Apr 23 08:05:40 pizza dhcpd: 

** Ignoring requests on faith0.  If this is not what

   you want, please write a subnet declaration

   in your dhcpd.conf file for the network segment

   to which interface faith0 is attached. **

Apr 23 08:05:40 pizza dhcpd: No subnet declaration for faith0 (no IPv4 addresses).




No subnet declaration for xl0 (192.168.0.253).

** Ignoring requests on xl0.  If this is not what

   you want, please write a subnet declaration

Apr 23 08:05:40 pizza dhcpd: ** Ignoring requests on faith0.  If this is not what
   in your dhcpd.conf file for the network segment

   to which interface xl0 is attached. **



Apr 23 08:05:40 pizza dhcpd:    you want, please write a subnet declaration
Listening on BPF/em0/00:0e:0c:a1:aa:7b/192.168.2.0/24

Sending on   BPF/em0/00:0e:0c:a1:aa:7b/192.168.2.0/24

Apr 23 08:05:40 pizza dhcpd:    in your dhcpd.conf file for the network segment
Sending on   Socket/fallback/fallback-net

Apr 23 08:05:40 pizza dhcpd:    to which interface faith0 is attached. **
Apr 23 08:05:40 pizza dhcpd: 
Apr 23 08:05:40 pizza dhcpd: 
Apr 23 08:05:40 pizza dhcpd: No subnet declaration for xl0 (192.168.0.253).
Apr 23 08:05:40 pizza dhcpd: ** Ignoring requests on xl0.  If this is not what
Apr 23 08:05:40 pizza dhcpd:    you want, please write a subnet declaration
Apr 23 08:05:40 pizza dhcpd:    in your dhcpd.conf file for the network segment
Apr 23 08:05:40 pizza dhcpd:    to which interface xl0 is attached. **
Apr 23 08:05:40 pizza dhcpd: 
Starting miltergreylist.
Starting munin_node.
/usr/pkg/etc/rc.d/named9: WARNING: $named is not set properly - see rc.conf(5).
Starting named.
Apr 23 08:05:42 pizza named[833]: none:0: open: /etc/rndc.key: file not found
Apr 23 08:05:42 pizza named[833]: none:0: open: /etc/rndc.key: file not found
Apr 23 08:05:42 pizza named[833]: managed-keys-zone ./IN: loading from master file managed-keys.bind failed: file not found
 (skipping snmpd, not executable)
. 
Additional TCP options:
. 
Starting inetd.

Sat Apr 23 08:05:43 CEST 2011
panic: assertion: sb->sb_mb == NULL in sbunlinkmbuf
cpuid = 1
Trace beginning at frame 0xd9cccb50
panic(ffffffff,1,c067243b,d9cccb84,d6a257d8) at panic+0x19d
panic(c067243b,c06917d5,c0652b97,c4913600,c4a02c00) at panic+0x19d
sbunlinkmbuf(c491364c,c4a02c00,d9cccbec,1,c4913670) at sbunlinkmbuf+0xb9
soreceive(c4913600,d9cccc7c,d9cccc88,0,0) at soreceive+0x63c
kern_recvmsg(1,d9cccc7c,d9cccc88,0,d9cccd0c) at kern_recvmsg+0x13c
sys_recvfrom(d9ccccf0,d9cccd00,18,ff809a6c,ff809000) at sys_recvfrom+0xd1
syscall2(d9cccd40) at syscall2+0x26f
Xint0x80_syscall() at Xint0x80_syscall+0x36
Debugger("panic")

CPU1 stopping CPUs: 0x00000001
 stopped
Physical memory: 2037 MB
Dumping 217 MB: 202 186 170 154 138 122 106 90 74 58 42 26 10





More information about the Bugs mailing list