dual port EM nic wedging under load

[Mike Tancsa]

At 08:56 PM 11/23/2006, Sepherosa Ziehau wrote:
On 11/24/06, Mike Tancsa <mike at sentex.net> wrote:

Can you post the output of em's debug_info sysctl?
I did a full cvsup upto today to see if it would help just in case 
there was some issue with the kernel I downloaded. Also wanted to see 
if SMP/APIC_IO would make a difference, but no difference.

Pre wedge

em0: Adapter hardware address = 0xd38f61b0
em0: CTRL  = 0x180c0241
em0: RCTL  = 0x0 PS=(0x8402)
em0: Packet buffer = Tx=10k Rx=38k
em0: Flow control watermarks high = 36864 low = 35364
em0: tx_int_delay = 0, tx_abs_int_delay = 0
em0: rx_int_delay = 0, rx_abs_int_delay = 0
em0: fifo workaround = 0, fifo_reset = 0
em0: hw tdh = 0, hw tdt = 0
em0: Num Tx descriptors avail = 0
em0: Tx Descriptors not avail1 = 0
em0: Tx Descriptors not avail2 = 0
em0: Std mbuf failed = 0
em0: Std mbuf cluster failed = 0
em0: Driver dropped packets = 0
post wedge

em0: Adapter hardware address = 0xd38f61b0
em0: CTRL  = 0x180c0241
em0: RCTL  = 0x8002 PS=(0x8402)
em0: Packet buffer = Tx=16k Rx=32k
em0: Flow control watermarks high = 30720 low = 29220
em0: tx_int_delay = 66, tx_abs_int_delay = 66
em0: rx_int_delay = 0, rx_abs_int_delay = 66
em0: fifo workaround = 0, fifo_reset = 0
em0: hw tdh = 5, hw tdt = 5
em0: Num Tx descriptors avail = 256
em0: Tx Descriptors not avail1 = 0
em0: Tx Descriptors not avail2 = 0
em0: Std mbuf failed = 0
em0: Std mbuf cluster failed = 2
em0: Driver dropped packets = 2
em1: Adapter hardware address = 0xd38f68b0
em1: CTRL  = 0x180c0241
em1: RCTL  = 0x8002 PS=(0x8402)
em1: Packet buffer = Tx=16k Rx=32k
em1: Flow control watermarks high = 30720 low = 29220
em1: tx_int_delay = 66, tx_abs_int_delay = 66
em1: rx_int_delay = 0, rx_abs_int_delay = 66
em1: fifo workaround = 0, fifo_reset = 0
em1: hw tdh = 95, hw tdt = 95
em1: Num Tx descriptors avail = 256
em1: Tx Descriptors not avail1 = 0
em1: Tx Descriptors not avail2 = 0
em1: Std mbuf failed = 0
em1: Std mbuf cluster failed = 0
em1: Driver dropped packets = 0
em1: Adapter: 0xd38f65b8
em1: Excessive collisions = 0
em1: Symbol errors = 0
em1: Sequence errors = 0
em1: Defer count = 0
em1: Missed Packets = 0
em1: Receive No Buffers = 0
em1: Receive length errors = 0
em1: Receive errors = 0
em1: Crc errors = 0
em1: Alignment errors = 0
em1: Carrier extension errors = 0
em1: RX overruns = 0
em1: Watchdog timeouts = 0
em1: XON Rcvd = 0
em1: XON Xmtd = 0
em1: XOFF Rcvd = 0
em1: XOFF Xmtd = 0
em1: Good Packets Rcvd = 4
em1: Good Packets Xmtd = 5727
em0: Adapter: 0xd38f5eb8
em0: Excessive collisions = 0
em0: Symbol errors = 0
em0: Sequence errors = 0
em0: Defer count = 0
em0: Missed Packets = 4408330
em0: Receive No Buffers = 1471
em0: Receive length errors = 0
em0: Receive errors = 0
em0: Crc errors = 0
em0: Alignment errors = 0
em0: Carrier extension errors = 0
em0: RX overruns = 1
em0: Watchdog timeouts = 0
em0: XON Rcvd = 0
em0: XON Xmtd = 0
em0: XOFF Rcvd = 0
em0: XOFF Xmtd = 4408331
em0: Good Packets Rcvd = 6390
em0: Good Packets Xmtd = 5
[r2-dragonfly]# uname -a
DragonFly r2-dragonfly.sentex.ca 1.7.0-DEVELOPMENT DragonFly 
1.7.0-DEVELOPMENT #0: Thu Nov 23 17:53:52 EST 
2006     mdtancsa at r2-dragonfly.sentex.ca:/usr/obj/usr/src/sys/router  pc32




em0: Adapter: 0xda491ec0
em0: Excessive collisions = 0
em0: Symbol errors = 0
em0: Sequence errors = 0
em0: Defer count = 0
em0: Missed Packets = 7202325
em0: Receive No Buffers = 1472
em0: Receive length errors = 0
em0: Receive errors = 0
em0: Crc errors = 0
em0: Alignment errors = 0
em0: Carrier extension errors = 0
em0: XON Rcvd = 0
em0: XON Xmtd = 5
em0: XOFF Rcvd = 0
em0: XOFF Xmtd = 7202331
em0: Good Packets Rcvd = 6560
em0: Good Packets Xmtd = 16
em1: Adapter: 0xda492540
em1: Excessive collisions = 0
em1: Symbol errors = 0
em1: Sequence errors = 0
em1: Defer count = 0
em1: Missed Packets = 0
em1: Receive No Buffers = 0
em1: Receive length errors = 0
em1: Receive errors = 0
em1: Crc errors = 0
em1: Alignment errors = 0
em1: Carrier extension errors = 0
em1: XON Rcvd = 0
em1: XON Xmtd = 0
em1: XOFF Rcvd = 0
em1: XOFF Xmtd = 0
em1: Good Packets Rcvd = 5
em1: Good Packets Xmtd = 5909
as seen leading up to and during the wedge
[r2-dragonfly]# netstat -ni 1
             input        (Total)           output
    packets  errs      bytes    packets  errs      bytes colls
          0     0          0          0     0          0     0
          1     0         60          0     0          0     0
          0     0          0          0     0          0     0
          1     0         60          0     0          0     0
          0     0          0          0     0          0     0
       5889 279836     419388       5888     0     376832     0
          0 380706          0          0     0          0     0
          0 379626          0          0     0          0     0
          1 382278         60          0     0          0     0


--------------------------------------------------------------------
Mike Tancsa,                                      tel +1 519 651 3400
Sentex Communications,                            mike at sentex.net
Providing Internet since 1994                    www.sentex.net
Cambridge, Ontario Canada                         www.sentex.net/mike


--
Live Free or Die