Discussion:
[j-nsp] L3 incompletes
Phil Rosenthal
2003-12-05 21:40:24 UTC
Permalink
I noticed that all of my links between my Junipers and my Bigirons that
are doing vlan tagging have about 4 "L3 incompletes" per second
(monitor interface ge-x/y/z).


Per juniper:
http://www.junipernetworks.lt/techpubs/software/junos/junos55/
swcmdref55-interfaces/html/vt-monitor2.html
? L3 incompletes
This counter is incremented when the incoming packet fails Layer 3
(usually IPv4) sanity checks of the header. For example, a frame with
less than 20 bytes of available IP header would be discarded and this
counter would be incremented.

Has anyone ever bothered to try to figure out what these packets are?

--Phil Rosenthal
ISPrime, Inc.
Chris Robb
2003-12-06 22:04:45 UTC
Permalink
I believe we've always believed they were CDP packets. Dunno where that
thought originated from, but I'd be interested if anyone else has dug
any deeper.

-Chris
Post by Phil Rosenthal
I noticed that all of my links between my Junipers and my Bigirons
that are doing vlan tagging have about 4 "L3 incompletes" per second
(monitor interface ge-x/y/z).
http://www.junipernetworks.lt/techpubs/software/junos/junos55/
swcmdref55-interfaces/html/vt-monitor2.html
? L3 incompletes
This counter is incremented when the incoming packet fails Layer 3
(usually IPv4) sanity checks of the header. For example, a frame with
less than 20 bytes of available IP header would be discarded and this
counter would be incremented.
Has anyone ever bothered to try to figure out what these packets are?
--Phil Rosenthal
ISPrime, Inc.
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
Chris Robb
Indiana University Global NOC Engineer
***@indiana.edu Desk: 812-855-8604
Jeff Groth
2003-12-08 03:23:06 UTC
Permalink
That was my understanding as well. CDP packets.

Jeff
(currently on Juniper withdrawal)
-----Original Message-----
Sent: Saturday, December 06, 2003 4:03 PM
To: Phil Rosenthal
Subject: Re: [j-nsp] L3 incompletes
I believe we've always believed they were CDP packets. Dunno
where that
thought originated from, but I'd be interested if anyone else
has dug
any deeper.
-Chris
Post by Phil Rosenthal
I noticed that all of my links between my Junipers and my Bigirons
that are doing vlan tagging have about 4 "L3 incompletes"
per second
Post by Phil Rosenthal
(monitor interface ge-x/y/z).
http://www.junipernetworks.lt/techpubs/software/junos/junos55/
swcmdref55-interfaces/html/vt-monitor2.html
? L3 incompletes
This counter is incremented when the incoming packet fails Layer 3
(usually IPv4) sanity checks of the header. For example, a
frame with
Post by Phil Rosenthal
less than 20 bytes of available IP header would be
discarded and this
Post by Phil Rosenthal
counter would be incremented.
Has anyone ever bothered to try to figure out what these
packets are?
Post by Phil Rosenthal
--Phil Rosenthal
ISPrime, Inc.
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
Chris Robb
Indiana University Global NOC Engineer
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
Christopher Morrow
2003-12-08 04:39:17 UTC
Permalink
Post by Jeff Groth
That was my understanding as well. CDP packets.
Jeff
(currently on Juniper withdrawal)
Could you not log based on packet size SMALLER than the limit that
would equal the 'incompletes' size and see what got logged?
Eric Van Tol
2003-12-08 15:37:04 UTC
Permalink
Policed discards are the CDP packets. CDP is a layer 2 protocol, not
layer 3.

-----Original Message-----
From: Christopher Morrow [mailto:***@ops-netman.net]
Sent: Sunday, December 07, 2003 10:39 PM
To: ***@groth.com
Cc: 'Phil Rosenthal'; juniper-***@puck.nether.net
Subject: Re: [j-nsp] L3 incompletes
Post by Jeff Groth
That was my understanding as well. CDP packets.
Jeff
(currently on Juniper withdrawal)
Could you not log based on packet size SMALLER than the limit that
would equal the 'incompletes' size and see what got logged?

_______________________________________________
juniper-nsp mailing list juniper-***@puck.nether.net
http://puck.nether.net/mailman/listinfo/juniper-nsp
Niels Bakker
2003-12-08 15:54:24 UTC
Permalink
Post by Eric Van Tol
Policed discards are the CDP packets. CDP is a layer 2 protocol, not
layer 3.
Or BPDUs (spanning-tree) originating from your switch, as the case may be


-- Niels.

--
bbird at epik.net ()
2003-12-08 19:04:17 UTC
Permalink
#-----Original Message-----
#From: Christopher Morrow [mailto:***@ops-netman.net]
#Sent: Sunday, December 07, 2003 10:39 PM
#To: ***@groth.com
#Cc: 'Phil Rosenthal'; juniper-***@puck.nether.net
#Subject: Re: [j-nsp] L3 incompletes
#
#
#On Dec 8, 2003, at 2:26 AM, Jeff Groth wrote:
#
#> That was my understanding as well. CDP packets.
#>
#> Jeff
#> (currently on Juniper withdrawal)
#>
#>
#
#Could you not log based on packet size SMALLER than the limit that
#would equal the 'incompletes' size and see what got logged?

One of our health reports recently indicated a small number of input
errors ( < 1 /sec.), on a Juniper gigE interface. This is derived
via SNMP ifInErrors counter. I did verify that L3 incompletes are,
by design, meant to be included in this counter (a knob would be
nice). I also verified that the L3 incompletes are the cause of the
SNMP reported errors. The interesting part is that the device this
GigE is connected to is a Foundry, which has FDP/CDP disabled. It is
also worth mentioning that spanning-tree is disabled on this
interface. So these are not BPDU's
CDP should not be counted as a L3 incomplete, and Juniper's web page
concurs. Juniper's web site reads that CDP will be counted as
'Policed Discards', not 'L3 incompletes'. Based on my interpretation
of Juniper's definitions of their counters, 'Policed Discards' and
'L3 incompletes' are mutually exclusive. Although there is some
ambiguity in the wording.

According to Juniper; L3 incompletes are defined as "The number of
packets discarded due to the packets failing Layer 3 header checks.
This counter increments when the incoming packet fails Layer 3
(usually IPv4) checks of the header. For example, a frame with less
than 20 bytes of available IP header would be discarded and this
counter would increment."

Also according to Juniper; Policed discards are defined as "The
frames that the incoming packet match code discarded. The frames were
discarded because they were not recognized or of interest. Usually,
this field reports protocols that the JUNOS software does not handle,
such as the Cisco Discovery Protocol (CDP)."

CDP doesn't have a L3 header, so I don't believe that Juniper would
consider this Ethernet frame to contain a bad L3 header. Ethernet
encapsulated CDP packets have a proprietary protocol ID of 0x2000
(some think of this as the Ether type, but that is technically
inaccurate in the case of CDP). CDP packets are LLC SNAP packets
with an IEEE OUI id of 0x00000c, registered to Cisco. 0x2000 isn't
the Ether type, but a Cisco proprietary protocol ID. Ether type's
are only defined in the version II frame format, and must be greater
than 0xO5DC

Here is my dilemma. Since a L3 incomplete is a failed layer 3 header
check, the entire packet size of a L3 incomplete is not
deterministic. Therefore filter and log wouldn't appear to help
identify what is incrementing this counter. If Juniper's "packet
match code" is able to identify "frame of interest", based on the
Ether type (and discard accordingly), then the router is actually
detecting a bad packet. In my case, this interface (and its units)
is configured with inet, iso and mpls. This interface is also
configured for 802.1q tagging, so the only Ether type frames that the
"packet match code" should not discard as a "policed discard", would
be 0x8100 (.1q), 0x8000 (IPv4), 0x8847 (MPLS uni.), 0x8848 (MPLS
multi), and 0x0806 (ARP). The only way that I can see getting
visibility to this, is a passive monitoring device.

Any ideas Juniper? Could this be something that is misinterpreted by
Juniper's "packet match code", but coincidentally has the correct
bits at the correct offset, to look like a L3 packet which the router
is configured for?
Paul Goyette
2003-12-09 03:51:45 UTC
Permalink
L3 incomplete means that the datagram received by layer 2 does
not have enough data to match the l3 header.

For example, if you get a 64-byte Ethernet packet where the IP
header says length is 200 bytes, that's L3 Incomplete.

Most frequently seen in ATM where a missed cell causes a short
packet; usually but not always the AAL5 CRC will catch it...

-----Original Message-----
From: juniper-nsp-***@puck.nether.net
[mailto:juniper-nsp-***@puck.nether.net]On Behalf Of Eric Van Tol
Sent: Monday, December 08, 2003 6:37 AM
To: juniper-***@puck.nether.net
Subject: RE: [j-nsp] L3 incompletes


Policed discards are the CDP packets. CDP is a layer 2 protocol, not
layer 3.

-----Original Message-----
From: Christopher Morrow [mailto:***@ops-netman.net]
Sent: Sunday, December 07, 2003 10:39 PM
To: ***@groth.com
Cc: 'Phil Rosenthal'; juniper-***@puck.nether.net
Subject: Re: [j-nsp] L3 incompletes
Post by Jeff Groth
That was my understanding as well. CDP packets.
Jeff
(currently on Juniper withdrawal)
Could you not log based on packet size SMALLER than the limit that
would equal the 'incompletes' size and see what got logged?

_______________________________________________
juniper-nsp mailing list juniper-***@puck.nether.net
http://puck.nether.net/mailman/listinfo/juniper-nsp

_______________________________________________
juniper-nsp mailing list juniper-***@puck.nether.net
http://puck.nether.net/mailman/listinfo/juniper-nsp
Phil Rosenthal
2003-12-09 04:29:47 UTC
Permalink
We have no ATM cards in our Juniper producing this, all Gig-E's doing
802.1q to BigIrons, which have no ATM cards in them either.

-Phil
Post by Paul Goyette
L3 incomplete means that the datagram received by layer 2 does
not have enough data to match the l3 header.
For example, if you get a 64-byte Ethernet packet where the IP
header says length is 200 bytes, that's L3 Incomplete.
Most frequently seen in ATM where a missed cell causes a short
packet; usually but not always the AAL5 CRC will catch it...
-----Original Message-----
Sent: Monday, December 08, 2003 6:37 AM
Subject: RE: [j-nsp] L3 incompletes
Policed discards are the CDP packets. CDP is a layer 2 protocol, not
layer 3.
-----Original Message-----
Sent: Sunday, December 07, 2003 10:39 PM
Subject: Re: [j-nsp] L3 incompletes
Post by Jeff Groth
That was my understanding as well. CDP packets.
Jeff
(currently on Juniper withdrawal)
Could you not log based on packet size SMALLER than the limit that
would equal the 'incompletes' size and see what got logged?
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
--Phil Rosenthal
ISPrime, Inc.
Daniel Roesen
2003-12-09 13:26:16 UTC
Permalink
Post by Paul Goyette
L3 incomplete means that the datagram received by layer 2 does
not have enough data to match the l3 header.
For example, if you get a 64-byte Ethernet packet where the IP
header says length is 200 bytes, that's L3 Incomplete.
Well, but this should only be reported IF the ethernet frame payload
actually contains an IP header. CDP/STP has no IP header, so JunOS
trying to interpret a value at a certain offset in the ethernet frame
payload as IP packet length is IMNSHO quite bogus.


Best regards,
Daniel

Paul Goyette
2003-12-09 04:32:39 UTC
Permalink
I didn't say "only" ATM, only "most often ATM" :)

The definition still stands - the length field of the L3 header
requires more data than is available in the L2 frame.

-----Original Message-----
From: Phil Rosenthal [mailto:***@isprime.com]
Sent: Monday, December 08, 2003 7:30 PM
To: Paul Goyette
Cc: <juniper-***@puck.nether.net>
Subject: Re: [j-nsp] L3 incompletes


We have no ATM cards in our Juniper producing this, all Gig-E's doing
802.1q to BigIrons, which have no ATM cards in them either.

-Phil
Post by Paul Goyette
L3 incomplete means that the datagram received by layer 2 does
not have enough data to match the l3 header.
For example, if you get a 64-byte Ethernet packet where the IP
header says length is 200 bytes, that's L3 Incomplete.
Most frequently seen in ATM where a missed cell causes a short
packet; usually but not always the AAL5 CRC will catch it...
-----Original Message-----
Sent: Monday, December 08, 2003 6:37 AM
Subject: RE: [j-nsp] L3 incompletes
Policed discards are the CDP packets. CDP is a layer 2 protocol, not
layer 3.
-----Original Message-----
Sent: Sunday, December 07, 2003 10:39 PM
Subject: Re: [j-nsp] L3 incompletes
Post by Jeff Groth
That was my understanding as well. CDP packets.
Jeff
(currently on Juniper withdrawal)
Could you not log based on packet size SMALLER than the limit that
would equal the 'incompletes' size and see what got logged?
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
_______________________________________________
http://puck.nether.net/mailman/listinfo/juniper-nsp
--Phil Rosenthal
ISPrime, Inc.
Loading...