Receive signed ITS messages and forward each at its declared length

Signed packets. A GeoNetworking Basic Header NextHeader of 2 means a
TS 103 097 (IEEE 1609.2) envelope follows, with the Common Header
inside it. gn_unwrap_its rejected all of these, and most real traffic is
signed: the 2026-08-17 capture holds 157 signed frames from 15 source
MACs against 2 unsecured stations. It now opens a COER-encoded
signedData, or a bare unsecuredData, and parses the inner packet as
before. The inner packet comes first inside tbsData, so the certificate
and signature are never parsed, and the signature is not verified - the
firmware has no trust store. Such messages reach the phone with the new
V2X_RX flags bit1, signed but not verified. The app reads only bit0 and
is unaffected until it learns the flag. Encrypted payloads, nested
signing and the legacy v1.2.1 envelope are still rejected. All 157
recorded signed frames have the layout this reads, in all three COER
length forms, and asn1tools decodes every envelope to the same inner
packet.

Payload bounds. Every frame recorded through the ESP32-C5's promiscuous
RX, about 15 000 of them, ends in 8 bytes that are not part of the
802.11 frame and not a valid FCS. obu-firmware reads frames through the
same API and took the rest of the frame as the message, so it forwarded
those 8 bytes to the phone after every message. UPER decoders stop where
the message ends, so nothing visibly broke, but the bytes cost serial
bandwidth and 8 bytes of the DENM's headroom, and they stayed attached
wherever raw payloads were stored or passed on. The payload is now
exactly what the Common Header's payload-length field declares, which is
also what separates a signed message from its signature.

A frame longer than main.c's 800-byte capture buffer is now reported as
truncated instead of being forwarded cut off, and counted as an oversize
drop through the new serial_link_note_oversize_drop, as it was when the
cut-off frame failed serial_link's size check.

Host tests in obu-firmware/test/host build the firmware sources
unmodified with MSYS2 gcc; `make` runs all three.
- test_chain: frames from the firmware's TX code checked byte by byte
  against EN 302 636-4-1 and parsed back, including hand-built signed
  frames, the payload-length rule, the RX trailer, and every truncation
  length against a no-access guard page. 1731 checks, 0 failures.
- test_replay and check_replay.py: all 15 145 recorded frames through
  gn_unwrap_its, cut to 800 bytes as on the board, and re-derived
  independently in Python with the envelope decoded by asn1tools. They
  agree on every record; 15 131 accepted, 157 of them signed. 11 043 of
  the 11 106 distinct messages re-encode byte-identically. The other 63
  fail the same way with the old 8 bytes put back, so the boundary is
  not the cause: 5 are our own CAMs from before the 2026-08-20
  yawRateConfidence fix, and the rest, from other stations, are a
  follow-up in TODO.md.
- fuzz_gn_unwrap: random edits of every recorded frame, each run against
  the guard page. 50 000 000 iterations, no crash.

obu-firmware/test/pcap_gn_tally.py tallies GeoNetworking header fields
per station over captures; it is how the other stations' lifetimes were
measured. TODO.md collects what is still open, including the on-air
check for this change: it builds on IDF 6.1 but has not been flashed.
This commit is contained in:
Ashin Walpola
2026-09-11 20:19:40 +02:00
parent 1baae2c5f6
commit 75d6d3b85c
15 changed files with 2196 additions and 34 deletions
+131 -15
View File
@@ -28,9 +28,20 @@
#define GN_HEADER_TYPE_TSB (5) // Topologically-Scoped Broadcast
#define GN_HEADER_SUBTYPE_SINGLE_HOP (0)
#define GN_NEXT_HEADER_COMMON (1) // unsecured; 2 would be a secured packet
#define GN_NEXT_HEADER_COMMON (1) // unsecured: the Common Header follows
#define GN_NEXT_HEADER_SECURED (2) // a TS 103 097 envelope follows, Common Header inside it
#define GN_COMMON_NEXT_HEADER_BTP_B (2)
// Common Header field (clause 9.7): length of everything after the GeoNetworking headers, i.e.
// the BTP-B header plus the ITS payload.
#define GN_COMMON_PAYLOAD_LEN_OFFSET (4)
// IEEE 1609.2 / TS 103 097 envelope, COER encoded - see unwrap_secured().
#define IEEE1609DOT2_VERSION (3)
#define CONTENT_TAG_UNSECURED_DATA (0x80) // Ieee1609Dot2Content CHOICE, context tag 0
#define CONTENT_TAG_SIGNED_DATA (0x81) // context tag 1
#define SIGNED_PAYLOAD_HAS_DATA (0x40) // SignedDataPayload preamble: `data` present
#define BTP_DEST_PORT_CAM (2001) // ETSI TS 103 248
#define BTP_DEST_PORT_DENM (2002)
// NOTE the crossover: SPATEM is BTP port 2004 but ItsPduHeader messageID 4, while MAPEM is port
@@ -51,6 +62,90 @@ static uint16_t be16(const uint8_t *p)
return (uint16_t)(((uint16_t)p[0] << 8) | (uint16_t)p[1]);
}
// COER length determinant (ITU-T X.696): a first byte below 0x80 is the length itself; otherwise
// its low 7 bits count the big-endian length bytes that follow. Two of them cover anything this
// radio can deliver. Returns how many bytes the determinant occupies, or 0 if it does not fit in
// `avail` or uses a form this does not read.
static int coer_length(const uint8_t *p, int avail, int *len)
{
if (avail < 1) {
return 0;
}
if (p[0] < 0x80) {
*len = p[0];
return 1;
}
const int n = p[0] & 0x7F;
if (n < 1 || n > 2 || avail < 1 + n) {
return 0;
}
int v = 0;
for (int i = 1; i <= n; i++) {
v = (v << 8) | p[i];
}
*len = v;
return 1 + n;
}
// Locates the GeoNetworking packet inside a secured one. `offset` points just past the Basic
// Header. Returns the offset of the inner Common Header and sets *inner_end to where the envelope
// says the inner packet ends - which lies beyond frame_len if the capture was cut short - or
// returns -1 for anything this does not unwrap.
//
// The envelope is an Ieee1609Dot2Data (IEEE 1609.2, profiled by TS 103 097 v1.3.1 and later),
// COER encoded. A signed message starts:
//
// 03 protocolVersion 3
// 81 content = signedData
// 00 hashId (sha256; any one-byte value is accepted - the hash is not checked)
// 40 tbsData.payload preamble: `data` present (bit 6)
// 03 80 <len> payload.data: an Ieee1609Dot2Data holding unsecuredData of <len> bytes, which
// are the Common Header, extended header, BTP-B header and ITS payload
// ... headerInfo, signer, signature: not read
//
// The inner packet comes first inside tbsData, so it is found without parsing the certificate
// or the signature, and its explicit length is what separates it from them. The shape is
// measured, not only read from the standard: all 157 signed frames in
// capture_20260817_171055.pcap have it (150 CAM, 7 GeoBroadcast DENM; <len> in all three COER
// forms), and asn1tools decodes every one of them to the same unsecuredData. A top-level
// unsecuredData (03 80 <len>, no signature at all) is accepted too.
static int unwrap_secured(const uint8_t *frame, int offset, int frame_len,
int *inner_end, bool *is_signed)
{
const uint8_t *p = frame + offset;
const int avail = frame_len - offset;
int i;
if (avail < 2 || p[0] != IEEE1609DOT2_VERSION) {
return -1; // includes the legacy TS 103 097 v1.2.1 envelope, protocolVersion 2
}
if (p[1] == CONTENT_TAG_SIGNED_DATA) {
if (avail < 6 ||
p[2] >= 0x80 || // hashId: a one-byte enumerated value
!(p[3] & SIGNED_PAYLOAD_HAS_DATA) || // signs only a hash of data sent elsewhere
p[4] != IEEE1609DOT2_VERSION ||
p[5] != CONTENT_TAG_UNSECURED_DATA) { // nested signing or encryption
return -1;
}
i = 6;
*is_signed = true;
} else if (p[1] == CONTENT_TAG_UNSECURED_DATA) {
i = 2;
*is_signed = false;
} else {
return -1; // encryptedData, certificate requests
}
int len;
const int used = coer_length(p + i, avail - i, &len);
if (used == 0) {
return -1;
}
i += used;
*inner_end = offset + i + len;
return offset + i;
}
bool gn_unwrap_its(const uint8_t *frame, int frame_len, gn_rx_t *out)
{
if (!frame || !out || frame_len < IEEE80211_HEADER_LEN) {
@@ -91,22 +186,33 @@ bool gn_unwrap_its(const uint8_t *frame, int frame_len, gn_rx_t *out)
if (frame_len < offset + GN_BASIC_HEADER_LEN) {
return false;
}
// NextHeader distinguishes an unsecured packet (1 = Common Header follows) from a secured one
// (2 = a TS 103 097 SecuredMessage follows, with the Common Header buried inside it at a
// variable offset). Checking this rather than blindly skipping means a secured packet is
// rejected cleanly instead of having its security envelope misread as a Common Header.
if ((frame[offset] & 0x0F) != GN_NEXT_HEADER_COMMON) {
return false;
}
const uint8_t basic_next_header = frame[offset] & 0x0F;
offset += GN_BASIC_HEADER_LEN;
// The headers from here on must end before `limit`: the end of the frame, or for a secured
// packet the end of the envelope's inner packet if that comes first.
int limit = frame_len;
int envelope_end = -1;
if (basic_next_header == GN_NEXT_HEADER_SECURED) {
offset = unwrap_secured(frame, offset, frame_len, &envelope_end, &out->signed_unverified);
if (offset < 0) {
return false;
}
if (envelope_end < limit) {
limit = envelope_end;
}
} else if (basic_next_header != GN_NEXT_HEADER_COMMON) {
return false;
}
// ---- GN Common Header (8 bytes) ----
if (frame_len < offset + GN_COMMON_HEADER_LEN) {
if (limit < offset + GN_COMMON_HEADER_LEN) {
return false;
}
uint8_t next_header = (frame[offset + 0] >> 4) & 0x0F;
uint8_t header_type = (frame[offset + 1] >> 4) & 0x0F;
uint8_t header_subtype = frame[offset + 1] & 0x0F;
const int gn_payload_len = be16(frame + offset + GN_COMMON_PAYLOAD_LEN_OFFSET);
if (next_header != GN_COMMON_NEXT_HEADER_BTP_B) {
return false;
}
@@ -126,7 +232,7 @@ bool gn_unwrap_its(const uint8_t *frame, int frame_len, gn_rx_t *out)
} else {
return false; // Beacon / GeoUnicast / GeoAnycast / multi-hop TSB - see header comment
}
if (frame_len < offset + ext_len) {
if (limit < offset + ext_len) {
return false;
}
if (is_gbc) {
@@ -138,7 +244,7 @@ bool gn_unwrap_its(const uint8_t *frame, int frame_len, gn_rx_t *out)
offset += ext_len;
// ---- BTP-B header (4 bytes) ----
if (frame_len < offset + BTP_B_HEADER_LEN) {
if (limit < offset + BTP_B_HEADER_LEN) {
return false;
}
uint16_t dest_port = be16(frame + offset);
@@ -146,16 +252,26 @@ bool gn_unwrap_its(const uint8_t *frame, int frame_len, gn_rx_t *out)
dest_port != BTP_DEST_PORT_SPATEM) {
return false;
}
offset += BTP_B_HEADER_LEN;
// ---- Whatever's left is the ITS UPER payload ----
int payload_len = frame_len - offset;
// ---- ITS payload: exactly as long as the Common Header declares ----
// Not "whatever is left of the frame": see "Payload bounds" in gn_unwrap.h for the 8 trailing
// bytes every received frame carries and the signature that follows a secured packet.
if (gn_payload_len <= BTP_B_HEADER_LEN) {
return false; // no ITS payload at all
}
const int payload_start = offset + BTP_B_HEADER_LEN;
const int payload_end = offset + gn_payload_len;
if (envelope_end >= 0 && payload_end > envelope_end) {
return false; // the inner packet claims more than its envelope holds
}
out->truncated = payload_end > frame_len;
const int payload_len = (out->truncated ? frame_len : payload_end) - payload_start;
if (payload_len <= 0) {
return false;
}
out->btp_dest_port = dest_port;
out->payload = frame + offset;
out->payload = frame + payload_start;
out->payload_len = payload_len;
return true;
}