Marine DebrisCompetition research · v8

ANALYSIS · FULL_SHARED_AUDIT_V1 · PASS

Shared Audit & Hard Cases

The shared audit separates missing candidates from ranking errors. Later ensemble decisions and validation limitations are recorded alongside the missing-annotation diagnostics.

12 / 12 MODELSTINY-OBJECT BOTTLENECKPARETO EVIDENCEVALIDATION SCOPE MATTERS
12 / 12accepted models audited
3,022validation images
408 / 408model-class rows
66 / 66unique model pairs
6,449validation GT objects
PER-CLASS AP50

Co-DINO · 18 / 34

MI-DETR wins 9 classes, RT-DETRv4-X 5, Mr. DETR 1, and Stable-DINO Swin-L 1.

SIZE

RT-DETRv4 leads tiny recall

RT-DETRv4-X leads recall below 0.1% image area; D-FINE-X leads the other major size bands.

DENSITY

MI-DETR leads sparse scenes

MI-DETR leads at 0–5 objects/image; Co-DINO leads the 6–10, 11–20, and >20 slices.

Shared hard-case concentration

Objects <1% · universal failures60.3%
515 of 854
Objects <1% · universal misses78.9%
315 of 399
Objects <1% · validation GT share29.6%
strong overrepresentation in residual errors
854 / 6,449universal failures
399 / 6,449universal misses
140 / 224<0.1% universal failures
124 / 224<0.1% universal misses
A · MISSING-CANDIDATE PROBLEM

Higher resolution → candidate recovery

The audit identified tiny-object misses. MI-DETR1280 improved standalone local and hidden scores, but later ensemble replacement tests did not pass the integration gate.

B · RANKING PROBLEM

Crop rescorer → ranking / precision

External teammate evidence suggests that learned visual crop features can improve the confidence ordering of candidates already proposed by detectors and fusion.

External crop-rescoring evidence · do not compare numerically with our leaderboard
External branchval_selAIdea preliminaryObserved change
Clean EFS WBF0.74970.7175357reference
EFS + safe ConvNeXt-Tiny crop rescorer0.7640approximately 0.729approximately +0.0143 local / +0.0115 hidden
FEATURE EVIDENCE

Visual crops were necessary

Metadata-only reranking did not provide the same gain; actual crop/image features were required.

STARTING ARCHITECTURE

ConvNeXt-Tiny

ConvNeXt-Base did not beat Tiny in the teammate branch's frozen local gate, so Tiny is the preferred V1 starting point.

COLLABORATION BOUNDARY

Transparent handoff

The repositories document shared artifacts and completed experiments. Exact lineage for the owner-confirmed 0.7910702 submission remains unresolved.

A · MISSING CANDIDATES

Resolution recovers proposals

Completed 1280 controls demonstrate standalone scale gains. Integration tests separately measure whether those recovered candidates improve the protected ensemble.

B · RANKING / PRECISION

Fusion → crop rescoring → LambdaRank

LambdaRank is already documented: 0.7884920 hidden versus 0.7731070 with the same detector/rescorer pipeline. The later scene-context variant was rejected.

High-Confidence FP / Missing-Annotation Audit
SliceVisual resultIndependent supportInterpretation
max any-GT IoU <0.10120 / 128 visually debris-likeincluded in 135 / 142 2/3-or-3/3 same-class supportlow-GT-overlap evidence
max any-GT IoU <0.30142 / 150 visually debris-like120 with 3/3 + 15 with 2/3 same-class support95.1% independently supported
Detector votesCo-DINO-1280 · original MI-DETR-1024 · grouped80 YWBF, rescorers, LambdaRank excludeddetector agreement only
Canonical TRAIN 3/3 discovery pool
FieldFrozen record
Pre-dedup / post-dedup52,919 / 50,303
Unique source images4,819
max official-GT IoU <0.10 / 0.10–<0.3045,197 / 5,106
Size distribution<0.1% 8,608 · 0.1–<0.5% 21,274 · 0.5–<1% 7,631 · >=1% 12,790
Rare / non-rare / small-and-rare416 / 49,887 / 229
Validation views · canonical remains authoritative
ViewmAP50PrecisionRecallAuthority
Canonical0.71547033476234890.66715447154471540.6362226701814234official VAL · 3,022 images · 6,449 positive GT
PRIMARY diagnostic0.73000083755139860.78092881614008370.6362226701814234892 protected 3/3 regions · max GT IoU <0.10
EXTENDED diagnostic0.73401266413724060.80529931305201170.63622267018142341,045 protected regions · max GT IoU <0.30 · sensitivity only