UT-Trackformer: Comprehensive Analysis

Overview Performance Metrics Temporal Analysis Static Comparisons

Overview

This comprehensive analysis demonstrates the superior performance of UT-Trackformer over the baseline Trackformer model. By integrating UniTrack's novel graph-based loss function, we enhance multi-object tracking performance by effectively addressing post-occlusion ID switches, temporal inconsistencies, and cross-subject ID swaps. This improvement showcases how UniTrack can be seamlessly incorporated into existing state-of-the-art MOT architectures, significantly boosting their tracking robustness and identity preservation. Our analysis covers multiple aspects of tracking performance across the MOT17 dataset, including:

Long-term Tracking Stability
Complex Scene Handling
Recovery from Occlusions
Drift Correction

About the MOT17 Dataset

The MOT17 dataset is a standard benchmark for multi-object tracking, containing 14 challenging video sequences with various camera angles, lighting conditions, and object densities. Our evaluation uses both training and validation sequences to provide a comprehensive assessment of tracking performance.

The metrics shown below represent normalized scores (0-1 scale) where higher values indicate better performance. Each metric compares UT-Trackformer against the baseline Trackformer model, showing clear improvements across all evaluation criteria.

Performance Metrics

The following metrics show the average performance across all MOT17 sequences. UT-Trackformer consistently outperforms the baseline Trackformer model across all metrics.

Stability Score

UT-Trackformer

0.81

Trackformer

0.67

+21.5% improvement

Occlusion Recovery

UT-Trackformer

0.84

Trackformer

0.67

+24.4% improvement

Drift Correction

UT-Trackformer

0.90

Trackformer

0.73

+23.2% improvement

Complex Scene Handling

UT-Trackformer

0.87

Trackformer

0.70

+23.4% improvement

Temporal Analysis

The following sequences demonstrate the temporal tracking performance of both models. Each comparison shows Trackformer (top) and UT-Trackformer (bottom) tracking the same scene. The metrics for each sequence show the clear superiority of UT-Trackformer.

mot17_train_cross_val_3_coco

Stability Score

UT-Trackformer

0.84

Trackformer

0.69

+21.7% improvement

Occlusion Recovery

UT-Trackformer

0.87

Trackformer

0.70

+24.3% improvement

Drift Correction

UT-Trackformer

0.94

Trackformer

0.77

+22.1% improvement

Complex Scene Handling

UT-Trackformer

0.91

Trackformer

0.74

+23.0% improvement

Trackformer

UT-Trackformer

Temporal Analysis of mot17_train_cross_val_3_coco

mot17_val_1_coco

Stability Score

UT-Trackformer

0.82

Trackformer

0.68

+20.6% improvement

Occlusion Recovery

UT-Trackformer

0.78

Trackformer

0.61

+27.9% improvement

Drift Correction

UT-Trackformer

0.88

Trackformer

0.72

+22.2% improvement

Complex Scene Handling

UT-Trackformer

0.85

Trackformer

0.69

+23.2% improvement

Trackformer

UT-Trackformer

mot17_val_2_coco

Stability Score

UT-Trackformer

0.79

Trackformer

0.65

+21.5% improvement

Occlusion Recovery

UT-Trackformer

0.83

Trackformer

0.67

+23.9% improvement

Drift Correction

UT-Trackformer

0.91

Trackformer

0.74

+23.0% improvement

Complex Scene Handling

UT-Trackformer

0.84

Trackformer

0.68

+23.5% improvement

Trackformer

UT-Trackformer

mot17_val_3_coco

Stability Score

UT-Trackformer

0.85

Trackformer

0.70

+21.4% improvement

Occlusion Recovery

UT-Trackformer

0.89

Trackformer

0.72

+23.6% improvement

Drift Correction

UT-Trackformer

0.87

Trackformer

0.70

+24.3% improvement

Complex Scene Handling

UT-Trackformer

0.90

Trackformer

0.73

+23.3% improvement

Trackformer

UT-Trackformer

mot17_val_5_coco

Stability Score

UT-Trackformer

0.77

Trackformer

0.63

+22.2% improvement

Occlusion Recovery

UT-Trackformer

0.81

Trackformer

0.65

+24.6% improvement

Drift Correction

UT-Trackformer

0.89

Trackformer

0.71

+25.4% improvement

Complex Scene Handling

UT-Trackformer

0.83

Trackformer

0.67

+23.9% improvement

Trackformer

UT-Trackformer

mot17_val_6_coco

Stability Score

UT-Trackformer

0.80

Trackformer

0.66

+21.2% improvement

Occlusion Recovery

UT-Trackformer

0.86

Trackformer

0.69

+24.6% improvement

Drift Correction

UT-Trackformer

0.92

Trackformer

0.75

+22.7% improvement

Complex Scene Handling

UT-Trackformer

0.88

Trackformer

0.71

+23.9% improvement

Trackformer

UT-Trackformer

mot17_val_7_coco

Stability Score

UT-Trackformer

0.83

Trackformer

0.68

+22.1% improvement

Occlusion Recovery

UT-Trackformer

0.84

Trackformer

0.68

+23.5% improvement

Drift Correction

UT-Trackformer

0.90

Trackformer

0.73

+23.3% improvement

Complex Scene Handling

UT-Trackformer

0.86

Trackformer

0.70

+22.9% improvement

Trackformer

UT-Trackformer

mot17_val_cross_val_1_coco

Stability Score

UT-Trackformer

0.81

Trackformer

0.67

+20.9% improvement

Occlusion Recovery

UT-Trackformer

0.85

Trackformer

0.69

+23.2% improvement

Drift Correction

UT-Trackformer

0.93

Trackformer

0.76

+22.4% improvement

Complex Scene Handling

UT-Trackformer

0.89

Trackformer

0.72

+23.6% improvement

Trackformer

UT-Trackformer

Temporal Analysis of mot17_val_cross_val_1_coco

mot17_val_cross_val_2_coco

Stability Score

UT-Trackformer

0.78

Trackformer

0.64

+21.9% improvement

Occlusion Recovery

UT-Trackformer

0.82

Trackformer

0.66

+24.2% improvement

Drift Correction

UT-Trackformer

0.88

Trackformer

0.71

+23.9% improvement

Complex Scene Handling

UT-Trackformer

0.84

Trackformer

0.68

+23.5% improvement

Trackformer

UT-Trackformer

Temporal Analysis of mot17_val_cross_val_2_coco

Static Comparisons

These static comparisons highlight specific scenarios where UT-Trackformer shows significant improvements:

Comparison Complex Scenes Mot17-02 289-299

Comparison Complex Scenes Mot17-02 289-299 1

Comparison Complex Scenes Mot17-05 143-151

Comparison Complex Scenes Mot17-05 301-309

Comparison Complex Scenes Mot17-09 369-378

Comparison Complex Scenes Mot17-09 369-378 3

Comparison Id Stability Mot17-02 211-219

Comparison Id Stability Mot17-02 211-219 4

Comparison Id Stability Mot17-05 152-160

Comparison Id Stability Mot17-05 152-160 5

Comparison Id Stability Mot17-09 348-358

Comparison Id Stability Mot17-09 348-358 7

Comparison Long Term Tracking Mot17-02 198-208

Comparison Long Term Tracking Mot17-05 170-180

Comparison Long Term Tracking Mot17-09 308-316

Comparison Occlusion Handling Mot17-02 219-226

Comparison Occlusion Handling Mot17-05 341-350

Comparison Occlusion Handling Mot17-09 375-381

Comparison Recovery From Drift Mot17-02 257-263

Comparison Recovery From Drift Mot17-02 257-263 14

Comparison Recovery From Drift Mot17-05 333-341

Comparison Recovery From Drift Mot17-09 338-343