comma.ai leaderboard

home · jobs · bounties · Discord · X

Welcome to the comma.ai leaderboard! We designed these challenges around real problems we've faced while building and shipping openpilot. We hope you enjoy them. If you do and score well, you'll probably enjoy a job here. * Submit your solution here * Multiple submissions are allowed * Non-competitive scores will not be published * is an employee or intern score * Active challenges are still expected to be difficult * Archived challenges are (mostly) solved problems

🔗 video compression challenge  

ACTIVE

 HIRING

lossy video compression challenge

👑 challenge prize winner

💡 new approach

📖 best write-up

score name link
0.193 hnerv_ft_microcodec 👑 #101
0.195 hnerv_lc_ac 👑 #103
0.195 hnerv_lc_v2_scale095_rplus1 👑 #102
0.195 hnerv_lc_v2 💡 #100
0.197 hnerv_muon_finetuned_from_pr95 #98
0.198 kitchen_sink #105
0.199 hnerv_muon 💡 📖 #95
0.206 rem2_HNeRV #96
0.209 belt_and_suspenders #106
0.229 vibe_coder_final_boss #97
0.229 apogee #107
0.231 qhnerv_ft_best #104
0.249 hpac_coder_hybrid #91
0.258 adaptive_masking_joint_frame_model #85
0.260 qzs3_range_joint_r258 #92
0.274 jas0xf_adversarial_neural_representation 💡 #86
0.275 adaptive_range_mask #84
0.280 qrepro 💡 #90
0.288 qzs3_range_mask 💡 #81
0.315 qpose14_r55_segactions_minp #79
0.315 qzs3_tile_delta_r147 #77
0.316 qpose14_qzs3_filmq9g_slsb1_r55 #67
0.320 henosis_qz_n3z_r25_clean #65
0.321 flatpup #93
0.325 qpose14 #63
0.331 unified_brotli #64
0.333 quantizr 💡 #55
0.344 qpose14_poseq6 #76
0.368 ph4ntom_drv #74
0.375 fp4_mask_gen #62
0.382 selfcomp #56
0.602 mask2mask 💡 #53
0.717 tomasdousek #71
1.236 codex_metric_yshift_av1 💡 #60
1.891 neural_inflate 💡 #49
1.914 svtav1_dilated_ren #58
1.944 roi_v2 #48
1.947 av1_roi_lanczos_unsharp #31
1.979 svtav1_av1grain_10bit #51
1.981 damir_bearclaw_002 💡 #30
2.005 roi_gop300_c34 #43
2.020 v4_qp_aq2_roi 💡 #44
2.033 av1_crf31_bicubic #52
2.052 svtav1_cheetah #24
2.070 svtav1_45pct_unsharp20_direct #27
2.083 svtav1_gop360_binomial_unsharp #26
2.083 av1_sharp1_adaptive #23
2.086 svtav1_45pct_unsharp 💡 #20
2.158 svtav1_spline_fg22 #37
2.200 svt_av1_lanczos_fg #18
2.553 h265_g16_512x384_veryslow #21
3.323 optimized #22
3.833 delta_codec 💡 #61
4.390 baseline_fast #1
5.086 damir_bearclaw_003 #39
25.000 no_compress #0

🔗 hardware challenge  

ACTIVE

 HIRING

find as many bugs as you can in our custom wire harness tester

bugs name
21 leosteinberg 👑
20 probablyanasian
20 delat
18 MastroGippo
18 dzid26
17 s-bashar
16 ruselec 👑
16 ashrey
15 bjkayani
14 1art
14 JulesGy
14 rexblade21
14 peteEH
13 lukasloetkolben
13 Quantizr
13 kostas1507
13 avangerp
13 arnuvbatra01
13 WesleyVong
13 bobycx
13 J-oseph
13 Panda-bit
13 AndrewYeh1
12 LukeA25
11 duong999123
11 Ans1S
11 tarnpreetb123
11 piman51277
11 CC-Ian
11 jrlomas
11 photon-cat
11 BlueKoiiiiii
11 Janaa19
10 ssysm
10 ylevental
10 ZhanXiang-Yu
10 BagavanMM

🔗 controls challenge  

ACTIVE

 HIRING

design a controller to steer a (simulated) car

score name method
7.228 Yezus69 👑per segment optimized actions
13.593 auriium2per segment MPC
16.372 Ashray-gper segment optimized actions
17.791 tfpghPGTO+BC distillation
29.549 hypery11per segment optimized actions
35.967 haraschax MPC+much compute
39.348 ksd3 per segment MPC
42.206 utkarshgill PPO+MPC
45.756 bheijdenPPO
46.92 Janaa19per segment PID+FF with CEM
48.08 ellenjxu custom feedback controller + evolution
48.474 TheConverseEngineer tube MPC + 2dof PID
48.57 Quantizr custom feedback controller
49.264 dumanah MPC w diffusion style annealing
50.192 truefit-ai custom PID + evolution
50.608 CheckmeowwwT PID w FF
50.633 jonoomph ML PID
50.716 felsager  👑 custom feedback controller
51.483 AnmolDeshmukh Adaptive preview PID+CMA-ES
52.114 Jerenemy Residual preview MPC
52.506 izzunnafis custom feedback controller
53.050 Josemedinan custom feedback controller
54.708 ch33nchan adaptive PID
54.709 freeklinssen adaptive PID
55.485 garrettpall custom feedback controller
55.739 clouds1729 custom feedback controller + evolution
56.586 AnmolDeshmukh PID w FF
56.849 armanjr PID w FF
57.670 YasinSonmez PID w FF
58.57 YashDYD custom feedback controller
59.317 Parth171 custom feedback controller
59.811 avangerp custom feedback controller
59.853 haraschax custom feedback controller
59.862 tristan-yk PID w FF
60.993 srikanth-444 PPO
61.783 xfqbuaa custom PID
62.462 0xmmo genetic algorithm
62.971 zachhaidari PID w FF
63.793 fabP258 DOBC
64.042 avlord PID w FF
66.165 CheckmeowwwT PID w FF
67.329 ninohdasilva PID w FF
67.355 kofteee adaptive PID
68.055 matthiaspetry custom feedback controller
68.942 Officially-Siddhant custom PID
69.100 Vansh404 custom feedback controller + bayesian optimization
74.440 diegoruizpon custom feedback controller
75.688 Sanjit1 custom feedback controller
76.644 jaumebalust PID w FF
76.723 gcosentino PID w FF
77.365 ZiZizou custom PID
77.411 chinmayi-r >PID w FF
78.590 hpoonawala PID w FF
78.593 Havee005 PID w FF
78.862 hbarkh PID w FF
78.868 yiannisha bayesian optimization
79.316 chinmaymirji PID+TD3
79.360 ffmiruz MPC
80.828 donymorph custom PID
83.568 jonoomph8 custom PID
88.774 Pranav-Malpure custom PID
90.893 atharva10764 custom PID w FF
91.130 integ01 MPC
95.724 adhintz auto-tuned PID
98.703 QuangTran1608 slsqp
100.445 pau-mensa bayesian optimization
102.184 NikhilGangaram custom PID
110.254 baseline PID

🔗 commaVQ compression challenge  

ACTIVE

 HIRING

losslessly compress 5,000 minutes of driving data

score name method
3.4 szabolcs-cs self-compressing neural network
3.0 SAT-oO arithmetic coding with GPT
2.9 BradyWynn arithmetic coding with GPT
2.7 ylevental arithmetic coding with GPT
2.7 ksd3 arithmetic coding with GPT
2.6 pkourouklidis 👑 arithmetic coding with GPT
2.3 anonymous zpaq
2.3 rostislav zpaq
2.2 anonymous zpaq
2.2 anonymous zpaq
2.2 0x41head zpaq
2.2 tillinf zpaq
2.2 ylevental zpaq
2.2 nuniesmith zpaq
1.6 baseline lzma

🔗 design challenge  

ACTIVE

design a UI to communicate openpilot's confidence to the user

NOTE: the job has been filled, but the challenge is still active for the leaderboard

name design
davidcalifornia design
utkarshgill design
hyusap design
salfolio design
dahsmartgirl design
kalipeng design

🔗 calibration challenge  

ARCHIVED

predict the direction of travel (in camera frame) from provided dashcam video

score name
5.33% fredyshox
9.4% Boris
10.0% krikarls
11.4% Ritam
18.5% bongbui321
18.7% Nathan
19.0% MartinEthier
19.0% louislva
19.6% arshsinghal6
19.6% Yasin
20.0% RoyVorster
20.0% Roman
20.22% Armandpl
20.5% Herman
24.8% gijskoning