3080Ti

3080Ti in a workstation with Intel 12900K CPU

This section contains benchmarking results for various YOLO models on the 3080Ti platform.

Performance Plots

The following plots show the performance comparison between different YOLO models and frameworks:

yolov10m

yolov10m performance plot

yolov10n

yolov10n performance plot

yolov10s

yolov10s performance plot

yolov7m

yolov7m performance plot

yolov7t

yolov7t performance plot

yolov8m

yolov8m performance plot

yolov8n

yolov8n performance plot

yolov8s

yolov8s performance plot

yolov9m

yolov9m performance plot

yolov9s

yolov9s performance plot

yolov9t

yolov9t performance plot

yoloxm

yoloxm performance plot

yoloxn

yoloxn performance plot

yoloxs

yoloxs performance plot

yoloxt

yoloxt performance plot

Performance Table

The following table shows detailed performance metrics for all tested models:

Performance Metrics

Framework

Model

Input Size

Mean (ms)

Median (ms)

Min (ms)

Max (ms)

tensorrt

yolov10n

160

0.6

0.6

0.6

0.6

tensorrt

yolov10n

320

0.6

0.6

0.6

0.7

tensorrt

yolov10n

480

0.7

0.7

0.7

0.8

tensorrt

yolov10n

640

0.8

0.8

0.8

0.9

tensorrt

yolov10n

800

1.0

1.0

1.0

1.1

tensorrt

yolov10n

960

1.3

1.3

1.2

1.4

tensorrt

yolov10n

1120

1.6

1.6

1.5

1.6

tensorrt

yolov10n

1280

1.9

1.9

1.8

2.0

tensorrt

yolov10s

160

0.7

0.7

0.7

0.7

tensorrt

yolov10s

320

0.8

0.8

0.8

0.8

tensorrt

yolov10s

480

1.0

1.0

0.9

1.0

tensorrt

yolov10s

640

1.2

1.2

1.2

1.3

tensorrt

yolov10s

800

1.5

1.5

1.5

1.6

tensorrt

yolov10s

960

2.0

2.0

1.8

2.1

tensorrt

yolov10s

1120

2.5

2.5

2.3

2.6

tensorrt

yolov10s

1280

3.2

3.2

2.9

3.4

tensorrt

yolov10m

160

1.0

1.0

1.0

1.0

tensorrt

yolov10m

320

1.1

1.1

1.1

1.3

tensorrt

yolov10m

480

1.6

1.6

1.5

1.6

tensorrt

yolov10m

640

2.1

2.1

2.0

2.2

tensorrt

yolov10m

800

2.8

2.8

2.6

2.9

tensorrt

yolov10m

960

3.9

3.9

3.7

4.0

tensorrt

yolov10m

1120

4.8

4.8

4.4

5.0

tensorrt

yolov10m

1280

5.9

5.9

5.4

6.2

tensorrt

yolov9t

160

1.2

1.2

1.2

1.3

tensorrt

yolov9t

320

1.3

1.3

1.3

1.3

tensorrt

yolov9t

480

1.4

1.4

1.4

1.5

tensorrt

yolov9t

640

1.5

1.5

1.5

1.6

tensorrt

yolov9t

800

1.6

1.6

1.6

1.7

tensorrt

yolov9t

960

1.9

1.9

1.9

2.0

tensorrt

yolov9t

1120

2.2

2.2

2.1

2.3

tensorrt

yolov9t

1280

2.6

2.6

2.5

2.8

tensorrt

yolov9s

160

1.3

1.3

1.3

1.4

tensorrt

yolov9s

320

1.4

1.4

1.4

1.4

tensorrt

yolov9s

480

1.5

1.5

1.5

1.6

tensorrt

yolov9s

640

1.8

1.8

1.8

1.9

tensorrt

yolov9s

800

2.3

2.3

2.2

2.3

tensorrt

yolov9s

960

2.6

2.6

2.5

2.8

tensorrt

yolov9s

1120

3.1

3.1

2.9

3.2

tensorrt

yolov9s

1280

3.9

3.9

3.7

4.1

tensorrt

yolov9m

160

1.3

1.3

1.3

1.3

tensorrt

yolov9m

320

1.5

1.5

1.5

1.5

tensorrt

yolov9m

480

2.0

2.0

1.9

2.0

tensorrt

yolov9m

640

2.7

2.7

2.6

2.7

tensorrt

yolov9m

800

3.4

3.4

3.3

3.5

tensorrt

yolov9m

960

4.6

4.6

4.4

4.7

tensorrt

yolov9m

1120

5.6

5.6

5.2

5.8

tensorrt

yolov9m

1280

7.2

7.2

6.8

7.5

tensorrt

yolov8n

160

0.5

0.5

0.5

0.5

tensorrt

yolov8n

320

0.5

0.5

0.5

0.5

tensorrt

yolov8n

480

0.6

0.6

0.6

0.6

tensorrt

yolov8n

640

0.7

0.7

0.7

0.7

tensorrt

yolov8n

800

0.8

0.8

0.8

0.9

tensorrt

yolov8n

960

1.1

1.1

1.0

1.1

tensorrt

yolov8n

1120

1.3

1.3

1.2

1.3

tensorrt

yolov8n

1280

1.6

1.6

1.5

1.7

tensorrt

yolov8s

160

0.5

0.5

0.5

0.6

tensorrt

yolov8s

320

0.6

0.6

0.6

0.6

tensorrt

yolov8s

480

0.8

0.8

0.8

0.8

tensorrt

yolov8s

640

1.0

1.0

1.0

1.1

tensorrt

yolov8s

800

1.3

1.3

1.2

1.4

tensorrt

yolov8s

960

1.7

1.7

1.6

1.8

tensorrt

yolov8s

1120

2.1

2.1

1.9

2.3

tensorrt

yolov8s

1280

2.9

2.9

2.6

3.0

tensorrt

yolov8m

160

0.8

0.8

0.8

0.8

tensorrt

yolov8m

320

1.0

1.0

1.0

1.0

tensorrt

yolov8m

480

1.4

1.4

1.4

1.5

tensorrt

yolov8m

640

2.0

2.0

1.9

2.1

tensorrt

yolov8m

800

2.6

2.6

2.4

2.7

tensorrt

yolov8m

960

3.9

3.9

3.6

4.1

tensorrt

yolov8m

1120

4.6

4.6

4.2

4.8

tensorrt

yolov8m

1280

5.8

5.8

5.2

6.1

tensorrt

yolov7t

160

0.5

0.5

0.5

0.6

tensorrt

yolov7t

320

0.5

0.5

0.5

0.5

tensorrt

yolov7t

480

0.6

0.6

0.6

0.7

tensorrt

yolov7t

640

0.8

0.8

0.8

0.9

tensorrt

yolov7t

800

1.1

1.1

1.0

1.2

tensorrt

yolov7t

960

1.4

1.4

1.3

1.6

tensorrt

yolov7t

1120

1.7

1.7

1.5

1.8

tensorrt

yolov7t

1280

2.2

2.2

2.0

2.3

tensorrt

yolov7m

160

0.9

0.9

0.9

0.9

tensorrt

yolov7m

320

1.2

1.2

1.1

1.2

tensorrt

yolov7m

480

1.7

1.7

1.7

1.9

tensorrt

yolov7m

640

2.6

2.5

2.4

2.7

tensorrt

yolov7m

800

3.4

3.3

3.1

3.5

tensorrt

yolov7m

960

4.8

4.8

4.4

5.0

tensorrt

yolov7m

1120

5.8

5.8

5.3

6.1

tensorrt

yolov7m

1280

7.8

7.8

7.5

8.2

tensorrt

yoloxt

160

0.5

0.5

0.5

0.6

tensorrt

yoloxt

320

0.6

0.6

0.6

0.6

tensorrt

yoloxt

480

0.7

0.7

0.7

0.7

tensorrt

yoloxt

640

0.8

0.8

0.8

0.9

tensorrt

yoloxt

800

1.1

1.1

1.0

1.1

tensorrt

yoloxt

960

1.4

1.4

1.4

1.6

tensorrt

yoloxt

1120

1.7

1.7

1.6

1.8

tensorrt

yoloxt

1280

2.2

2.1

2.0

2.3

tensorrt

yoloxn

160

0.5

0.5

0.5

0.7

tensorrt

yoloxn

320

0.6

0.6

0.6

0.6

tensorrt

yoloxn

480

0.6

0.6

0.6

0.7

tensorrt

yoloxn

640

0.7

0.7

0.7

0.8

tensorrt

yoloxn

800

0.9

0.9

0.9

0.9

tensorrt

yoloxn

960

1.0

1.0

1.0

1.1

tensorrt

yoloxn

1120

1.2

1.2

1.2

1.3

tensorrt

yoloxn

1280

1.5

1.5

1.4

1.5

tensorrt

yoloxs

160

0.5

0.5

0.5

0.6

tensorrt

yoloxs

320

0.6

0.6

0.6

0.6

tensorrt

yoloxs

480

0.8

0.8

0.8

0.8

tensorrt

yoloxs

640

1.0

1.0

1.0

1.1

tensorrt

yoloxs

800

1.3

1.3

1.2

1.4

tensorrt

yoloxs

960

1.7

1.7

1.5

1.8

tensorrt

yoloxs

1120

2.0

2.0

1.8

2.1

tensorrt

yoloxs

1280

2.7

2.7

2.4

2.9

tensorrt

yoloxm

160

0.8

0.8

0.8

1.0

tensorrt

yoloxm

320

1.0

1.0

1.0

1.0

tensorrt

yoloxm

480

1.4

1.4

1.3

1.4

tensorrt

yoloxm

640

1.8

1.8

1.7

1.9

tensorrt

yoloxm

800

2.5

2.5

2.2

2.6

tensorrt

yoloxm

960

3.7

3.7

3.3

3.9

tensorrt

yoloxm

1120

4.3

4.3

3.8

4.6

tensorrt

yoloxm

1280

5.3

5.3

4.7

5.6

trtutils(trt)

yolov10n

160

1.0

1.0

1.0

1.3

trtutils(trt)

yolov10n

320

1.1

1.1

1.1

1.3

trtutils(trt)

yolov10n

480

1.2

1.2

1.2

1.9

trtutils(trt)

yolov10n

640

1.3

1.3

1.3

1.7

trtutils(trt)

yolov10n

800

1.5

1.5

1.5

2.4

trtutils(trt)

yolov10n

960

1.7

1.7

1.7

2.1

trtutils(trt)

yolov10n

1120

2.1

2.1

2.0

2.5

trtutils(trt)

yolov10n

1280

2.4

2.4

2.3

3.1

trtutils(trt)

yolov10s

160

1.1

1.1

1.1

1.3

trtutils(trt)

yolov10s

320

1.2

1.2

1.2

1.4

trtutils(trt)

yolov10s

480

1.4

1.4

1.4

2.1

trtutils(trt)

yolov10s

640

1.6

1.6

1.6

2.0

trtutils(trt)

yolov10s

800

2.0

2.0

1.9

2.8

trtutils(trt)

yolov10s

960

2.4

2.4

2.3

2.8

trtutils(trt)

yolov10s

1120

3.0

3.0

2.8

3.3

trtutils(trt)

yolov10s

1280

3.7

3.7

3.5

4.1

trtutils(trt)

yolov10m

160

1.4

1.4

1.4

1.7

trtutils(trt)

yolov10m

320

1.6

1.6

1.5

1.8

trtutils(trt)

yolov10m

480

2.0

2.0

1.9

2.6

trtutils(trt)

yolov10m

640

2.5

2.5

2.4

2.8

trtutils(trt)

yolov10m

800

3.2

3.2

3.0

3.9

trtutils(trt)

yolov10m

960

4.4

4.4

4.1

4.6

trtutils(trt)

yolov10m

1120

5.3

5.2

4.8

5.6

trtutils(trt)

yolov10m

1280

6.5

6.5

5.8

6.8

trtutils(trt)

yolov9t

160

1.7

1.7

1.7

1.9

trtutils(trt)

yolov9t

320

1.7

1.7

1.7

1.9

trtutils(trt)

yolov9t

480

1.8

1.8

1.8

2.6

trtutils(trt)

yolov9t

640

1.9

1.9

1.9

2.4

trtutils(trt)

yolov9t

800

2.1

2.1

2.1

3.1

trtutils(trt)

yolov9t

960

2.4

2.4

2.4

2.9

trtutils(trt)

yolov9t

1120

2.7

2.7

2.7

3.2

trtutils(trt)

yolov9t

1280

3.1

3.1

3.1

3.7

trtutils(trt)

yolov9s

160

1.8

1.8

1.8

2.0

trtutils(trt)

yolov9s

320

1.9

1.9

1.8

2.0

trtutils(trt)

yolov9s

480

2.0

2.0

2.0

2.8

trtutils(trt)

yolov9s

640

2.3

2.3

2.2

2.7

trtutils(trt)

yolov9s

800

2.7

2.7

2.7

3.6

trtutils(trt)

yolov9s

960

3.1

3.1

3.1

3.5

trtutils(trt)

yolov9s

1120

3.6

3.6

3.5

4.0

trtutils(trt)

yolov9s

1280

4.5

4.5

4.3

4.9

trtutils(trt)

yolov9m

160

1.7

1.7

1.7

2.0

trtutils(trt)

yolov9m

320

1.9

1.9

1.9

2.1

trtutils(trt)

yolov9m

480

2.4

2.4

2.3

3.1

trtutils(trt)

yolov9m

640

3.1

3.1

3.0

3.4

trtutils(trt)

yolov9m

800

3.8

3.8

3.6

4.6

trtutils(trt)

yolov9m

960

5.1

5.1

4.7

5.3

trtutils(trt)

yolov9m

1120

6.1

6.1

5.6

6.4

trtutils(trt)

yolov9m

1280

7.8

7.8

7.0

8.1

trtutils(trt)

yolov8n

160

0.9

0.9

0.9

1.1

trtutils(trt)

yolov8n

320

1.0

1.0

1.0

1.2

trtutils(trt)

yolov8n

480

1.0

1.0

1.0

1.8

trtutils(trt)

yolov8n

640

1.1

1.1

1.1

1.6

trtutils(trt)

yolov8n

800

1.3

1.3

1.3

2.2

trtutils(trt)

yolov8n

960

1.5

1.5

1.5

2.0

trtutils(trt)

yolov8n

1120

1.8

1.8

1.7

2.3

trtutils(trt)

yolov8n

1280

2.1

2.1

2.1

2.7

trtutils(trt)

yolov8s

160

1.0

1.0

1.0

1.3

trtutils(trt)

yolov8s

320

1.1

1.1

1.1

1.3

trtutils(trt)

yolov8s

480

1.2

1.2

1.2

2.0

trtutils(trt)

yolov8s

640

1.5

1.5

1.4

1.8

trtutils(trt)

yolov8s

800

1.8

1.8

1.7

2.7

trtutils(trt)

yolov8s

960

2.2

2.2

2.1

2.6

trtutils(trt)

yolov8s

1120

2.6

2.6

2.5

3.0

trtutils(trt)

yolov8s

1280

3.4

3.4

3.2

3.8

trtutils(trt)

yolov8m

160

1.3

1.3

1.3

1.5

trtutils(trt)

yolov8m

320

1.5

1.5

1.4

1.6

trtutils(trt)

yolov8m

480

1.9

1.9

1.8

2.6

trtutils(trt)

yolov8m

640

2.4

2.4

2.3

2.7

trtutils(trt)

yolov8m

800

3.0

3.0

2.8

3.8

trtutils(trt)

yolov8m

960

4.3

4.3

4.0

4.5

trtutils(trt)

yolov8m

1120

5.1

5.1

4.6

5.3

trtutils(trt)

yolov8m

1280

6.3

6.3

5.6

6.7

trtutils(trt)

yolov7t

160

0.9

0.9

0.9

1.1

trtutils(trt)

yolov7t

320

1.0

1.0

1.0

1.2

trtutils(trt)

yolov7t

480

1.1

1.1

1.1

1.8

trtutils(trt)

yolov7t

640

1.3

1.3

1.3

1.7

trtutils(trt)

yolov7t

800

1.5

1.5

1.5

2.5

trtutils(trt)

yolov7t

960

1.8

1.8

1.8

2.3

trtutils(trt)

yolov7t

1120

2.2

2.2

2.1

2.6

trtutils(trt)

yolov7t

1280

2.7

2.7

2.5

3.2

trtutils(trt)

yolov7m

160

1.3

1.3

1.3

1.6

trtutils(trt)

yolov7m

320

1.6

1.6

1.6

1.8

trtutils(trt)

yolov7m

480

2.1

2.1

2.1

2.8

trtutils(trt)

yolov7m

640

3.0

3.0

2.8

3.2

trtutils(trt)

yolov7m

800

3.8

3.8

3.5

4.4

trtutils(trt)

yolov7m

960

5.2

5.2

4.7

5.5

trtutils(trt)

yolov7m

1120

6.2

6.2

5.6

6.6

trtutils(trt)

yolov7m

1280

8.3

8.3

7.3

8.8

trtutils(trt)

yoloxt

160

1.0

1.0

1.0

1.2

trtutils(trt)

yoloxt

320

1.1

1.1

1.1

1.3

trtutils(trt)

yoloxt

480

1.4

1.4

1.4

1.5

trtutils(trt)

yoloxt

640

1.7

1.7

1.7

2.1

trtutils(trt)

yoloxt

800

2.3

2.3

2.2

3.3

trtutils(trt)

yoloxt

960

2.9

2.9

2.9

3.4

trtutils(trt)

yoloxt

1120

3.5

3.5

3.5

4.1

trtutils(trt)

yoloxt

1280

4.4

4.4

4.3

5.1

trtutils(trt)

yoloxn

160

1.0

1.0

1.0

1.2

trtutils(trt)

yoloxn

320

1.1

1.1

1.1

1.3

trtutils(trt)

yoloxn

480

1.3

1.3

1.3

1.5

trtutils(trt)

yoloxn

640

1.7

1.7

1.7

2.1

trtutils(trt)

yoloxn

800

2.1

2.1

2.1

3.1

trtutils(trt)

yoloxn

960

2.6

2.6

2.6

3.1

trtutils(trt)

yoloxn

1120

3.2

3.2

3.2

3.8

trtutils(trt)

yoloxn

1280

3.9

3.9

3.9

4.7

trtutils(trt)

yoloxs

160

1.0

1.0

1.0

1.2

trtutils(trt)

yoloxs

320

1.2

1.2

1.2

1.3

trtutils(trt)

yoloxs

480

1.5

1.5

1.4

1.6

trtutils(trt)

yoloxs

640

1.9

1.9

1.9

2.3

trtutils(trt)

yoloxs

800

2.4

2.4

2.4

3.4

trtutils(trt)

yoloxs

960

3.1

3.1

3.1

3.6

trtutils(trt)

yoloxs

1120

3.8

3.8

3.8

4.3

trtutils(trt)

yoloxs

1280

4.9

4.9

4.8

5.6

trtutils(trt)

yoloxm

160

1.3

1.3

1.2

1.4

trtutils(trt)

yoloxm

320

1.5

1.5

1.5

1.7

trtutils(trt)

yoloxm

480

2.0

2.0

2.0

2.2

trtutils(trt)

yoloxm

640

2.6

2.6

2.6

3.0

trtutils(trt)

yoloxm

800

3.5

3.5

3.4

4.4

trtutils(trt)

yoloxm

960

5.0

5.0

4.8

5.3

trtutils(trt)

yoloxm

1120

5.9

5.9

5.7

6.3

trtutils(trt)

yoloxm

1280

7.3

7.3

7.0

8.0

trtutils(cuda)

yolov10n

160

1.2

1.2

1.2

1.6

trtutils(cuda)

yolov10n

320

1.3

1.3

1.3

1.6

trtutils(cuda)

yolov10n

480

1.4

1.4

1.4

1.7

trtutils(cuda)

yolov10n

640

1.5

1.5

1.5

1.9

trtutils(cuda)

yolov10n

800

1.7

1.7

1.6

2.7

trtutils(cuda)

yolov10n

960

1.9

1.9

1.9

2.4

trtutils(cuda)

yolov10n

1120

2.2

2.2

2.2

2.8

trtutils(cuda)

yolov10n

1280

2.5

2.5

2.5

3.2

trtutils(cuda)

yolov10s

160

1.3

1.3

1.3

1.6

trtutils(cuda)

yolov10s

320

1.4

1.4

1.4

1.6

trtutils(cuda)

yolov10s

480

1.6

1.6

1.5

1.9

trtutils(cuda)

yolov10s

640

1.8

1.8

1.8

2.3

trtutils(cuda)

yolov10s

800

2.1

2.1

2.1

3.2

trtutils(cuda)

yolov10s

960

2.6

2.6

2.5

3.0

trtutils(cuda)

yolov10s

1120

3.1

3.1

3.0

3.5

trtutils(cuda)

yolov10s

1280

3.9

3.8

3.7

4.3

trtutils(cuda)

yolov10m

160

1.6

1.6

1.6

1.9

trtutils(cuda)

yolov10m

320

1.8

1.8

1.7

2.0

trtutils(cuda)

yolov10m

480

2.2

2.2

2.1

2.4

trtutils(cuda)

yolov10m

640

2.6

2.6

2.6

3.1

trtutils(cuda)

yolov10m

800

3.3

3.3

3.2

4.2

trtutils(cuda)

yolov10m

960

4.5

4.5

4.2

4.8

trtutils(cuda)

yolov10m

1120

5.4

5.4

5.0

5.6

trtutils(cuda)

yolov10m

1280

6.5

6.5

5.9

7.0

trtutils(cuda)

yolov9t

160

1.9

1.9

1.9

2.2

trtutils(cuda)

yolov9t

320

2.0

2.0

1.9

2.4

trtutils(cuda)

yolov9t

480

2.0

2.0

2.0

2.4

trtutils(cuda)

yolov9t

640

2.1

2.1

2.1

2.7

trtutils(cuda)

yolov9t

800

2.3

2.3

2.3

3.3

trtutils(cuda)

yolov9t

960

2.6

2.6

2.6

3.2

trtutils(cuda)

yolov9t

1120

2.9

2.9

2.8

3.5

trtutils(cuda)

yolov9t

1280

3.3

3.3

3.2

4.0

trtutils(cuda)

yolov9s

160

2.0

2.0

2.0

2.3

trtutils(cuda)

yolov9s

320

2.1

2.1

2.0

2.3

trtutils(cuda)

yolov9s

480

2.2

2.2

2.2

2.6

trtutils(cuda)

yolov9s

640

2.5

2.5

2.4

2.9

trtutils(cuda)

yolov9s

800

2.9

2.9

2.9

3.9

trtutils(cuda)

yolov9s

960

3.3

3.3

3.2

3.8

trtutils(cuda)

yolov9s

1120

3.8

3.8

3.7

4.2

trtutils(cuda)

yolov9s

1280

4.6

4.6

4.4

5.0

trtutils(cuda)

yolov9m

160

2.0

2.0

1.9

2.2

trtutils(cuda)

yolov9m

320

2.2

2.2

2.1

2.4

trtutils(cuda)

yolov9m

480

2.6

2.6

2.5

3.0

trtutils(cuda)

yolov9m

640

3.2

3.2

3.2

3.7

trtutils(cuda)

yolov9m

800

4.0

4.0

3.8

4.8

trtutils(cuda)

yolov9m

960

5.2

5.2

4.9

5.4

trtutils(cuda)

yolov9m

1120

6.2

6.2

5.7

6.5

trtutils(cuda)

yolov9m

1280

7.9

7.8

7.1

8.2

trtutils(cuda)

yolov8n

160

1.1

1.1

1.1

1.5

trtutils(cuda)

yolov8n

320

1.2

1.2

1.1

1.5

trtutils(cuda)

yolov8n

480

1.2

1.2

1.2

1.7

trtutils(cuda)

yolov8n

640

1.3

1.3

1.3

1.8

trtutils(cuda)

yolov8n

800

1.5

1.5

1.4

2.4

trtutils(cuda)

yolov8n

960

1.7

1.7

1.7

2.2

trtutils(cuda)

yolov8n

1120

1.9

1.9

1.9

2.6

trtutils(cuda)

yolov8n

1280

2.3

2.3

2.2

2.9

trtutils(cuda)

yolov8s

160

1.2

1.2

1.2

1.5

trtutils(cuda)

yolov8s

320

1.3

1.3

1.3

1.5

trtutils(cuda)

yolov8s

480

1.4

1.4

1.4

1.8

trtutils(cuda)

yolov8s

640

1.7

1.7

1.6

2.1

trtutils(cuda)

yolov8s

800

1.9

1.9

1.9

2.9

trtutils(cuda)

yolov8s

960

2.4

2.4

2.3

2.8

trtutils(cuda)

yolov8s

1120

2.8

2.8

2.6

3.2

trtutils(cuda)

yolov8s

1280

3.5

3.5

3.3

4.0

trtutils(cuda)

yolov8m

160

1.5

1.5

1.5

1.8

trtutils(cuda)

yolov8m

320

1.7

1.7

1.6

1.9

trtutils(cuda)

yolov8m

480

2.1

2.1

2.0

2.5

trtutils(cuda)

yolov8m

640

2.6

2.6

2.5

2.9

trtutils(cuda)

yolov8m

800

3.2

3.2

3.0

4.0

trtutils(cuda)

yolov8m

960

4.4

4.4

4.1

4.6

trtutils(cuda)

yolov8m

1120

5.2

5.2

4.8

5.4

trtutils(cuda)

yolov8m

1280

6.4

6.4

5.8

6.7

trtutils(cuda)

yolov7t

160

1.1

1.1

1.1

1.6

trtutils(cuda)

yolov7t

320

1.2

1.2

1.2

6.8

trtutils(cuda)

yolov7t

480

1.3

1.3

1.3

1.5

trtutils(cuda)

yolov7t

640

1.5

1.5

1.4

2.0

trtutils(cuda)

yolov7t

800

1.7

1.7

1.7

2.7

trtutils(cuda)

yolov7t

960

2.0

2.0

2.0

2.5

trtutils(cuda)

yolov7t

1120

2.3

2.3

2.3

2.8

trtutils(cuda)

yolov7t

1280

2.8

2.8

2.7

3.5

trtutils(cuda)

yolov7m

160

1.5

1.5

1.5

1.8

trtutils(cuda)

yolov7m

320

1.8

1.8

1.8

2.2

trtutils(cuda)

yolov7m

480

2.3

2.3

2.3

2.5

trtutils(cuda)

yolov7m

640

3.1

3.1

3.0

3.5

trtutils(cuda)

yolov7m

800

3.9

3.9

3.6

4.6

trtutils(cuda)

yolov7m

960

5.3

5.3

4.8

5.5

trtutils(cuda)

yolov7m

1120

6.4

6.3

5.7

6.7

trtutils(cuda)

yolov7m

1280

8.4

8.4

7.5

8.8

trtutils(cuda)

yoloxt

160

1.2

1.2

1.2

1.4

trtutils(cuda)

yoloxt

320

1.3

1.3

1.3

2.4

trtutils(cuda)

yoloxt

480

1.6

1.6

1.6

1.8

trtutils(cuda)

yoloxt

640

1.9

1.9

1.9

2.4

trtutils(cuda)

yoloxt

800

2.4

2.4

2.4

3.5

trtutils(cuda)

yoloxt

960

3.1

3.1

3.0

4.1

trtutils(cuda)

yoloxt

1120

3.7

3.7

3.7

4.8

trtutils(cuda)

yoloxt

1280

4.5

4.5

4.5

5.7

trtutils(cuda)

yoloxn

160

1.2

1.2

1.2

1.6

trtutils(cuda)

yoloxn

320

1.3

1.3

1.3

2.4

trtutils(cuda)

yoloxn

480

1.5

1.5

1.5

1.8

trtutils(cuda)

yoloxn

640

1.9

1.9

1.8

2.4

trtutils(cuda)

yoloxn

800

2.3

2.3

2.3

3.4

trtutils(cuda)

yoloxn

960

2.8

2.8

2.8

3.9

trtutils(cuda)

yoloxn

1120

3.4

3.4

3.4

4.5

trtutils(cuda)

yoloxn

1280

4.1

4.1

4.0

5.4

trtutils(cuda)

yoloxs

160

1.2

1.2

1.2

1.5

trtutils(cuda)

yoloxs

320

1.4

1.4

1.3

2.2

trtutils(cuda)

yoloxs

480

1.7

1.7

1.6

2.0

trtutils(cuda)

yoloxs

640

2.1

2.1

2.1

2.6

trtutils(cuda)

yoloxs

800

2.6

2.6

2.6

3.6

trtutils(cuda)

yoloxs

960

3.3

3.3

3.2

4.4

trtutils(cuda)

yoloxs

1120

4.0

4.0

3.9

5.1

trtutils(cuda)

yoloxs

1280

5.0

5.0

5.0

6.2

trtutils(cuda)

yoloxm

160

1.5

1.5

1.4

1.7

trtutils(cuda)

yoloxm

320

1.7

1.7

1.7

2.7

trtutils(cuda)

yoloxm

480

2.2

2.2

2.2

2.4

trtutils(cuda)

yoloxm

640

2.8

2.8

2.8

3.2

trtutils(cuda)

yoloxm

800

3.7

3.7

3.6

4.6

trtutils(cuda)

yoloxm

960

5.2

5.2

5.0

6.1

trtutils(cuda)

yoloxm

1120

6.1

6.1

5.9

7.0

trtutils(cuda)

yoloxm

1280

7.4

7.4

7.2

8.4

trtutils(cpu)

yolov10n

160

0.9

0.8

0.8

1.1

trtutils(cpu)

yolov10n

320

1.4

1.4

1.3

1.5

trtutils(cpu)

yolov10n

480

2.6

2.6

2.5

2.8

trtutils(cpu)

yolov10n

640

7.3

7.3

6.0

7.7

trtutils(cpu)

yolov10n

800

11.0

11.0

9.3

11.5

trtutils(cpu)

yolov10n

960

15.2

15.2

13.4

15.9

trtutils(cpu)

yolov10n

1120

21.2

21.2

18.5

22.0

trtutils(cpu)

yolov10n

1280

29.2

29.2

28.9

29.8

trtutils(cpu)

yolov10s

160

0.9

0.9

0.9

1.1

trtutils(cpu)

yolov10s

320

1.5

1.5

1.5

1.7

trtutils(cpu)

yolov10s

480

2.5

2.5

2.5

2.7

trtutils(cpu)

yolov10s

640

5.3

5.3

5.1

5.5

trtutils(cpu)

yolov10s

800

8.4

8.4

8.2

9.0

trtutils(cpu)

yolov10s

960

12.8

12.8

12.5

13.0

trtutils(cpu)

yolov10s

1120

21.1

21.1

20.8

22.8

trtutils(cpu)

yolov10s

1280

30.8

30.8

30.3

31.4

trtutils(cpu)

yolov10m

160

1.2

1.2

1.2

1.3

trtutils(cpu)

yolov10m

320

1.9

1.9

1.8

1.9

trtutils(cpu)

yolov10m

480

3.3

3.3

3.3

3.7

trtutils(cpu)

yolov10m

640

6.0

6.0

5.9

6.6

trtutils(cpu)

yolov10m

800

10.1

10.1

9.8

10.3

trtutils(cpu)

yolov10m

960

14.6

14.7

14.2

15.6

trtutils(cpu)

yolov10m

1120

23.1

23.1

22.6

23.8

trtutils(cpu)

yolov10m

1280

32.9

32.9

32.2

33.4

trtutils(cpu)

yolov9t

160

1.5

1.5

1.5

1.6

trtutils(cpu)

yolov9t

320

2.1

2.1

2.1

2.2

trtutils(cpu)

yolov9t

480

3.1

3.1

3.0

3.8

trtutils(cpu)

yolov9t

640

5.6

5.5

5.5

5.9

trtutils(cpu)

yolov9t

800

8.8

8.8

8.5

9.1

trtutils(cpu)

yolov9t

960

12.9

12.9

12.6

13.7

trtutils(cpu)

yolov9t

1120

21.4

21.4

21.0

22.6

trtutils(cpu)

yolov9t

1280

30.1

30.1

29.6

30.5

trtutils(cpu)

yolov9s

160

1.6

1.6

1.6

1.7

trtutils(cpu)

yolov9s

320

2.2

2.2

2.1

2.7

trtutils(cpu)

yolov9s

480

3.2

3.2

3.2

3.4

trtutils(cpu)

yolov9s

640

5.9

5.9

5.8

6.1

trtutils(cpu)

yolov9s

800

9.3

9.3

9.1

9.6

trtutils(cpu)

yolov9s

960

13.5

13.6

13.2

14.4

trtutils(cpu)

yolov9s

1120

21.7

21.7

21.2

22.0

trtutils(cpu)

yolov9s

1280

31.5

31.5

31.0

32.2

trtutils(cpu)

yolov9m

160

1.6

1.6

1.5

1.7

trtutils(cpu)

yolov9m

320

2.2

2.3

2.2

2.4

trtutils(cpu)

yolov9m

480

3.6

3.6

3.5

3.9

trtutils(cpu)

yolov9m

640

6.6

6.6

6.5

7.2

trtutils(cpu)

yolov9m

800

10.5

10.5

10.4

11.7

trtutils(cpu)

yolov9m

960

15.1

15.1

14.9

16.7

trtutils(cpu)

yolov9m

1120

23.9

23.9

23.3

24.4

trtutils(cpu)

yolov9m

1280

34.4

34.4

33.7

35.0

trtutils(cpu)

yolov8n

160

0.8

0.8

0.7

0.8

trtutils(cpu)

yolov8n

320

1.2

1.2

1.2

1.4

trtutils(cpu)

yolov8n

480

2.4

2.4

2.3

2.6

trtutils(cpu)

yolov8n

640

5.1

5.1

5.0

6.5

trtutils(cpu)

yolov8n

800

8.4

8.3

8.2

8.9

trtutils(cpu)

yolov8n

960

11.4

11.4

11.2

12.1

trtutils(cpu)

yolov8n

1120

20.0

20.0

19.8

20.3

trtutils(cpu)

yolov8n

1280

28.9

28.9

28.6

29.4

trtutils(cpu)

yolov8s

160

0.8

0.8

0.8

0.9

trtutils(cpu)

yolov8s

320

1.4

1.4

1.4

1.6

trtutils(cpu)

yolov8s

480

2.7

2.6

2.6

2.8

trtutils(cpu)

yolov8s

640

5.4

5.4

5.3

5.6

trtutils(cpu)

yolov8s

800

8.8

8.8

8.6

9.2

trtutils(cpu)

yolov8s

960

12.1

12.1

11.8

12.8

trtutils(cpu)

yolov8s

1120

20.7

20.7

20.4

21.2

trtutils(cpu)

yolov8s

1280

30.1

30.1

29.7

30.4

trtutils(cpu)

yolov8m

160

1.1

1.1

1.1

1.2

trtutils(cpu)

yolov8m

320

1.8

1.8

1.8

1.9

trtutils(cpu)

yolov8m

480

3.3

3.2

3.2

3.5

trtutils(cpu)

yolov8m

640

6.2

6.2

6.1

6.5

trtutils(cpu)

yolov8m

800

9.9

10.0

9.7

10.1

trtutils(cpu)

yolov8m

960

13.9

14.0

13.6

14.5

trtutils(cpu)

yolov8m

1120

23.0

23.0

22.5

24.0

trtutils(cpu)

yolov8m

1280

32.7

32.7

32.1

33.5

trtutils(cpu)

yolov7t

160

0.8

0.8

0.8

0.9

trtutils(cpu)

yolov7t

320

1.3

1.3

1.3

1.4

trtutils(cpu)

yolov7t

480

2.4

2.4

2.4

3.1

trtutils(cpu)

yolov7t

640

5.2

5.2

5.1

5.5

trtutils(cpu)

yolov7t

800

8.4

8.5

8.3

8.8

trtutils(cpu)

yolov7t

960

12.3

12.3

12.2

12.8

trtutils(cpu)

yolov7t

1120

20.2

20.2

19.9

20.7

trtutils(cpu)

yolov7t

1280

29.6

29.6

29.3

30.2

trtutils(cpu)

yolov7m

160

1.2

1.2

1.1

1.3

trtutils(cpu)

yolov7m

320

1.9

1.9

1.9

2.0

trtutils(cpu)

yolov7m

480

3.2

3.2

3.2

3.4

trtutils(cpu)

yolov7m

640

6.2

6.2

6.2

6.8

trtutils(cpu)

yolov7m

800

10.0

10.0

9.9

10.6

trtutils(cpu)

yolov7m

960

15.1

15.0

14.9

15.5

trtutils(cpu)

yolov7m

1120

23.9

23.9

23.4

24.6

trtutils(cpu)

yolov7m

1280

34.7

34.7

34.0

35.2

trtutils(cpu)

yoloxt

160

0.8

0.8

0.8

0.9

trtutils(cpu)

yoloxt

320

1.4

1.4

1.4

1.5

trtutils(cpu)

yoloxt

480

2.8

2.8

2.7

3.0

trtutils(cpu)

yoloxt

640

5.3

5.3

5.2

5.7

trtutils(cpu)

yoloxt

800

9.4

9.4

9.2

9.8

trtutils(cpu)

yoloxt

960

13.6

13.6

13.4

14.3

trtutils(cpu)

yoloxt

1120

21.5

21.5

21.2

21.7

trtutils(cpu)

yoloxt

1280

31.6

31.6

31.2

32.1

trtutils(cpu)

yoloxn

160

0.8

0.8

0.8

0.9

trtutils(cpu)

yoloxn

320

1.4

1.4

1.4

1.5

trtutils(cpu)

yoloxn

480

3.1

3.1

3.0

3.6

trtutils(cpu)

yoloxn

640

5.1

5.1

5.0

5.5

trtutils(cpu)

yoloxn

800

9.3

9.3

9.1

9.6

trtutils(cpu)

yoloxn

960

13.3

13.3

13.1

13.6

trtutils(cpu)

yoloxn

1120

21.3

21.3

21.0

22.6

trtutils(cpu)

yoloxn

1280

31.1

31.1

30.8

31.7

trtutils(cpu)

yoloxs

160

0.8

0.8

0.8

0.9

trtutils(cpu)

yoloxs

320

1.4

1.4

1.4

1.5

trtutils(cpu)

yoloxs

480

3.2

3.2

3.1

3.3

trtutils(cpu)

yoloxs

640

5.8

5.8

5.7

6.0

trtutils(cpu)

yoloxs

800

9.5

9.6

9.3

9.8

trtutils(cpu)

yoloxs

960

13.8

13.8

13.5

14.2

trtutils(cpu)

yoloxs

1120

21.7

21.7

21.4

22.3

trtutils(cpu)

yoloxs

1280

31.9

31.9

31.5

32.3

trtutils(cpu)

yoloxm

160

1.1

1.1

1.1

1.2

trtutils(cpu)

yoloxm

320

1.8

1.8

1.8

1.9

trtutils(cpu)

yoloxm

480

3.2

3.2

3.1

3.5

trtutils(cpu)

yoloxm

640

6.6

6.5

6.5

7.3

trtutils(cpu)

yoloxm

800

10.4

10.4

10.2

10.9

trtutils(cpu)

yoloxm

960

15.6

15.6

15.2

16.2

trtutils(cpu)

yoloxm

1120

24.0

24.0

23.6

25.0

trtutils(cpu)

yoloxm

1280

34.4

34.4

33.8

34.8

ultralytics(trt)

yolov10n

160

1.2

1.2

1.2

1.4

ultralytics(trt)

yolov10n

320

1.3

1.3

1.3

1.5

ultralytics(trt)

yolov10n

480

1.7

1.7

1.7

1.9

ultralytics(trt)

yolov10n

640

4.9

4.7

4.2

6.8

ultralytics(trt)

yolov10n

800

2.9

2.8

2.8

3.0

ultralytics(trt)

yolov10n

960

3.8

3.7

3.6

5.8

ultralytics(trt)

yolov10n

1120

8.8

8.5

7.3

17.2

ultralytics(trt)

yolov10n

1280

5.8

5.8

5.8

5.9

ultralytics(trt)

yolov10s

160

1.2

1.2

1.2

1.3

ultralytics(trt)

yolov10s

320

1.5

1.5

1.5

1.6

ultralytics(trt)

yolov10s

480

2.1

2.1

2.0

2.3

ultralytics(trt)

yolov10s

640

2.7

2.7

2.7

2.9

ultralytics(trt)

yolov10s

800

3.5

3.5

3.4

4.0

ultralytics(trt)

yolov10s

960

4.5

4.5

4.5

4.9

ultralytics(trt)

yolov10s

1120

5.8

5.8

5.7

6.1

ultralytics(trt)

yolov10s

1280

7.5

7.5

7.4

7.8

ultralytics(trt)

yolov10m

160

1.5

1.5

1.5

1.6

ultralytics(trt)

yolov10m

320

1.9

1.9

1.8

2.0

ultralytics(trt)

yolov10m

480

2.6

2.6

2.6

2.7

ultralytics(trt)

yolov10m

640

3.4

3.4

3.4

3.5

ultralytics(trt)

yolov10m

800

4.6

4.6

4.5

4.8

ultralytics(trt)

yolov10m

960

6.3

6.3

6.3

7.0

ultralytics(trt)

yolov10m

1120

8.0

8.0

7.9

8.4

ultralytics(trt)

yolov10m

1280

10.0

10.0

9.9

10.3

ultralytics(trt)

yolov9t

160

2.1

2.1

2.0

2.2

ultralytics(trt)

yolov9t

320

2.3

2.3

2.3

2.6

ultralytics(trt)

yolov9t

480

2.7

2.7

2.7

3.2

ultralytics(trt)

yolov9t

640

3.2

3.2

3.2

3.6

ultralytics(trt)

yolov9t

800

4.0

4.0

3.9

5.5

ultralytics(trt)

yolov9t

960

5.0

4.9

4.9

5.8

ultralytics(trt)

yolov9t

1120

6.2

6.2

6.1

7.1

ultralytics(trt)

yolov9t

1280

7.6

7.6

7.5

8.6

ultralytics(trt)

yolov9s

160

2.3

2.3

2.3

2.5

ultralytics(trt)

yolov9s

320

2.5

2.5

2.4

2.6

ultralytics(trt)

yolov9s

480

2.9

2.9

2.9

3.0

ultralytics(trt)

yolov9s

640

3.5

3.5

3.4

3.6

ultralytics(trt)

yolov9s

800

4.4

4.4

4.3

4.8

ultralytics(trt)

yolov9s

960

5.7

5.6

5.6

5.8

ultralytics(trt)

yolov9s

1120

6.8

6.8

6.7

7.1

ultralytics(trt)

yolov9s

1280

8.5

8.4

8.3

8.7

ultralytics(trt)

yolov9m

160

2.1

2.1

2.0

2.2

ultralytics(trt)

yolov9m

320

2.5

2.5

2.5

2.7

ultralytics(trt)

yolov9m

480

3.3

3.3

3.2

3.4

ultralytics(trt)

yolov9m

640

4.2

4.2

4.1

4.3

ultralytics(trt)

yolov9m

800

5.4

5.4

5.3

5.6

ultralytics(trt)

yolov9m

960

7.1

7.1

7.0

7.3

ultralytics(trt)

yolov9m

1120

9.1

9.1

9.0

9.3

ultralytics(trt)

yolov9m

1280

11.4

11.4

11.2

11.8

ultralytics(trt)

yolov8n

160

1.4

1.4

1.4

1.5

ultralytics(trt)

yolov8n

320

1.7

1.7

1.7

1.8

ultralytics(trt)

yolov8n

480

2.0

2.0

2.0

2.5

ultralytics(trt)

yolov8n

640

2.5

2.5

2.5

2.9

ultralytics(trt)

yolov8n

800

3.1

3.1

3.1

3.3

ultralytics(trt)

yolov8n

960

4.1

4.1

4.0

4.2

ultralytics(trt)

yolov8n

1120

5.1

5.1

5.1

5.3

ultralytics(trt)

yolov8n

1280

6.5

6.5

6.4

6.6

ultralytics(trt)

yolov8s

160

1.5

1.5

1.4

1.6

ultralytics(trt)

yolov8s

320

1.8

1.8

1.8

1.8

ultralytics(trt)

yolov8s

480

2.2

2.2

2.2

2.3

ultralytics(trt)

yolov8s

640

2.8

2.8

2.8

2.9

ultralytics(trt)

yolov8s

800

3.5

3.5

3.5

3.6

ultralytics(trt)

yolov8s

960

4.7

4.7

4.6

5.0

ultralytics(trt)

yolov8s

1120

5.8

5.8

5.7

6.1

ultralytics(trt)

yolov8s

1280

7.5

7.5

7.4

7.8

ultralytics(trt)

yolov8m

160

1.8

1.8

1.8

1.9

ultralytics(trt)

yolov8m

320

2.2

2.2

2.2

2.4

ultralytics(trt)

yolov8m

480

2.8

2.8

2.8

2.9

ultralytics(trt)

yolov8m

640

3.7

3.7

3.6

3.9

ultralytics(trt)

yolov8m

800

4.7

4.7

4.7

5.0

ultralytics(trt)

yolov8m

960

6.6

6.6

6.5

6.9

ultralytics(trt)

yolov8m

1120

8.0

8.0

7.9

8.3

ultralytics(trt)

yolov8m

1280

10.0

10.0

9.9

10.3

ultralytics(torch)

yolov10n

160

6.0

5.9

5.9

6.7

ultralytics(torch)

yolov10n

320

6.2

6.2

6.2

6.4

ultralytics(torch)

yolov10n

480

6.4

6.4

6.4

6.5

ultralytics(torch)

yolov10n

640

7.2

7.3

6.8

10.5

ultralytics(torch)

yolov10n

800

12.3

14.2

7.2

17.8

ultralytics(torch)

yolov10n

960

7.4

7.4

7.3

7.7

ultralytics(torch)

yolov10n

1120

8.2

8.1

7.8

10.9

ultralytics(torch)

yolov10n

1280

18.4

18.5

14.1

46.2

ultralytics(torch)

yolov10s

160

6.2

6.2

6.2

6.5

ultralytics(torch)

yolov10s

320

6.5

6.5

6.5

6.6

ultralytics(torch)

yolov10s

480

6.8

6.7

6.6

8.4

ultralytics(torch)

yolov10s

640

6.9

6.9

6.8

7.5

ultralytics(torch)

yolov10s

800

7.4

7.4

7.3

7.6

ultralytics(torch)

yolov10s

960

8.1

8.0

7.8

12.4

ultralytics(torch)

yolov10s

1120

8.6

8.6

8.6

9.1

ultralytics(torch)

yolov10s

1280

10.4

10.4

10.3

10.5

ultralytics(torch)

yolov10m

160

7.7

7.7

7.6

8.2

ultralytics(torch)

yolov10m

320

7.8

7.8

7.7

8.5

ultralytics(torch)

yolov10m

480

8.0

8.0

7.9

8.3

ultralytics(torch)

yolov10m

640

8.3

8.3

8.1

8.6

ultralytics(torch)

yolov10m

800

8.9

8.9

8.8

9.1

ultralytics(torch)

yolov10m

960

11.6

11.6

11.5

11.9

ultralytics(torch)

yolov10m

1120

14.7

14.7

14.5

15.1

ultralytics(torch)

yolov10m

1280

19.1

19.1

18.9

21.1

ultralytics(torch)

yolov9t

160

11.0

10.8

9.9

12.6

ultralytics(torch)

yolov9t

320

10.0

10.0

9.7

10.8

ultralytics(torch)

yolov9t

480

10.2

10.1

10.0

11.5

ultralytics(torch)

yolov9t

640

10.3

10.3

10.2

11.2

ultralytics(torch)

yolov9t

800

11.0

10.9

10.7

12.3

ultralytics(torch)

yolov9t

960

11.6

11.5

11.4

13.1

ultralytics(torch)

yolov9t

1120

25.2

26.5

12.5

30.5

ultralytics(torch)

yolov9t

1280

13.1

13.0

12.9

14.7

ultralytics(torch)

yolov9s

160

23.5

23.6

16.6

31.7

ultralytics(torch)

yolov9s

320

10.7

10.6

10.5

13.3

ultralytics(torch)

yolov9s

480

11.0

11.0

10.8

11.3

ultralytics(torch)

yolov9s

640

11.2

11.1

11.0

11.8

ultralytics(torch)

yolov9s

800

11.3

11.3

11.2

12.3

ultralytics(torch)

yolov9s

960

11.9

11.9

11.8

12.3

ultralytics(torch)

yolov9s

1120

12.7

12.7

12.6

13.2

ultralytics(torch)

yolov9s

1280

13.5

13.4

13.3

14.0

ultralytics(torch)

yolov9m

160

8.7

8.7

8.6

9.4

ultralytics(torch)

yolov9m

320

8.9

8.9

8.8

9.5

ultralytics(torch)

yolov9m

480

9.1

9.1

9.0

10.1

ultralytics(torch)

yolov9m

640

9.3

9.3

9.1

9.8

ultralytics(torch)

yolov9m

800

10.4

10.4

10.4

11.2

ultralytics(torch)

yolov9m

960

13.3

13.3

13.2

13.7

ultralytics(torch)

yolov9m

1120

16.3

16.3

16.1

16.6

ultralytics(torch)

yolov9m

1280

21.7

21.7

21.4

23.5

ultralytics(torch)

yolov8n

160

4.4

4.4

4.4

4.8

ultralytics(torch)

yolov8n

320

4.7

4.7

4.7

4.8

ultralytics(torch)

yolov8n

480

4.9

4.9

4.9

5.5

ultralytics(torch)

yolov8n

640

5.1

5.1

5.0

5.1

ultralytics(torch)

yolov8n

800

5.4

5.4

5.4

5.6

ultralytics(torch)

yolov8n

960

5.9

5.9

5.8

6.4

ultralytics(torch)

yolov8n

1120

6.3

6.3

6.2

6.7

ultralytics(torch)

yolov8n

1280

6.9

6.9

6.8

7.1

ultralytics(torch)

yolov8s

160

4.6

4.6

4.5

4.9

ultralytics(torch)

yolov8s

320

4.9

4.9

4.8

5.2

ultralytics(torch)

yolov8s

480

5.0

5.0

4.9

5.7

ultralytics(torch)

yolov8s

640

5.1

5.1

5.1

5.3

ultralytics(torch)

yolov8s

800

5.5

5.5

5.4

5.6

ultralytics(torch)

yolov8s

960

6.1

6.1

6.0

6.3

ultralytics(torch)

yolov8s

1120

8.0

8.0

7.9

8.4

ultralytics(torch)

yolov8s

1280

9.3

9.3

9.2

9.6

ultralytics(torch)

yolov8m

160

5.7

5.7

5.6

6.2

ultralytics(torch)

yolov8m

320

5.9

5.9

5.9

6.3

ultralytics(torch)

yolov8m

480

6.0

6.0

5.9

6.3

ultralytics(torch)

yolov8m

640

6.5

6.5

6.4

7.0

ultralytics(torch)

yolov8m

800

9.2

9.2

9.1

9.6

ultralytics(torch)

yolov8m

960

11.7

11.7

11.6

11.9

ultralytics(torch)

yolov8m

1120

14.8

14.8

14.6

15.2

ultralytics(torch)

yolov8m

1280

18.8

18.8

18.6

19.1