OrinNano-8GB

Developer Kit with Jetpack 5

This section contains benchmarking results for various YOLO models on the OrinNano-8GB platform.

Performance Plots

The following plots show the performance comparison between different YOLO models and frameworks:

yolov10m

yolov10m performance plot

yolov10n

yolov10n performance plot

yolov10s

yolov10s performance plot

yolov7m

yolov7m performance plot

yolov7t

yolov7t performance plot

yolov8m

yolov8m performance plot

yolov8n

yolov8n performance plot

yolov8s

yolov8s performance plot

yolov9m

yolov9m performance plot

yolov9s

yolov9s performance plot

yolov9t

yolov9t performance plot

yoloxm

yoloxm performance plot

yoloxn

yoloxn performance plot

yoloxs

yoloxs performance plot

yoloxt

yoloxt performance plot

Performance Table

The following table shows detailed performance metrics for all tested models:

Performance Metrics

Framework

Model

Input Size

Mean (ms)

Median (ms)

Min (ms)

Max (ms)

tensorrt

yolov10n

160

3.0

2.9

2.9

3.4

tensorrt

yolov10n

320

3.8

3.7

3.6

4.2

tensorrt

yolov10n

480

5.6

5.6

5.5

6.1

tensorrt

yolov10n

640

7.8

7.6

7.5

8.2

tensorrt

yolov10n

800

11.5

11.5

11.2

11.9

tensorrt

yolov10n

960

14.4

14.4

14.3

14.9

tensorrt

yolov10n

1120

19.8

19.7

19.7

20.2

tensorrt

yolov10n

1280

23.7

23.7

23.3

24.0

tensorrt

yolov10s

160

3.3

3.3

3.3

3.9

tensorrt

yolov10s

320

5.0

5.0

5.0

5.5

tensorrt

yolov10s

480

8.2

8.2

7.9

8.5

tensorrt

yolov10s

640

12.5

12.4

12.1

12.7

tensorrt

yolov10s

800

18.1

18.0

17.9

18.5

tensorrt

yolov10s

960

24.3

24.4

24.1

24.7

tensorrt

yolov10s

1120

32.6

32.5

32.3

33.0

tensorrt

yolov10s

1280

40.0

40.1

39.7

40.3

tensorrt

yolov10m

160

5.0

5.0

4.9

5.5

tensorrt

yolov10m

320

9.1

9.2

8.8

9.4

tensorrt

yolov10m

480

15.1

15.2

14.8

15.5

tensorrt

yolov10m

640

23.6

23.6

23.2

24.0

tensorrt

yolov10m

800

34.3

34.3

33.9

34.6

tensorrt

yolov10m

960

47.3

47.3

46.9

47.6

tensorrt

yolov10m

1120

63.3

63.4

62.9

63.7

tensorrt

yolov10m

1280

78.4

78.4

77.9

78.8

tensorrt

yolov9t

160

5.2

5.3

5.0

5.5

tensorrt

yolov9t

320

6.5

6.5

6.4

6.7

tensorrt

yolov9t

480

8.7

8.7

8.4

8.9

tensorrt

yolov9t

640

12.1

12.1

11.9

12.4

tensorrt

yolov9t

800

16.7

16.7

16.6

17.0

tensorrt

yolov9t

960

21.6

21.6

21.2

21.9

tensorrt

yolov9t

1120

28.6

28.5

28.3

28.8

tensorrt

yolov9t

1280

35.0

34.9

34.8

35.2

tensorrt

yolov9s

160

5.7

5.7

5.4

5.9

tensorrt

yolov9s

320

7.6

7.6

7.3

7.8

tensorrt

yolov9s

480

11.3

11.3

11.0

11.6

tensorrt

yolov9s

640

16.5

16.5

16.4

16.9

tensorrt

yolov9s

800

23.7

23.7

23.4

23.9

tensorrt

yolov9s

960

31.4

31.3

31.0

31.6

tensorrt

yolov9s

1120

41.5

41.5

41.4

41.7

tensorrt

yolov9s

1280

52.0

52.0

51.8

52.2

tensorrt

yolov9m

160

6.5

6.5

6.2

6.7

tensorrt

yolov9m

320

11.1

11.1

10.9

11.4

tensorrt

yolov9m

480

18.4

18.4

18.3

18.8

tensorrt

yolov9m

640

28.9

28.9

28.8

29.2

tensorrt

yolov9m

800

42.6

42.6

42.4

42.8

tensorrt

yolov9m

960

58.1

58.1

57.7

58.5

tensorrt

yolov9m

1120

77.3

77.3

77.0

77.6

tensorrt

yolov9m

1280

98.2

98.2

97.7

98.5

tensorrt

yolov8n

160

2.1

2.0

2.0

2.7

tensorrt

yolov8n

320

3.0

3.0

3.0

3.5

tensorrt

yolov8n

480

4.7

4.7

4.6

5.2

tensorrt

yolov8n

640

7.2

7.1

7.0

7.7

tensorrt

yolov8n

800

10.5

10.5

10.4

11.0

tensorrt

yolov8n

960

13.8

13.7

13.6

14.2

tensorrt

yolov8n

1120

18.7

18.7

18.4

18.9

tensorrt

yolov8n

1280

23.3

23.4

23.1

23.6

tensorrt

yolov8s

160

2.6

2.6

2.6

3.1

tensorrt

yolov8s

320

4.3

4.3

4.2

4.8

tensorrt

yolov8s

480

7.2

7.3

7.0

7.6

tensorrt

yolov8s

640

11.3

11.2

11.1

11.9

tensorrt

yolov8s

800

16.5

16.4

16.4

16.9

tensorrt

yolov8s

960

22.4

22.3

22.2

22.8

tensorrt

yolov8s

1120

29.5

29.4

29.3

30.0

tensorrt

yolov8s

1280

37.6

37.5

37.3

38.0

tensorrt

yolov8m

160

4.3

4.3

4.2

4.8

tensorrt

yolov8m

320

8.4

8.5

8.2

8.7

tensorrt

yolov8m

480

14.2

14.1

14.1

14.8

tensorrt

yolov8m

640

23.1

23.2

22.8

23.4

tensorrt

yolov8m

800

32.9

32.8

32.7

33.3

tensorrt

yolov8m

960

46.2

46.2

45.8

46.5

tensorrt

yolov8m

1120

61.0

61.1

60.6

61.3

tensorrt

yolov8m

1280

77.3

77.4

76.9

77.7

tensorrt

yolov7t

160

2.3

2.3

2.2

2.8

tensorrt

yolov7t

320

3.6

3.6

3.6

4.1

tensorrt

yolov7t

480

6.0

6.1

5.8

6.3

tensorrt

yolov7t

640

9.0

9.0

8.9

9.5

tensorrt

yolov7t

800

13.3

13.4

13.1

13.6

tensorrt

yolov7t

960

17.8

17.7

17.6

18.4

tensorrt

yolov7t

1120

24.0

23.9

23.8

24.6

tensorrt

yolov7t

1280

30.2

30.1

30.0

30.8

tensorrt

yolov7m

160

5.0

5.0

4.9

5.5

tensorrt

yolov7m

320

9.6

9.5

9.4

10.0

tensorrt

yolov7m

480

16.7

16.7

16.6

17.3

tensorrt

yolov7m

640

27.7

27.8

27.4

28.0

tensorrt

yolov7m

800

40.9

40.9

40.5

41.2

tensorrt

yolov7m

960

56.4

56.4

55.9

56.7

tensorrt

yolov7m

1120

75.2

75.2

74.8

75.5

tensorrt

yolov7m

1280

96.5

96.6

96.0

96.9

tensorrt

yoloxt

160

2.4

2.4

2.4

2.9

tensorrt

yoloxt

320

3.7

3.7

3.6

4.2

tensorrt

yoloxt

480

5.8

5.8

5.8

6.4

tensorrt

yoloxt

640

9.0

9.0

9.0

9.5

tensorrt

yoloxt

800

12.7

12.6

12.5

13.1

tensorrt

yoloxt

960

17.3

17.2

17.2

17.7

tensorrt

yoloxt

1120

22.7

22.6

22.5

23.2

tensorrt

yoloxt

1280

28.7

28.6

28.5

29.1

tensorrt

yoloxn

160

2.4

2.4

2.4

2.9

tensorrt

yoloxn

320

3.2

3.2

3.2

3.7

tensorrt

yoloxn

480

4.7

4.6

4.6

5.1

tensorrt

yoloxn

640

6.7

6.7

6.6

7.2

tensorrt

yoloxn

800

9.5

9.5

9.5

10.0

tensorrt

yoloxn

960

12.4

12.3

12.2

12.8

tensorrt

yoloxn

1120

16.5

16.4

16.4

16.9

tensorrt

yoloxn

1280

20.4

20.3

20.3

20.8

tensorrt

yoloxs

160

2.6

2.5

2.5

3.0

tensorrt

yoloxs

320

4.1

4.0

4.0

4.5

tensorrt

yoloxs

480

6.5

6.4

6.4

6.9

tensorrt

yoloxs

640

10.2

10.1

10.1

10.6

tensorrt

yoloxs

800

14.8

14.7

14.7

15.2

tensorrt

yoloxs

960

19.8

19.7

19.7

20.4

tensorrt

yoloxs

1120

26.3

26.2

26.1

26.8

tensorrt

yoloxs

1280

33.2

33.1

33.0

33.6

tensorrt

yoloxm

160

4.2

4.2

4.1

4.7

tensorrt

yoloxm

320

7.7

7.6

7.6

8.1

tensorrt

yoloxm

480

13.0

13.0

12.9

13.5

tensorrt

yoloxm

640

21.2

21.1

21.0

21.6

tensorrt

yoloxm

800

30.1

30.0

29.9

30.6

tensorrt

yoloxm

960

42.2

42.1

42.0

42.6

tensorrt

yoloxm

1120

55.8

55.8

55.5

56.2

tensorrt

yoloxm

1280

71.1

71.2

70.7

71.5

trtutils(trt)

yolov10n

160

4.8

4.8

4.7

5.5

trtutils(trt)

yolov10n

320

5.7

5.7

5.7

6.4

trtutils(trt)

yolov10n

480

7.6

7.6

7.6

8.8

trtutils(trt)

yolov10n

640

10.3

10.3

10.2

11.5

trtutils(trt)

yolov10n

800

14.3

14.3

14.2

15.8

trtutils(trt)

yolov10n

960

17.9

17.9

17.8

19.6

trtutils(trt)

yolov10n

1120

23.8

23.8

23.7

25.3

trtutils(trt)

yolov10n

1280

28.3

28.2

28.1

29.8

trtutils(trt)

yolov10s

160

5.3

5.3

5.2

5.9

trtutils(trt)

yolov10s

320

7.1

7.1

7.1

7.7

trtutils(trt)

yolov10s

480

10.3

10.3

10.3

11.5

trtutils(trt)

yolov10s

640

14.9

14.8

14.8

16.0

trtutils(trt)

yolov10s

800

21.0

21.0

20.9

23.1

trtutils(trt)

yolov10s

960

27.6

27.6

27.5

29.1

trtutils(trt)

yolov10s

1120

36.5

36.5

36.4

37.9

trtutils(trt)

yolov10s

1280

44.6

44.6

44.4

46.2

trtutils(trt)

yolov10m

160

7.0

7.0

6.8

7.6

trtutils(trt)

yolov10m

320

10.9

10.9

10.8

11.6

trtutils(trt)

yolov10m

480

17.2

17.2

17.2

18.4

trtutils(trt)

yolov10m

640

26.0

26.0

25.9

27.1

trtutils(trt)

yolov10m

800

37.1

37.1

36.9

39.0

trtutils(trt)

yolov10m

960

50.5

50.5

50.3

54.2

trtutils(trt)

yolov10m

1120

67.2

67.2

67.1

68.6

trtutils(trt)

yolov10m

1280

82.9

82.9

82.6

84.3

trtutils(trt)

yolov9t

160

7.1

7.1

7.0

7.7

trtutils(trt)

yolov9t

320

8.3

8.3

8.2

8.9

trtutils(trt)

yolov9t

480

10.8

10.8

10.8

11.9

trtutils(trt)

yolov9t

640

14.5

14.5

14.4

15.6

trtutils(trt)

yolov9t

800

19.5

19.5

19.4

21.2

trtutils(trt)

yolov9t

960

25.1

25.1

25.0

26.4

trtutils(trt)

yolov9t

1120

32.5

32.5

32.4

34.1

trtutils(trt)

yolov9t

1280

39.5

39.5

39.4

41.0

trtutils(trt)

yolov9s

160

7.5

7.4

7.3

8.4

trtutils(trt)

yolov9s

320

9.5

9.5

9.4

10.1

trtutils(trt)

yolov9s

480

13.5

13.5

13.4

14.6

trtutils(trt)

yolov9s

640

18.9

18.9

18.8

20.2

trtutils(trt)

yolov9s

800

26.5

26.5

26.4

28.3

trtutils(trt)

yolov9s

960

34.7

34.7

34.6

43.0

trtutils(trt)

yolov9s

1120

45.4

45.4

45.3

46.8

trtutils(trt)

yolov9s

1280

56.5

56.5

56.3

58.1

trtutils(trt)

yolov9m

160

8.2

8.2

8.1

8.9

trtutils(trt)

yolov9m

320

13.0

12.9

12.8

13.9

trtutils(trt)

yolov9m

480

20.5

20.5

20.4

21.6

trtutils(trt)

yolov9m

640

31.4

31.4

31.3

32.6

trtutils(trt)

yolov9m

800

45.3

45.3

45.2

46.9

trtutils(trt)

yolov9m

960

61.6

61.6

61.5

63.2

trtutils(trt)

yolov9m

1120

81.1

81.1

80.9

82.6

trtutils(trt)

yolov9m

1280

102.7

102.7

102.6

104.4

trtutils(trt)

yolov8n

160

4.1

4.1

4.0

5.1

trtutils(trt)

yolov8n

320

5.1

5.1

5.0

5.7

trtutils(trt)

yolov8n

480

7.0

7.0

7.0

8.2

trtutils(trt)

yolov8n

640

9.7

9.6

9.6

10.8

trtutils(trt)

yolov8n

800

13.5

13.5

13.4

15.1

trtutils(trt)

yolov8n

960

17.3

17.3

17.2

19.1

trtutils(trt)

yolov8n

1120

22.6

22.6

22.6

24.1

trtutils(trt)

yolov8n

1280

28.0

28.0

27.9

29.5

trtutils(trt)

yolov8s

160

4.5

4.5

4.5

5.2

trtutils(trt)

yolov8s

320

6.4

6.3

6.3

7.1

trtutils(trt)

yolov8s

480

9.4

9.4

9.3

10.9

trtutils(trt)

yolov8s

640

13.9

13.9

13.8

15.2

trtutils(trt)

yolov8s

800

19.6

19.6

19.5

21.1

trtutils(trt)

yolov8s

960

25.8

25.8

25.7

27.3

trtutils(trt)

yolov8s

1120

33.6

33.6

33.5

35.1

trtutils(trt)

yolov8s

1280

42.3

42.3

42.2

43.9

trtutils(trt)

yolov8m

160

6.3

6.3

6.2

7.0

trtutils(trt)

yolov8m

320

10.3

10.3

10.2

11.3

trtutils(trt)

yolov8m

480

16.5

16.5

16.4

17.7

trtutils(trt)

yolov8m

640

25.7

25.7

25.6

26.8

trtutils(trt)

yolov8m

800

35.9

35.9

35.8

38.3

trtutils(trt)

yolov8m

960

49.5

49.5

49.4

50.8

trtutils(trt)

yolov8m

1120

65.0

64.9

64.7

66.6

trtutils(trt)

yolov8m

1280

82.0

81.9

81.7

83.7

trtutils(trt)

yolov7t

160

4.3

4.3

4.2

4.9

trtutils(trt)

yolov7t

320

5.7

5.7

5.7

6.4

trtutils(trt)

yolov7t

480

8.2

8.2

8.1

9.3

trtutils(trt)

yolov7t

640

11.6

11.6

11.5

13.0

trtutils(trt)

yolov7t

800

16.2

16.2

16.1

17.8

trtutils(trt)

yolov7t

960

21.2

21.2

21.2

22.5

trtutils(trt)

yolov7t

1120

28.0

28.0

27.9

29.5

trtutils(trt)

yolov7t

1280

34.9

34.9

34.8

36.3

trtutils(trt)

yolov7m

160

7.0

7.0

6.9

7.7

trtutils(trt)

yolov7m

320

11.7

11.7

11.6

12.8

trtutils(trt)

yolov7m

480

19.0

19.0

18.9

20.2

trtutils(trt)

yolov7m

640

30.2

30.2

30.1

31.4

trtutils(trt)

yolov7m

800

43.7

43.7

43.6

45.5

trtutils(trt)

yolov7m

960

59.8

59.8

59.4

61.4

trtutils(trt)

yolov7m

1120

78.9

78.9

78.7

80.4

trtutils(trt)

yolov7m

1280

101.0

101.0

100.7

102.4

trtutils(trt)

yoloxt

160

4.3

4.3

4.3

5.1

trtutils(trt)

yoloxt

320

5.8

5.8

5.7

6.7

trtutils(trt)

yoloxt

480

8.2

8.2

8.2

9.3

trtutils(trt)

yoloxt

640

11.8

11.8

11.8

13.6

trtutils(trt)

yoloxt

800

16.0

15.9

15.9

18.5

trtutils(trt)

yoloxt

960

21.2

21.2

21.1

23.9

trtutils(trt)

yoloxt

1120

27.3

27.3

27.2

30.5

trtutils(trt)

yoloxt

1280

34.1

34.1

34.0

38.0

trtutils(trt)

yoloxn

160

4.3

4.3

4.3

5.1

trtutils(trt)

yoloxn

320

5.3

5.3

5.2

6.1

trtutils(trt)

yoloxn

480

7.1

7.1

7.0

8.1

trtutils(trt)

yoloxn

640

9.7

9.7

9.6

11.5

trtutils(trt)

yoloxn

800

13.0

13.0

12.9

15.5

trtutils(trt)

yoloxn

960

16.5

16.5

16.5

19.3

trtutils(trt)

yoloxn

1120

21.5

21.4

21.4

24.7

trtutils(trt)

yoloxn

1280

26.3

26.3

26.3

30.3

trtutils(trt)

yoloxs

160

4.4

4.4

4.3

5.2

trtutils(trt)

yoloxs

320

6.1

6.1

6.0

7.0

trtutils(trt)

yoloxs

480

8.9

8.9

8.8

10.0

trtutils(trt)

yoloxs

640

13.0

12.9

12.9

14.7

trtutils(trt)

yoloxs

800

18.1

18.1

18.0

20.6

trtutils(trt)

yoloxs

960

23.7

23.7

23.6

26.8

trtutils(trt)

yoloxs

1120

30.9

30.8

30.7

34.0

trtutils(trt)

yoloxs

1280

38.6

38.6

38.4

42.5

trtutils(trt)

yoloxm

160

6.1

6.1

6.0

6.9

trtutils(trt)

yoloxm

320

9.6

9.6

9.6

10.7

trtutils(trt)

yoloxm

480

15.5

15.5

15.4

16.5

trtutils(trt)

yoloxm

640

23.9

23.9

23.9

25.8

trtutils(trt)

yoloxm

800

33.3

33.3

33.2

35.9

trtutils(trt)

yoloxm

960

46.1

46.0

45.9

48.8

trtutils(trt)

yoloxm

1120

60.3

60.3

60.2

63.6

trtutils(trt)

yoloxm

1280

76.4

76.4

76.3

80.2

trtutils(cuda)

yolov8n

160

4.8

4.8

4.7

5.6

trtutils(cuda)

yolov8n

320

5.8

5.7

5.7

15.5

trtutils(cuda)

yolov8n

480

7.5

7.5

7.4

8.4

trtutils(cuda)

yolov8n

640

10.1

10.1

10.0

11.4

trtutils(cuda)

yolov8n

800

13.7

13.7

13.6

15.8

trtutils(cuda)

yolov8n

960

17.2

17.2

17.1

18.9

trtutils(cuda)

yolov8n

1120

22.3

22.3

22.2

24.0

trtutils(cuda)

yolov8n

1280

27.4

27.4

27.3

29.1

trtutils(cuda)

yolov7t

160

5.0

5.0

4.9

6.1

trtutils(cuda)

yolov7t

320

6.4

6.4

6.3

7.5

trtutils(cuda)

yolov7t

480

8.7

8.7

8.6

9.5

trtutils(cuda)

yolov7t

640

12.0

12.0

11.9

13.6

trtutils(cuda)

yolov7t

800

16.4

16.4

16.3

18.3

trtutils(cuda)

yolov7t

960

21.2

21.2

21.1

22.6

trtutils(cuda)

yolov7t

1120

27.7

27.7

27.6

29.2

trtutils(cuda)

yolov7t

1280

34.3

34.3

34.2

35.9

trtutils(cuda)

yolov8s

160

5.3

5.3

5.2

6.1

trtutils(cuda)

yolov8s

320

7.0

7.0

6.9

7.8

trtutils(cuda)

yolov8s

480

9.9

9.9

9.8

10.7

trtutils(cuda)

yolov8s

640

14.2

14.2

14.1

15.5

trtutils(cuda)

yolov8s

800

19.8

19.8

19.7

21.5

trtutils(cuda)

yolov8s

960

25.8

25.8

25.7

27.2

trtutils(cuda)

yolov8s

1120

33.4

33.3

33.2

35.2

trtutils(cuda)

yolov8s

1280

41.8

41.8

41.6

43.4

trtutils(cuda)

yolov8m

160

7.0

7.0

6.9

7.8

trtutils(cuda)

yolov8m

320

11.0

11.0

10.9

12.0

trtutils(cuda)

yolov8m

480

17.0

17.0

16.9

17.8

trtutils(cuda)

yolov8m

640

26.0

26.0

25.8

27.7

trtutils(cuda)

yolov8m

800

36.0

36.0

35.9

37.7

trtutils(cuda)

yolov8m

960

49.5

49.5

49.3

51.2

trtutils(cuda)

yolov8m

1120

64.6

64.6

64.4

66.2

trtutils(cuda)

yolov8m

1280

81.4

81.4

81.2

83.1

trtutils(cuda)

yolov9t

160

7.8

7.8

7.7

8.5

trtutils(cuda)

yolov9t

320

8.9

8.9

8.8

9.6

trtutils(cuda)

yolov9t

480

11.4

11.4

11.3

12.1

trtutils(cuda)

yolov9t

640

15.0

15.0

14.9

16.5

trtutils(cuda)

yolov9t

800

19.7

19.7

19.6

21.5

trtutils(cuda)

yolov9t

960

24.9

24.9

24.7

26.2

trtutils(cuda)

yolov9t

1120

32.3

32.3

32.2

34.2

trtutils(cuda)

yolov9t

1280

38.9

38.9

38.8

40.6

trtutils(cuda)

yolov9s

160

8.1

8.1

8.0

8.9

trtutils(cuda)

yolov9s

320

10.1

10.1

10.0

11.0

trtutils(cuda)

yolov9s

480

14.0

14.0

13.9

14.7

trtutils(cuda)

yolov9s

640

19.4

19.4

19.3

28.9

trtutils(cuda)

yolov9s

800

26.7

26.7

26.5

28.7

trtutils(cuda)

yolov9s

960

34.7

34.7

34.6

36.1

trtutils(cuda)

yolov9s

1120

45.2

45.2

45.1

47.1

trtutils(cuda)

yolov9s

1280

56.0

56.0

55.9

57.8

trtutils(cuda)

yolov9m

160

8.9

8.9

8.8

9.6

trtutils(cuda)

yolov9m

320

13.6

13.6

13.5

14.7

trtutils(cuda)

yolov9m

480

21.0

21.0

20.9

22.2

trtutils(cuda)

yolov9m

640

31.8

31.8

31.7

33.2

trtutils(cuda)

yolov9m

800

45.5

45.5

45.4

47.3

trtutils(cuda)

yolov9m

960

61.7

61.7

61.6

63.3

trtutils(cuda)

yolov9m

1120

80.8

80.8

80.7

82.3

trtutils(cuda)

yolov9m

1280

102.3

102.3

102.1

103.9

trtutils(cuda)

yolov7m

160

7.7

7.7

7.6

8.5

trtutils(cuda)

yolov7m

320

12.3

12.3

12.2

13.3

trtutils(cuda)

yolov7m

480

19.6

19.6

19.5

20.7

trtutils(cuda)

yolov7m

640

30.7

30.6

30.5

32.2

trtutils(cuda)

yolov7m

800

43.9

43.9

43.8

45.9

trtutils(cuda)

yolov7m

960

59.7

59.7

59.5

61.4

trtutils(cuda)

yolov7m

1120

78.6

78.6

78.4

80.3

trtutils(cuda)

yolov7m

1280

100.4

100.4

100.2

102.1

trtutils(cuda)

yolov10n

160

5.7

5.6

5.5

171.8

trtutils(cuda)

yolov10n

320

6.4

6.4

6.3

7.1

trtutils(cuda)

yolov10n

480

8.2

8.2

8.2

9.0

trtutils(cuda)

yolov10n

640

10.6

10.6

10.5

11.9

trtutils(cuda)

yolov10n

800

14.5

14.5

14.4

16.2

trtutils(cuda)

yolov10n

960

17.9

17.8

17.8

19.4

trtutils(cuda)

yolov10n

1120

23.6

23.5

23.4

25.4

trtutils(cuda)

yolov10n

1280

27.6

27.6

27.5

29.5

trtutils(cuda)

yolov10s

160

6.1

6.0

6.0

7.0

trtutils(cuda)

yolov10s

320

7.8

7.8

7.7

8.5

trtutils(cuda)

yolov10s

480

10.8

10.8

10.7

11.6

trtutils(cuda)

yolov10s

640

15.2

15.2

15.1

16.4

trtutils(cuda)

yolov10s

800

21.3

21.2

21.1

23.3

trtutils(cuda)

yolov10s

960

27.7

27.7

27.6

29.0

trtutils(cuda)

yolov10s

1120

36.2

36.2

36.1

38.2

trtutils(cuda)

yolov10s

1280

44.0

44.0

43.9

45.6

trtutils(cuda)

yolov10m

160

7.7

7.7

7.6

8.5

trtutils(cuda)

yolov10m

320

11.6

11.6

11.5

12.3

trtutils(cuda)

yolov10m

480

17.7

17.7

17.6

18.7

trtutils(cuda)

yolov10m

640

26.5

26.4

26.3

28.0

trtutils(cuda)

yolov10m

800

37.3

37.3

37.1

38.9

trtutils(cuda)

yolov10m

960

50.6

50.6

50.4

52.2

trtutils(cuda)

yolov10m

1120

67.0

67.0

66.9

68.4

trtutils(cuda)

yolov10m

1280

82.2

82.2

82.0

84.1

trtutils(cuda)

yoloxt

160

5.0

5.0

5.0

6.1

trtutils(cuda)

yoloxt

320

6.5

6.5

6.4

7.9

trtutils(cuda)

yoloxt

480

8.8

8.8

8.7

10.0

trtutils(cuda)

yoloxt

640

12.3

12.3

12.2

14.2

trtutils(cuda)

yoloxt

800

16.2

16.2

16.0

18.8

trtutils(cuda)

yoloxt

960

21.2

21.2

21.0

24.4

trtutils(cuda)

yoloxt

1120

27.1

27.1

27.0

30.6

trtutils(cuda)

yoloxt

1280

33.6

33.6

33.4

38.0

trtutils(cuda)

yoloxn

160

5.0

5.0

4.9

6.0

trtutils(cuda)

yoloxn

320

6.0

6.0

5.9

7.5

trtutils(cuda)

yoloxn

480

7.6

7.6

7.5

8.8

trtutils(cuda)

yoloxn

640

10.0

10.0

9.9

11.9

trtutils(cuda)

yoloxn

800

13.3

13.3

13.1

15.8

trtutils(cuda)

yoloxn

960

16.6

16.5

16.3

19.7

trtutils(cuda)

yoloxn

1120

21.2

21.2

21.1

24.9

trtutils(cuda)

yoloxn

1280

25.9

25.9

25.8

30.3

trtutils(cuda)

yoloxs

160

5.2

5.2

5.1

6.1

trtutils(cuda)

yoloxs

320

6.8

6.8

6.7

8.3

trtutils(cuda)

yoloxs

480

9.5

9.5

9.4

11.0

trtutils(cuda)

yoloxs

640

13.4

13.4

13.3

15.5

trtutils(cuda)

yoloxs

800

18.3

18.3

18.2

21.3

trtutils(cuda)

yoloxs

960

23.7

23.7

23.5

27.6

trtutils(cuda)

yoloxs

1120

30.7

30.7

30.6

34.6

trtutils(cuda)

yoloxs

1280

38.1

38.1

37.9

42.5

trtutils(cuda)

yoloxm

160

6.9

6.9

6.8

20.3

trtutils(cuda)

yoloxm

320

10.4

10.4

10.3

12.0

trtutils(cuda)

yoloxm

480

16.0

16.0

15.9

17.7

trtutils(cuda)

yoloxm

640

24.4

24.4

24.3

26.5

trtutils(cuda)

yoloxm

800

33.6

33.6

33.4

36.1

trtutils(cuda)

yoloxm

960

46.0

46.0

45.9

49.5

trtutils(cuda)

yoloxm

1120

60.1

60.1

60.0

64.0

trtutils(cuda)

yoloxm

1280

75.8

75.8

75.6

80.4

trtutils(cpu)

yolov10n

160

4.4

4.4

4.4

5.2

trtutils(cpu)

yolov10n

320

7.4

7.4

7.3

7.8

trtutils(cpu)

yolov10n

480

11.5

11.5

11.4

14.7

trtutils(cpu)

yolov10n

640

17.5

17.4

17.3

19.0

trtutils(cpu)

yolov10n

800

25.8

25.8

25.6

30.2

trtutils(cpu)

yolov10n

960

35.2

35.1

35.0

36.2

trtutils(cpu)

yolov10n

1120

54.1

54.0

53.6

57.8

trtutils(cpu)

yolov10n

1280

72.2

72.1

71.9

96.8

trtutils(cpu)

yolov10s

160

4.9

4.9

4.9

5.2

trtutils(cpu)

yolov10s

320

8.8

8.8

8.7

9.1

trtutils(cpu)

yolov10s

480

14.3

14.3

14.1

15.1

trtutils(cpu)

yolov10s

640

22.1

22.1

21.9

23.6

trtutils(cpu)

yolov10s

800

33.1

33.2

32.5

34.2

trtutils(cpu)

yolov10s

960

45.0

44.9

44.8

46.5

trtutils(cpu)

yolov10s

1120

67.0

67.1

66.4

67.5

trtutils(cpu)

yolov10s

1280

80.7

80.3

79.9

111.6

trtutils(cpu)

yolov10m

160

6.5

6.5

6.5

6.9

trtutils(cpu)

yolov10m

320

12.6

12.6

12.5

12.9

trtutils(cpu)

yolov10m

480

21.1

21.1

21.0

21.5

trtutils(cpu)

yolov10m

640

33.3

33.3

33.1

34.5

trtutils(cpu)

yolov10m

800

48.9

48.8

48.5

50.2

trtutils(cpu)

yolov10m

960

68.0

68.0

67.8

68.7

trtutils(cpu)

yolov10m

1120

91.2

91.3

90.8

93.0

trtutils(cpu)

yolov10m

1280

144.7

144.2

139.6

194.3

trtutils(cpu)

yolov9t

160

6.7

6.7

6.6

7.2

trtutils(cpu)

yolov9t

320

9.9

9.9

9.8

10.2

trtutils(cpu)

yolov9t

480

14.8

14.8

14.7

15.0

trtutils(cpu)

yolov9t

640

21.6

21.6

21.5

22.4

trtutils(cpu)

yolov9t

800

31.3

31.5

30.8

31.8

trtutils(cpu)

yolov9t

960

42.2

42.0

41.9

195.1

trtutils(cpu)

yolov9t

1120

56.4

56.4

56.1

57.6

trtutils(cpu)

yolov9t

1280

90.7

89.9

85.5

115.4

trtutils(cpu)

yolov9s

160

7.0

7.0

7.0

7.3

trtutils(cpu)

yolov9s

320

11.2

11.2

11.1

11.4

trtutils(cpu)

yolov9s

480

17.5

17.5

17.3

18.0

trtutils(cpu)

yolov9s

640

26.1

26.1

26.0

27.2

trtutils(cpu)

yolov9s

800

38.2

38.1

37.9

39.0

trtutils(cpu)

yolov9s

960

52.1

52.0

51.9

53.7

trtutils(cpu)

yolov9s

1120

69.3

69.2

68.9

70.6

trtutils(cpu)

yolov9s

1280

106.8

106.5

102.2

124.2

trtutils(cpu)

yolov9m

160

7.8

7.8

7.8

8.1

trtutils(cpu)

yolov9m

320

14.6

14.6

14.5

14.8

trtutils(cpu)

yolov9m

480

24.6

24.6

24.4

25.4

trtutils(cpu)

yolov9m

640

38.7

38.7

38.5

40.2

trtutils(cpu)

yolov9m

800

57.1

57.0

56.9

57.7

trtutils(cpu)

yolov9m

960

78.9

78.9

78.7

80.3

trtutils(cpu)

yolov9m

1120

104.8

104.8

104.7

106.0

trtutils(cpu)

yolov9m

1280

150.8

151.3

142.3

170.2

trtutils(cpu)

yolov8n

160

3.7

3.7

3.7

4.1

trtutils(cpu)

yolov8n

320

6.8

6.8

6.7

7.4

trtutils(cpu)

yolov8n

480

11.1

11.1

11.0

11.7

trtutils(cpu)

yolov8n

640

17.1

17.1

17.0

18.1

trtutils(cpu)

yolov8n

800

25.3

25.2

25.0

25.8

trtutils(cpu)

yolov8n

960

34.6

34.6

34.4

35.8

trtutils(cpu)

yolov8n

1120

46.4

46.3

46.1

47.4

trtutils(cpu)

yolov8n

1280

75.0

74.8

72.8

92.9

trtutils(cpu)

yolov8s

160

4.2

4.2

4.1

4.5

trtutils(cpu)

yolov8s

320

8.1

8.1

8.0

8.4

trtutils(cpu)

yolov8s

480

13.4

13.4

13.3

14.1

trtutils(cpu)

yolov8s

640

21.1

21.1

21.0

21.8

trtutils(cpu)

yolov8s

800

31.4

31.3

31.0

32.1

trtutils(cpu)

yolov8s

960

43.2

43.2

43.1

43.7

trtutils(cpu)

yolov8s

1120

57.5

57.4

57.0

59.3

trtutils(cpu)

yolov8s

1280

87.5

86.8

85.8

116.4

trtutils(cpu)

yolov8m

160

6.0

6.0

5.9

15.4

trtutils(cpu)

yolov8m

320

12.0

12.0

11.9

12.3

trtutils(cpu)

yolov8m

480

20.5

20.5

20.4

21.1

trtutils(cpu)

yolov8m

640

33.0

33.0

32.9

33.9

trtutils(cpu)

yolov8m

800

47.4

47.4

47.2

48.3

trtutils(cpu)

yolov8m

960

66.9

66.9

66.7

67.6

trtutils(cpu)

yolov8m

1120

88.8

88.7

88.3

89.8

trtutils(cpu)

yolov8m

1280

131.3

132.0

124.5

150.2

trtutils(cpu)

yolov7t

160

3.9

3.9

3.9

4.3

trtutils(cpu)

yolov7t

320

7.5

7.5

7.4

7.7

trtutils(cpu)

yolov7t

480

12.2

12.2

12.1

12.5

trtutils(cpu)

yolov7t

640

19.2

19.0

18.9

30.3

trtutils(cpu)

yolov7t

800

27.8

27.7

27.6

28.7

trtutils(cpu)

yolov7t

960

38.6

38.6

38.5

40.4

trtutils(cpu)

yolov7t

1120

51.8

51.8

51.5

70.1

trtutils(cpu)

yolov7t

1280

85.3

86.0

82.8

96.1

trtutils(cpu)

yolov7m

160

6.6

6.6

6.5

6.9

trtutils(cpu)

yolov7m

320

13.3

13.3

13.2

13.5

trtutils(cpu)

yolov7m

480

23.2

23.2

23.0

23.6

trtutils(cpu)

yolov7m

640

37.6

37.6

37.5

38.9

trtutils(cpu)

yolov7m

800

55.4

55.4

55.1

56.4

trtutils(cpu)

yolov7m

960

77.0

77.0

76.8

78.7

trtutils(cpu)

yolov7m

1120

102.8

102.7

102.5

104.4

trtutils(cpu)

yolov7m

1280

151.1

151.1

137.9

170.1

trtutils(cpu)

yoloxt

160

4.1

4.0

4.0

75.1

trtutils(cpu)

yoloxt

320

7.5

7.5

7.4

8.2

trtutils(cpu)

yoloxt

480

12.3

12.3

12.1

13.2

trtutils(cpu)

yoloxt

640

19.4

19.4

19.2

20.8

trtutils(cpu)

yoloxt

800

27.7

27.7

27.5

28.8

trtutils(cpu)

yoloxt

960

38.4

38.3

38.2

40.0

trtutils(cpu)

yoloxt

1120

51.1

51.0

50.8

53.8

trtutils(cpu)

yoloxt

1280

70.4

70.2

69.8

125.6

trtutils(cpu)

yoloxn

160

4.0

4.0

3.9

4.7

trtutils(cpu)

yoloxn

320

7.1

7.1

7.0

7.4

trtutils(cpu)

yoloxn

480

11.1

11.1

10.9

11.7

trtutils(cpu)

yoloxn

640

17.2

17.1

16.9

156.3

trtutils(cpu)

yoloxn

800

24.7

24.7

24.6

26.6

trtutils(cpu)

yoloxn

960

34.1

34.0

33.9

35.5

trtutils(cpu)

yoloxn

1120

45.4

45.3

45.1

47.8

trtutils(cpu)

yoloxn

1280

71.3

71.0

69.6

75.3

trtutils(cpu)

yoloxs

160

4.1

4.1

4.1

4.4

trtutils(cpu)

yoloxs

320

7.8

7.8

7.7

8.2

trtutils(cpu)

yoloxs

480

12.6

12.6

12.5

13.2

trtutils(cpu)

yoloxs

640

20.4

20.4

20.2

27.1

trtutils(cpu)

yoloxs

800

29.7

29.7

29.5

31.5

trtutils(cpu)

yoloxs

960

41.1

41.1

41.0

42.8

trtutils(cpu)

yoloxs

1120

54.6

54.6

54.3

57.2

trtutils(cpu)

yoloxs

1280

116.6

119.9

97.9

143.0

trtutils(cpu)

yoloxm

160

5.7

5.7

5.6

6.1

trtutils(cpu)

yoloxm

320

11.3

11.3

11.2

11.7

trtutils(cpu)

yoloxm

480

19.2

19.2

19.1

19.9

trtutils(cpu)

yoloxm

640

31.4

31.3

31.2

32.1

trtutils(cpu)

yoloxm

800

45.7

45.7

45.1

47.1

trtutils(cpu)

yoloxm

960

63.5

63.5

63.3

65.2

trtutils(cpu)

yoloxm

1120

84.2

84.2

83.9

86.4

trtutils(cpu)

yoloxm

1280

124.4

125.5

116.5

165.9