NOTE: following tests were done in May. 2025, which may not reflect latest status of the package.

AimRT 1.0.0-py  Performance Test Report

Preface

AimRT’s communication layer is implemented through plugins, with official support for backends including Iceoryx, ROS2, Zenoh, Net, Grpc, and Mqtt, covering common edge and cloud communication scenarios. These plugins provide two common communication patterns: Publish-Subscribe (Channel) and Request-Response (Rpc), enabling both intra-machine and cross-machine multi-process communication.

Test Environment

  • System Environment:

    • OS: 6.1.59-rt16 x86_64 GNU/Linux

    • CPU: 13th Gen Intel® Core™ i5-1350P

    • Total Memory/Available Memory: 62Gi / 38Gi

  • Software Environment:

    • AimRT Version: 1.0.0

Test Items

Tests were conducted using AimRT-py with the following items:

  • Single-Machine Performance Tests

    • Channel Backend Performance Tests

      • Impact of packet size on performance in multi-topic mode

      • Impact of topic count on performance in multi-topic mode

      • Impact of packet size on performance in parallel mode

      • Impact of concurrency level on performance in parallel mode

    • Rpc Backend Performance Tests

      • Impact of packet size on performance in bench mode

      • Impact of concurrency level on performance in bench mode

      • Impact of packet size on performance in fixed_freq mode

      • Impact of concurrency level on performance in fixed_freq mode

  • Cross-Machine Performance Tests

    • Channel Backend Performance Tests

      • Impact of packet size on performance in multi-topic mode

      • Impact of topic count on performance in multi-topic mode

      • Impact of packet size on performance in parallel mode

      • Impact of concurrency level on performance in parallel mode

    • Rpc Backend Performance Tests

      • Impact of packet size on performance in bench mode

      • Impact of concurrency level on performance in bench mode

      • Impact of packet size on performance in fixed_freq mode

      • Impact of concurrency level on performance in fixed_freq mode

Test Results

Single-Machine Performance Tests (X86)

Channel Backend Performance Tests

Impact of Packet Size on Performance in Multi-Topic Mode:

  • Test Objective: Performance test of single-machine cross-process Channel backend in multi-topic mode with varying packet sizes

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 256 B ~ 64 KB (2^8 ~ 2^16, increasing by powers of 2)

    • topic_number: 1

    • parallel_number=1

  • Test Results:

Impact of Topic Count on Performance in Multi-Topic Mode:

  • Test Objective: Performance test of single-machine cross-process Channel backend in multi-topic mode with varying topic counts

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • topic_number: 1 ~ 10

    • parallel_number=1

  • Test Results:

Impact of Packet Size on Performance in Parallel Mode:

  • Test Objective: Performance test of single-machine cross-process Channel backend in parallel mode with varying packet sizes

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • topic_number: 1

    • parallel_number=1 ~ 10

  • Test Results:

Impact of Concurrency Level on Performance in Parallel Mode:

  • Test Objective: Performance test of single-machine cross-process Channel backend in parallel mode with varying concurrency levels

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • topic_number: 1

    • parallel_number=1 ~ 10

  • Test Results:

Detailed Data

Rpc Backend Performance Tests

Impact of Packet Size on Performance in Bench Mode:

  • Test Objective: Performance test of single-machine cross-process Rpc backend in bench mode with varying packet sizes

  • Test Configuration:

    • mode: bench

    • channel_frequency: 1 kHz

    • pkg_size: 256 B ~ 64 KB (2^8 ~ 2^16, increasing by powers of 2)

    • paraller_number: 1

  • Test Results:

Impact of Concurrency Level on Performance in Bench Mode:

  • Test Objective: Performance test of single-machine cross-process Rpc backend in bench mode with varying concurrency levels

  • Test Configuration:

    • mode: bench

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • paraller_number: 1 ~ 10

  • Test Results:

Impact of Packet Size on Performance in Fixed-Freq Mode:

  • Test Objective: Performance test of single-machine cross-process Rpc backend in fixed-freq mode with varying packet sizes

  • Test Configuration:

    • mode: fixed-freq

    • channel_frequency: 1 kHz

    • pkg_size: 256 B ~ 64 KB (2^8 ~ 2^16, increasing by powers of 2)

    • paraller_number: 1

  • Test Results:

Impact of Concurrency Level on Performance in Fixed-Freq Mode:

  • Test Objective: Performance test of single-machine cross-process Rpc backend in fixed-freq mode with varying concurrency levels

  • Test Configuration:

    • mode: fixed-freq

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • paraller_number: 1 ~ 10

  • Test Results:

Detailed Data

Cross-Machine Performance Tests

Channel Backend Performance Tests

Impact of Packet Size on Performance in Multi-Topic Mode:

  • Test Objective: Performance test of cross-machine Channel backend in multi-topic mode with varying packet sizes

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 256 B ~ 64 KB (2^8 ~ 2^16, increasing by powers of 2)

    • topic_number: 1

    • parallel_number=1

  • Test Results:

Impact of Topic Count on Performance in Multi-Topic Mode:

  • Test Objective: Performance test of cross-machine Channel backend in multi-topic mode with varying topic counts

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • topic_number: 1 ~ 10

    • parallel_number=1

  • Test Results:

Impact of Packet Size on Performance in Parallel Mode:

  • Test Objective: Performance test of cross-machine Channel backend in parallel mode with varying packet sizes

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • topic_number: 1

    • parallel_number=1 ~ 10

  • Test Results:

Impact of Concurrency Level on Performance in Parallel Mode:

  • Test Objective: Performance test of cross-machine Channel backend in parallel mode with varying concurrency levels

  • Test Configuration:

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • topic_number: 1

    • parallel_number=1 ~ 10

  • Test Results:

Detailed Data

Rpc Backend Performance Tests

Impact of Packet Size on Performance in Bench Mode:

  • Test Objective: Performance test of cross-machine Rpc backend in bench mode with varying packet sizes

  • Test Configuration:

    • mode: bench

    • channel_frequency: 1 kHz

    • pkg_size: 256 B ~ 64 KB (2^8 ~ 2^16, increasing by powers of 2)

    • paraller_number: 1

  • Test Results:

Impact of Concurrency Level on Performance in Bench Mode:

  • Test Objective: Performance test of cross-machine Rpc backend in bench mode with varying concurrency levels

  • Test Configuration:

    • mode: bench

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • paraller_number: 1 ~ 10

  • Test Results:

Impact of Packet Size on Performance in Fixed-Freq Mode:

  • Test Objective: Performance test of cross-machine Rpc backend in fixed-freq mode with varying packet sizes

  • Test Configuration:

    • mode: fixed-freq

    • channel_frequency: 1 kHz

    • pkg_size: 256 B ~ 64 KB (2^8 ~ 2^16, increasing by powers of 2)

    • paraller_number: 1

  • Test Results:

Impact of Concurrency Level on Performance in Fixed-Freq Mode:

  • Test Objective: Performance test of cross-machine Rpc backend in fixed-freq mode with varying concurrency levels

  • Test Configuration:

    • mode: fixed-freq

    • channel_frequency: 1 kHz

    • pkg_size: 1024 B

    • paraller_number: 1 ~ 10

  • Test Results:

Detailed Data