Sysbench Test Report

Background Information

Sysbench is an open-source, modular, cross-platform, multi-threaded benchmarking tool that can perform database performance testing in areas like CPU, memory, threads, and I/O.

Benchmark Boot is a one-stop benchmarking platform developed for PolarDB-X, currently supporting benchmarks including Sysbench, TPC-C, and TPC-H, enhancing testing efficiency through a graphical interface.

Test Design

Data Volume for the Test

The sysbench data includes 16 tables, each with a volume of 10 million records.

Test Cases

Sysbench evaluates the performance of PolarDB-X in a centralized standard edition single-table scenario.

Host Resources

The centralized standard edition of PolarDB-X only requires deployment of storage nodes DN, without the need for additional compute nodes CN.

Stress Test Machines

Test Methodology

Step 1: Prepare the Stress Test Machine

Deploy Benchmark-Boot, refer to the documentation: Using Benchmark Boot for Stress Testing

# Download the image
docker pull polardbx/benchmark-boot:latest

# Start the container
docker run -itd --name 'benchmark-boot' --privileged --net=host \
    -v /etc/localtime:/etc/localtime polardbx/benchmark-boot:latest \
    /usr/sbin/init

# Verification
curl http://127.0.0.1:4121/

For offline deployment, the benchmark-boot image can be downloaded using the OPS machine and then uploaded to a private repository.

Step 2: Prepare the PolarDB-X Instance for Stress Testing

Create a PolarDB-X instance. For detailed operation steps, please refer to: Deploy by PXD

Instance creation parameters:

version: v1
type: polardbx
cluster:
  name: pxc_test_standard
  dn:
    image: registry:5000/polardbx-engine-2.0:latest
    replica: 1
    nodes:
      - host_group: [10.0.3.244, 10.0.3.245, 10.0.3.246]
    resources:
      mem_limit: 80G

Verify that the instance is connectable. Open Benchmark-Boot, select 'Run Stress Test' -> 'Database Connection' on the left, fill in the database connection information into Benchmark-Boot, and click 'Submit'.

Step 3: Adjust Instance Parameters

The PolarDB-X instance created by default through PXD uses a built-in my.cnf parameter template:

sync_binlog = 1
innodb_flush_log_at_trx_commit = 1

Step 4: Prepare Data for Stress Testing

Launch Benchmark-Boot, select 'Run Stress Test' -> 'Sysbench' -> 'Switch Database' on the left, fill in the database name sbtest_mysql, select MySQL mode.

After submitting, scroll down to the bottom of the page, fill in the parameters for data preparation: 16 tables, table size 10000000, 16 concurrent threads, do not check the 'Uniform Distribution for Single Table' option, click submit and wait for the data preparation task to complete.

Step 5: Execute the Stress Test

The table contains the names of Sysbench scenarios included in this stress test. The following illustrates the stress testing method using the point-select scenario oltp_point_select as an example.

Launch Benchmark-Boot and verify if the database selected for stress testing is correct. If not, click to switch.

Select Run Stress Test->Sysbench on the left side, then in the Run Sysbench form

Note that other parameters should be in JSON format. You can copy the following settings, and after setting, click Run Stress Test.

{
"disable-ps-mode":false,
"range-size":5
}

View the stress test results by clicking View Real-Time Results, which takes you to the Real-Time Data page for live results.

Once the stress test is complete, record the results.

Return to the stress test page where you can choose to fill in the last test parameters. After making slight changes to the scenario or concurrency, you can continue to test other scenarios.

Test Results

All results below use QPS (Queries Per Second) as the performance metric.

Partition Table Performance