首页 > 技术文章 > sysbench基准测试工具

muahao 2017-01-17 15:55 原文

一。简介
SysBench是一个模块化的、跨平台、多线程基准测试工具,主要用于评估测试各种不同系统参数下的数据库负载情况。
当前功能允许测试的系统参数有:
file I/O performance (文件I / O性能) 
scheduler performance (调度性能) 
memory allocation and transfer speed (内存分配和传输速度) 
POSIX threads implementation performance (POSIX线程执行绩效) 
database server performance (OLTP benchmark) (数据库服务器性能) 
SysBench运行指定数目的线程,他们都是并行的执行请求。实际工作量的请求产生依赖于指定的测试模式(在编译中添加测试模块)。可以限制请求总数或总时间为基准,或两者。

二。安装
下载地址:
# wget http://nchc.dl.sourceforge.net/project/sysbench/sysbench/0.4.12/sysbench-0.4.12.tar.gz
# tar zxvf sysbench-0.4.12.tar.gz -C ../software/
# ./configure --prefix=/usr/local/sysbench-0.4.12 \
 --with-mysql-includes=/usr/local/mysql-5.5.8/include \
 --with-mysql-libs=/usr/local/mysql-5.5.8/lib
# make
# make install

安装过程中出现的错误以及解决办法:
问题一:
../libtool: line 838: X--tag=CC: command not found
../libtool: line 871: libtool: ignoring unknown tag : command not found
../libtool: line 838: X--mode=link: command not found
../libtool: line 1004: *** Warning: inferring the mode of operation is deprecated.: command not found
../libtool: line 1005: *** Future versions of Libtool will require --mode=MODE be specified.: command not found
../libtool: line 2231: X-g: command not found
../libtool: line 2231: X-O2: command not found
../libtool: line 1951: X-L/usr/local/mysql-5.5.8/lib: No such file or directory
../libtool: line 2400: Xsysbench: command not found
解决办法:
1.在编译前先运行autogen.sh即可。
2.安装新版本的libtool工具。

问题二:
./sysbench: error while loading shared libraries: libmysqlclient.so.16: cannot open shared object file: No such file or directory 
解决办法: 
# in -s /usr/local/mysql-5.5.8/lib/libmysqlclient.so.16 /lib64/libmysqlclient.so.16

三。测试选项说明
[root@localhost bin]# ./sysbench 
测试用例:
  sysbench [general-options]... --test=<test-name> [test-options]... command

通用选项:
  --num-threads=N   创建测试线程的数目。默认为1.
  --max-requests=N   请求的最大数目。默认为10000,0代表不限制。
  --max-time=N   最大执行时间,单位是s。默认是0,不限制。
  --forced-shutdown=STRING  超过max-time强制中断。默认是off。]
  --thread-stack-size=SIZE   每个线程的堆栈大小。默认是32K。
  --init-rng=[on|off]  在测试开始时是否初始化随机数发生器。默认是off。
  --test=STRING      指定测试项目名称。
  --debug=[on|off]    是否显示更多的调试信息。默认是off。
  --validate=[on|off]   在可能情况下执行验证检查。默认是off。

测试项目:
  fileio - File I/O test
  cpu - CPU performance test
  memory - Memory functions speed test
  threads - Threads subsystem performance test
  mutex - Mutex performance test(互斥性能测试)
  oltp - OLTP test

指令: prepare(测试前准备工作) run(正式测试) cleanup(测试后删掉测试数据) help version

See 'sysbench --test=<name> help' for a list of options for each test. 查看每个测试项目的更多选项列表。

[root@localhost bin]# ./sysbench --test=fileio help                        
  --file-num=N   创建测试文件的数量。默认是128
  --file-block-size=N  测试时文件块的大小。默认是16384(16K)
  --file-total-size=SIZE   测试文件的总大小。默认是2G
  --file-test-mode=STRING  文件测试模式{seqwr(顺序写), seqrewr(顺序读写), seqrd(顺序读), rndrd(随机读), rndwr(随机写), rndrw(随机读写)}
  --file-io-mode=STRING   文件操作模式{sync(同步),async(异步),fastmmap(快速map映射),slowmmap(慢map映射)}。默认是sync
  --file-extra-flags=STRING   使用额外的标志来打开文件{sync,dsync,direct} 。默认为空
  --file-fsync-freq=N   执行fsync()的频率。(0 – 不使用fsync())。默认是100
  --file-fsync-all=[on|off] 每执行完一次写操作就执行一次fsync。默认是off
  --file-fsync-end=[on|off] 在测试结束时才执行fsync。默认是on
  --file-fsync-mode=STRING  使用哪种方法进行同步{fsync, fdatasync}。默认是fsync
  --file-merged-requests=N   如果可以,合并最多的IO请求数(0 – 表示不合并)。默认是0
  --file-rw-ratio=N     测试时的读写比例。默认是1.5

[root@localhost bin]# ./sysbench --test=cpu help   
  --cpu-max-prime=N  最大质数发生器数量。默认是10000

[root@localhost bin]# ./sysbench --test=memory help
  --memory-block-size=SIZE  测试时内存块大小。默认是1K
  --memory-total-size=SIZE    传输数据的总大小。默认是100G
  --memory-scope=STRING    内存访问范围{global,local}。默认是global
  --memory-hugetlb=[on|off]  从HugeTLB池内存分配。默认是off
  --memory-oper=STRING     内存操作类型。{read, write, none} 默认是write
  --memory-access-mode=STRING存储器存取方式{seq,rnd} 默认是seq

[root@localhost bin]# ./sysbench --test=threads help
  --thread-yields=N   每个请求产生多少个线程。默认是1000
  --thread-locks=N    每个线程的锁的数量。默认是8

[root@localhost bin]# ./sysbench --test=mutex help  
  --mutex-num=N    数组互斥的总大小。默认是4096
  --mutex-locks=N    每个线程互斥锁的数量。默认是50000
  --mutex-loops=N    内部互斥锁的空循环数量。默认是10000

[root@localhost bin]# ./sysbench --test=oltp help 
oltp options:
  --oltp-test-mode=STRING    执行模式{simple,complex(advanced transactional),nontrx(non-transactional),sp}。默认是complex
  --oltp-reconnect-mode=STRING 重新连接模式{session(不使用重新连接。每个线程断开只在测试结束),transaction(在每次事务结束后重新连接),query(在每个SQL语句执行完重新连接),random(对于每个事务随机选择以上重新连接模式)}。默认是session
  --oltp-sp-name=STRING   存储过程的名称。默认为空
  --oltp-read-only=[on|off]  只读模式。Update,delete,insert语句不可执行。默认是off
  --oltp-skip-trx=[on|off]   省略begin/commit语句。默认是off
  --oltp-range-size=N      查询范围。默认是100 
  --oltp-point-selects=N          number of point selects [10]
  --oltp-simple-ranges=N          number of simple ranges [1]
  --oltp-sum-ranges=N             number of sum ranges [1]
  --oltp-order-ranges=N           number of ordered ranges [1]
  --oltp-distinct-ranges=N        number of distinct ranges [1]
  --oltp-index-updates=N          number of index update [1]
  --oltp-non-index-updates=N      number of non-index updates [1]
  --oltp-nontrx-mode=STRING   查询类型对于非事务执行模式{select, update_key, update_nokey, insert, delete} [select]
  --oltp-auto-inc=[on|off]      AUTO_INCREMENT是否开启。默认是on
  --oltp-connect-delay=N     在多少微秒后连接数据库。默认是10000 
  --oltp-user-delay-min=N    每个请求最短等待时间。单位是ms。默认是0
  --oltp-user-delay-max=N    每个请求最长等待时间。单位是ms。默认是0
  --oltp-table-name=STRING  测试时使用到的表名。默认是sbtest
  --oltp-table-size=N         测试表的记录数。默认是10000
  --oltp-dist-type=STRING    分布的随机数{uniform(均匀分布),Gaussian(高斯分布),special(空间分布)}。默认是special
  --oltp-dist-iter=N    产生数的迭代次数。默认是12
  --oltp-dist-pct=N    值的百分比被视为'special' (for special distribution)。默认是1
  --oltp-dist-res=N    ‘special’的百分比值。默认是75

General database options:
  --db-driver=STRING  指定数据库驱动程序('help' to get list of available drivers)
  --db-ps-mode=STRING编制报表使用模式{auto, disable} [auto]

Compiled-in database drivers:
  mysql - MySQL driver

mysql options:
  --mysql-host=[LIST,...]       MySQL server host [localhost]
  --mysql-port=N                MySQL server port [3306]
  --mysql-socket=STRING         MySQL socket
  --mysql-user=STRING           MySQL user [sbtest]
  --mysql-password=STRING       MySQL password []
  --mysql-db=STRING             MySQL database name [sbtest]
  --mysql-table-engine=STRING   storage engine to use for the test table {myisam,innodb,bdb,heap,ndbcluster,federated} [innodb]
  --mysql-engine-trx=STRING     whether storage engine used is transactional or not {yes,no,auto} [auto]
  --mysql-ssl=[on|off]          use SSL connections, if available in the client library [off]
  --myisam-max-rows=N           max-rows parameter for MyISAM tables [1000000]
  --mysql-create-options=STRING additional options passed to CREATE TABLE []

四。测试实例
1.测试cpu
[root@localhost bin]# ./sysbench --test=cpu --cpu-max-prime=20000 run
Number of threads: 1

Doing CPU performance benchmark

Threads started!
Done.

Maximum prime number checked in CPU test: 20000


Test execution summary:
    total time:                          31.9364s
    total number of events:              10000
    total time taken by event execution: 31.9334
    per-request statistics:
         min:                                  3.18ms
         avg:                                  3.19ms
         max:                                  3.60ms
         approx.  95 percentile:               3.20ms

Threads fairness:
    events (avg/stddev):           10000.0000/0.00
execution time (avg/stddev):   31.9334/0.00

2.测试线程
[root@localhost bin]# ./sysbench --num-threads=64 --test=threads --thread-yields=100 --thread-locks=2 run
Number of threads: 64

Doing thread subsystem performance test
Thread yields per test: 100 Locks used: 2
Threads started!
Done.


Test execution summary:
    total time:                          2.2507s
    total number of events:              10000
    total time taken by event execution: 143.8405
    per-request statistics:
         min:                                  0.03ms
         avg:                                 14.38ms
         max:                                411.39ms
         approx.  95 percentile:              63.49ms

Threads fairness:
    events (avg/stddev):           156.2500/45.17
execution time (avg/stddev):   2.2475/0.00

3.测试mutex
[root@localhost bin]# ./sysbench --num-threads=1500 --max-requests=2000  --test=mutex --mutex-num=10240 --mutex-locks=100000 --mutex-loops=15000 run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 1500

Doing mutex performance test
Threads started!
Done.


Test execution summary:
    total time:                          74.0710s
    total number of events:              1500
    total time taken by event execution: 5410.6925
    per-request statistics:
         min:                                485.77ms
         avg:                               3607.13ms
         max:                              13770.44ms
         approx.  95 percentile:           12489.67ms

Threads fairness:
    events (avg/stddev):           1.0000/0.00
execution time (avg/stddev):   3.6071/3.97

4.测试fileio
[root@localhost bin]# ./sysbench --num-threads=16 --test=fileio --file-total-size=3G --file-test-mode=rndrw prepare
sysbench 0.4.12:  multi-threaded system evaluation benchmark

128 files, 24576Kb each, 3072Mb total
Creating files for the test...

[root@localhost bin]# ./sysbench --num-threads=16 --test=fileio --file-total-size=3G --file-test-mode=rndrw run                      
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16

Extra file open flags: 0
128 files, 24Mb each
3Gb total file size
Block size 16Kb
Number of random requests for random IO: 10000
Read/Write ratio for combined random IO test: 1.50
Periodic FSYNC enabled, calling fsync() each 100 requests.
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing random r/w test
Threads started!
Done.

Operations performed:  6011 Read, 3997 Write, 12692 Other = 22700 Total
Read 93.922Mb  Written 62.453Mb  Total transferred 156.38Mb  (9.9885Mb/sec)
  639.27 Requests/sec executed

Test execution summary:
    total time:                          15.6555s
    total number of events:              10008
    total time taken by event execution: 34.5359
    per-request statistics:
         min:                                  0.01ms
         avg:                                  3.45ms
         max:                                828.73ms
         approx.  95 percentile:               0.07ms

Threads fairness:
    events (avg/stddev):           625.5000/137.06
execution time (avg/stddev):   2.1585/0.49

[root@localhost bin]# ./sysbench --num-threads=16 --test=fileio --file-total-size=3G --file-test-mode=rndrw cleanup
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Removing test files...

5.OLTP测试
[root@localhost bin]# ./sysbench --test=oltp --mysql-table-engine=innodb --mysql-port=3307 --mysql-db=test --oltp-table-size=10000000 --mysql-socket=/tmp/mysql-5.5.8.sock prepare
sysbench 0.4.12:  multi-threaded system evaluation benchmark

No DB drivers specified, using mysql
Creating table 'sbtest'...
Creating 10000000 records in table 'sbtest'...

[root@localhost bin]# ./sysbench --num-threads=100 --max-requests=100000 --test=oltp --oltp-table-size=1000000 --mysql-port=3307 --mysql-db=test  --mysql-socket=/tmp/mysql-5.5.8.sock run 
sysbench 0.4.12:  multi-threaded system evaluation benchmark

No DB drivers specified, using mysql
Running the test with following options:
Number of threads: 100

Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations,  1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 100000
Threads started!
Done.

OLTP test statistics:
    queries performed:
        read:                            1400154
        write:                           500055
        other:                           200022
        total:                           2100231
    transactions:                        100011 (740.18 per sec.)
    deadlocks:                           0      (0.00 per sec.)
    read/write requests:                 1900209 (14063.46 per sec.)
    other operations:                    200022 (1480.36 per sec.)

Test execution summary:
    total time:                          135.1168s
    total number of events:              100011
    total time taken by event execution: 13504.7609
    per-request statistics:
         min:                                  2.70ms
         avg:                                135.03ms
         max:                               2319.30ms
         approx.  95 percentile:             224.40ms

Threads fairness:
    events (avg/stddev):           1000.1100/12.06
execution time (avg/stddev):   135.0476/0.04

[root@localhost bin]# ./sysbench --test=oltp --mysql-table-engine=innodb --mysql-port=3307 --mysql-db=test --oltp-table-size=10000000 --mysql-socket=/tmp/mysql-5.5.8.sock cleanup
sysbench 0.4.12:  multi-threaded system evaluation benchmark

No DB drivers specified, using mysql
Dropping table 'sbtest'...
Done.

推荐阅读