benchmarksql 在5.0版本去除了对MySQL的TPC-C测试支持,本文通过修改部分源码,让benchmarksql 5.0支持MySQL。
1. 环境:
- CentOS 7.2
- benchmarksql 5.0
- Percona MySQL Server 5.7.19
2. 下载编译benchmarksql源码
2.1 首先安装java开发环境,具体步骤略过,本文涉及到的操作在 java 1.8.0 环境下测试通过。
2.2 安装ant工具。
yum install ant
2.3 下载benchmarksql 5.0 源码,解压。
https://sourceforge.net/projects/benchmarksql/
cd benchmarksql-5.0
2.4 编译
ant
此时会编译出一个版本 benchmarksql-5.0/dist/BenchmarkSQL-5.0.jar,但是该版本并不支持MySQL的TPC-C测试,需要做如下的修改。
3 修改benchmarksql源码
3.1 修改benchmarksql-5.0/src/client/jTPCC.java,增加mysql相关部分,如下所示:
if (iDB.equals("firebird"))
dbType = DB_FIREBIRD;
else if (iDB.equals("oracle"))
dbType = DB_ORACLE;
else if (iDB.equals("postgres"))
dbType = DB_POSTGRES;
else if (iDB.equals("mysql"))
dbType = DB_UNKNOWN;
else
{
log.error("unknown database type '" + iDB + "'");
return;
}
3.2 修改benchmarksql-5.0/src/client/jTPCCConnection.java, SQL子查询增加”AS L”别名,如下所示:
default:
stmtStockLevelSelectLow = dbConn.prepareStatement(
"SELECT count(*) AS low_stock FROM (" +
" SELECT s_w_id, s_i_id, s_quantity " +
" FROM bmsql_stock " +
" WHERE s_w_id = ? AND s_quantity < ? AND s_i_id IN (" +
" SELECT ol_i_id " +
" FROM bmsql_district " +
" JOIN bmsql_order_line ON ol_w_id = d_w_id " +
" AND ol_d_id = d_id " +
" AND ol_o_id >= d_next_o_id - 20 " +
" AND ol_o_id < d_next_o_id " +
" WHERE d_w_id = ? AND d_id = ? " +
" ) " +
" )AS L");
break;
3.3 编译修改后的源码,此时得到的benchmarksql版本 benchmarksql-5.0/dist/BenchmarkSQL-5.0.jar 已经支持MySQL的TPC-C测试。
cd benchmarksql-5.0
ant
4 修改相关脚本,支持MySQL
4.1. 在benchmarksql-5.0/run目录下,创建文件prop.mysql,内容如下:
db=mysql
driver=com.mysql.jdbc.Driver
conn=jdbc:mysql://127.0.0.1:3306/benchmarksql
user=benchmarksql
password=123456
warehouses=1
loadWorkers=4
terminals=1
//To run specified transactions per terminal- runMins must equal zero
runTxnsPerTerminal=10
//To run for specified minutes- runTxnsPerTerminal must equal zero
runMins=0
//Number of total transactions per minute
limitTxnsPerMin=300
//Set to true to run in 4.x compatible mode. Set to false to use the
//entire configured database evenly.
terminalWarehouseFixed=true
//The following five values must add up to 100
//The default percentages of 45, 43, 4, 4 & 4 match the TPC-C spec
newOrderWeight=45
paymentWeight=43
orderStatusWeight=4
deliveryWeight=4
stockLevelWeight=4
// Directory name to create for collecting detailed result data.
// Comment this out to suppress.
resultDirectory=my_result_%tY-%tm-%td_%tH%tM%tS
osCollectorScript=./misc/os_collector_linux.py
osCollectorInterval=1
//osCollectorSSHAddr=user@dbhost
osCollectorDevices=net_eth0 blk_sda
4.2. 修改 文件:benchmarksql-5.0/run/funcs.sh,添加mysql 数据库类型。
function setCP()
{
case "$(getProp db)" in
firebird)
cp="../lib/firebird/*:../lib/*"
;;
oracle)
cp="../lib/oracle/*"
if [ ! -z "${ORACLE_HOME}" -a -d ${ORACLE_HOME}/lib ] ; then
cp="${cp}:${ORACLE_HOME}/lib/*"
fi
cp="${cp}:../lib/*"
;;
postgres)
cp="../lib/postgres/*:../lib/*"
;;
mysql)
cp="../lib/mysql/*:../lib/*"
;;
esac
myCP=".:${cp}:../dist/*"
export myCP
}
...省略
case "$(getProp db)" in
firebird|oracle|postgres|mysql)
;;
"") echo "ERROR: missing db= config option in ${PROPS}" >&2
exit 1
;;
*) echo "ERROR: unsupported database type 'db=$(getProp db)' in ${PROPS}" >&2
exit 1
;;
esac
4.3 添加mysql java connector驱动,mysql-connector-java-5.1.45.jar 需自行下载。
mkdir -p benchmarksql-5.0/lib/mysql
cp mysql-connector-java-5.1.45.jar benchmarksql-5.0/lib/mysql/
4.4 修改benchmarksql-5.0/run/runDatabaseBuild.sh,去掉extraHistID
AFTER_LOAD="indexCreates foreignKeys extraHistID buildFinish"
修改为:
AFTER_LOAD="indexCreates foreignKeys buildFinish"
5 测试MySQL TPC-C
cd benchmarksql-5.0/run
./runDatabaseBuild.sh props.mysql
./runBenchmark.sh props.mysql
修改后的benchmarksql对MySQL进行TPC-C测试,结果如下所示:
02:58:47,071 [Thread-1] INFO jTPCC : Term-00,
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Measured tpmC (NewOrders) = 136.71
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Measured tpmTOTAL = 298.81
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Session Start = 2018-12-27 02:53:46
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Session End = 2018-12-27 02:58:47
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Transaction Count = 1494
最后,如果不想自己动手修改,在github上可以下载PingCAP修改过的支持MySQL和TiDB的benchmarksql,地址:
https://github.com/jackysp/benchmarksql