测试说明
- 仅限于 Java
- 客户端使用 JMH 进行压测, 32 线程, 3 轮预热 3 轮测试, 每轮 10s
- 每次运行前都会执行 killall java, 但没有在每轮测试时重启操作系统
- 所有类库版本在发布时都是最新的, 除非存在 bug
- 所有框架都尽量参考该项目自带的 Benchmark 实现
- 将会一直持续, 不定期发布测试结果
测试用例
- boolean existUser(String email), 判断某个 email 是否存在
- boolean createUser(User user), 添加一个 User
- User getUser(long id), 根据 id 获取一个用户
- Page<User> listUser(int pageNo), 获取用户列表
运行结果
生成时间: 2019-02-11 21:56:27
硬件环境: 阿里云 ic5 ecs.ic5.2xlarge 8vCPU 8GB Intel Xeon(Skylake) Platinum 8163 2.5GHz 2.5Gbps 80万PPS
软件环境: Ubuntu x64 18.04, OpenJDK 64-Bit Server VM 11.0.2+9
启动参数: java -server -Xmx1g -Xms1g -XX:+UseG1GC
existUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| netty | 164.575 | 0.194 | 0.259 | 0.344 | 0.442 |
| turbo-rpc | 161.511 | 0.199 | 0.262 | 0.353 | 0.452 |
| servicecomb | 110.166 | 0.293 | 0.34 | 0.418 | 1.288 |
| thrift | 101.398 | 0.31 | 0.597 | 1.12 | 1.626 |
| undertow | 89.628 | 0.363 | 0.82 | 1.425 | 1.907 |
| turbo-rest | 85.811 | 0.371 | 0.791 | 1.356 | 2.009 |
| armeria | 82.97 | 0.389 | 0.746 | 1.198 | 2.52 |
| undertow-async | 80.064 | 0.407 | 0.9 | 1.559 | 2.785 |
| motan | 77.789 | 0.413 | 0.554 | 0.808 | 4.043 |
| springwebflux | 55.141 | 0.59 | 0.729 | 0.831 | 4.071 |
| springboot-undertow | 49.449 | 0.656 | 0.821 | 5.03 | 17.138 |
| rapidoid | 48.622 | 0.714 | 451.412 | 905.97 | 1350.566 |
| sofa | 46.329 | 0.693 | 0.899 | 1.37 | 5.587 |
| springboot | 42.591 | 0.775 | 1.063 | 4.719 | 11.193 |
| hprose | 40.307 | 0.81 | 0.506 | 2.419 | 44.237 |
| grpc | 24.928 | 1.31 | 1.606 | 1.733 | 2.114 |
| dubbo | NaN | NaN | NaN | NaN | NaN |
| dubbo-kryo | NaN | NaN | NaN | NaN | NaN |
createUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| netty | 154.911 | 0.209 | 0.268 | 0.356 | 0.463 |
| turbo-rpc | 147.889 | 0.217 | 0.284 | 0.378 | 0.509 |
| servicecomb | 104.836 | 0.307 | 0.36 | 0.449 | 1.384 |
| thrift | 97.385 | 0.33 | 0.633 | 1.186 | 1.735 |
| undertow | 86.65 | 0.353 | 0.809 | 1.391 | 1.964 |
| turbo-rest | 84.658 | 0.379 | 0.811 | 1.38 | 2.273 |
| armeria | 79.6 | 0.397 | 0.652 | 1.112 | 2.826 |
| undertow-async | 78.527 | 0.413 | 0.9 | 1.54 | 2.843 |
| motan | 73.332 | 0.429 | 0.589 | 0.856 | 4.603 |
| springwebflux | 52.109 | 0.619 | 0.756 | 0.87 | 4.284 |
| springboot-undertow | 45.175 | 0.713 | 1.047 | 4.424 | 13.785 |
| springboot | 42.268 | 0.792 | 1.079 | 4.702 | 11.796 |
| sofa | 40.143 | 0.796 | 0.994 | 1.376 | 5.571 |
| hprose | 36.748 | 0.961 | 0.546 | 41.878 | 44.433 |
| dubbo | 24.382 | 1.317 | 1.679 | 1.901 | 3.998 |
| dubbo-kryo | 23.351 | 1.352 | 1.751 | 1.896 | 19.464 |
| grpc | 22.752 | 1.366 | 1.622 | 1.759 | 2.283 |
| rapidoid | 0.249 | 143.886 | 2336.227 | 3229.614 | 3670.016 |
getUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| netty | 151.653 | 0.212 | 0.278 | 0.383 | 0.492 |
| turbo-rpc | 147.862 | 0.215 | 0.292 | 0.391 | 0.496 |
| servicecomb | 106.251 | 0.306 | 0.359 | 0.449 | 1.376 |
| thrift | 97.936 | 0.331 | 0.631 | 1.182 | 1.761 |
| undertow | 85.706 | 0.371 | 0.827 | 1.425 | 1.722 |
| turbo-rest | 82.729 | 0.389 | 0.857 | 1.454 | 2.13 |
| armeria | 82.262 | 0.4 | 0.721 | 1.128 | 2.384 |
| undertow-async | 79.868 | 0.411 | 0.873 | 1.493 | 1.997 |
| motan | 72.961 | 0.447 | 0.569 | 0.834 | 4.53 |
| springwebflux | 52.11 | 0.619 | 0.752 | 0.849 | 3.322 |
| hprose | 50.001 | 0.667 | 0.734 | 1.075 | 42.336 |
| rapidoid | 46.558 | 0.767 | 448.791 | 897.581 | 1367.2 |
| springboot-undertow | 45.495 | 0.711 | 0.898 | 5.358 | 19.595 |
| sofa | 40.511 | 0.801 | 1.017 | 1.364 | 6.398 |
| springboot | 39.208 | 0.829 | 1.157 | 4.997 | 11.747 |
| dubbo | 24.413 | 1.305 | 1.45 | 1.706 | 3.228 |
| grpc | 24.187 | 1.266 | 1.583 | 1.755 | 2.251 |
| dubbo-kryo | NaN | NaN | NaN | NaN | NaN |
listUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| netty | 73.303 | 0.431 | 0.909 | 1.223 | 2.09 |
| turbo-rpc | 67.42 | 0.456 | 1.155 | 1.382 | 1.991 |
| thrift | 62.248 | 0.52 | 0.977 | 1.872 | 4.235 |
| servicecomb | 54.647 | 0.583 | 0.806 | 1.219 | 3.912 |
| undertow | 52.255 | 0.611 | 1.438 | 2.347 | 5.784 |
| undertow-async | 50.235 | 0.627 | 1.55 | 2.687 | 6.717 |
| armeria | 48.241 | 0.661 | 1.039 | 1.855 | 6.197 |
| motan | 44.201 | 0.723 | 0.985 | 1.458 | 5.972 |
| springwebflux | 38.353 | 0.834 | 1.006 | 1.257 | 5.333 |
| turbo-rest | 36.102 | 0.883 | 2.001 | 4.186 | 7.995 |
| grpc | 27.286 | 1.166 | 1.286 | 1.389 | 4.16 |
| springboot-undertow | 27.184 | 1.158 | 1.475 | 7.406 | 19.431 |
| rapidoid | 26.665 | 1.44 | 448.791 | 892.338 | 1780.482 |
| springboot | 25.04 | 1.258 | 1.712 | 6.267 | 11.78 |
| hprose | 22.529 | 1.384 | 1.513 | 1.819 | 24.62 |
| dubbo-kryo | 16.52 | 1.904 | 1.997 | 2.499 | 42.729 |
| sofa | 12.276 | 2.622 | 3.822 | 7.135 | 12.321 |
| dubbo | 3.716 | 8.727 | 9.404 | 10.207 | 28.312 |
更新说明
- 硬件升级到8核
- jdk 升级为 AdoptOpenJDK-11.0.2
- 各个框架均升级到最新版本
免责声明
快速链接
往期评测:
RPC Benchmark Round 4
RPC Benchmark Round 3
RPC Benchmark Round 2
RPC Benchmark Round 1
测试说明:
rpc-benchmark 测试说明
rpc-benchmark 项目代码
