测试说明
- 仅限于 Java
- 客户端使用 JMH 进行压测, 32 线程, 3 轮预热 3 轮测试, 每轮 10s
- 每次运行前都会执行 killall java, 但没有在每轮测试时重启操作系统
- 所有类库版本在发布时都是最新的, 除非存在 bug
- 所有框架都尽量参考该项目自带的 Benchmark 实现
- 将会一直持续, 不定期发布测试结果
测试用例
- boolean existUser(String email), 判断某个 email 是否存在
- boolean createUser(User user), 添加一个 User
- User getUser(long id), 根据 id 获取一个用户
- Page<User> listUser(int pageNo), 获取用户列表
运行结果
生成时间: 2018-05-12 21:15:11
硬件环境: 阿里云 ecs.hfc5.xlarge Intel Xeon Gold 6149, 4CPU 8GB RAM 两台
软件环境: Ubuntu x64 16.04.5, Java HotSpot(TM) 64-Bit Server VM 10+46
启动参数: java -server -Xmx1g -Xms1g -XX:MaxDirectMemorySize=1g -XX:+UseG1GC
existUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| turbo-rpc | 152.012 | 0.21 | 0.318 | 0.447 | 0.669 |
| servicecomb | 129.413 | 0.246 | 0.294 | 0.358 | 1.279 |
| jupiter | 128.015 | 0.249 | 0.36 | 0.543 | 3.826 |
| thrift | 117.827 | 0.273 | 0.52 | 0.97 | 1.454 |
| netty | 102.939 | 0.304 | 0.335 | 0.386 | 0.815 |
| turbo-rest | 95.774 | 0.341 | 0.845 | 1.505 | 4.047 |
| undertow | 92.956 | 0.342 | 0.88 | 1.552 | 3.532 |
| undertow-async | 82.539 | 0.38 | 0.773 | 1.604 | 5.153 |
| armeria-http | 75.795 | 0.411 | 0.731 | 1.305 | 6.054 |
| dubbo | 74.731 | 0.43 | 0.532 | 0.7 | 3.361 |
| dubbo-kryo | 74.728 | 0.43 | 0.532 | 0.713 | 3.758 |
| motan | 61.324 | 0.516 | 0.813 | 2.013 | 11.862 |
| rapidoid | 58.35 | 0.554 | 1.634 | 3.26 | 10.568 |
| hprose | 45.945 | 0.735 | 0.414 | 2.39 | 40.239 |
| springboot-undertow | 34.374 | 0.938 | 1.135 | 8.764 | 21.561 |
| springwebflux | 32.075 | 1.008 | 1.571 | 1.995 | 8.249 |
| grpc | 31.134 | 1.065 | 1.294 | 1.509 | 6.971 |
| springboot | 26.885 | 1.185 | 1.599 | 9.945 | 23.298 |
createUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| servicecomb | 124.015 | 0.255 | 0.306 | 0.382 | 1.436 |
| jupiter | 114.996 | 0.275 | 0.412 | 0.633 | 4.002 |
| turbo-rpc | 114.837 | 0.282 | 0.376 | 0.543 | 0.823 |
| thrift | 110.952 | 0.294 | 0.563 | 1.041 | 1.606 |
| undertow | 93.593 | 0.346 | 0.823 | 1.479 | 3.903 |
| turbo-rest | 88.512 | 0.353 | 0.894 | 1.618 | 5.087 |
| netty | 85.774 | 0.388 | 0.428 | 0.511 | 0.791 |
| undertow-async | 79.475 | 0.409 | 0.8 | 1.528 | 5.235 |
| armeria-http | 65.109 | 0.498 | 0.688 | 1.98 | 7.922 |
| motan | 56.708 | 0.561 | 0.893 | 1.892 | 11.289 |
| dubbo-kryo | 54.754 | 0.583 | 0.732 | 0.938 | 5.169 |
| hprose | 37.22 | 0.933 | 0.484 | 38.601 | 43.451 |
| dubbo | 31.811 | 0.988 | 1.284 | 1.642 | 7.471 |
| springwebflux | 30.212 | 1.084 | 1.694 | 2.13 | 6.824 |
| grpc | 29.992 | 1.029 | 1.321 | 1.544 | 4.5 |
| springboot-undertow | 28.142 | 1.139 | 2.003 | 6.398 | 13.976 |
| springboot | 26.411 | 1.196 | 1.647 | 10.994 | 26.771 |
| rapidoid | 22.434 | 1.438 | 0.913 | 26.345 | 46.137 |
getUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| turbo-rpc | 133.121 | 0.241 | 0.364 | 0.516 | 0.743 |
| servicecomb | 122.801 | 0.262 | 0.313 | 0.391 | 2.651 |
| jupiter | 111.682 | 0.29 | 0.45 | 0.689 | 4.301 |
| thrift | 110.368 | 0.289 | 0.553 | 1.02 | 1.573 |
| undertow | 87.382 | 0.343 | 0.981 | 1.765 | 3.945 |
| turbo-rest | 81.373 | 0.392 | 0.696 | 1.397 | 4.383 |
| undertow-async | 81.162 | 0.405 | 0.773 | 1.534 | 3.777 |
| netty | 73.999 | 0.421 | 0.442 | 0.472 | 0.886 |
| armeria-http | 70.776 | 0.448 | 0.753 | 1.389 | 4.366 |
| motan | 60.062 | 0.542 | 0.87 | 1.964 | 11.813 |
| dubbo-kryo | 55.375 | 0.564 | 0.722 | 0.951 | 5.317 |
| rapidoid | 51.64 | 0.625 | 2.019 | 4.076 | 11.72 |
| hprose | 48.659 | 0.649 | 0.701 | 1.356 | 40.042 |
| dubbo | 32.924 | 0.974 | 1.245 | 1.692 | 7.406 |
| grpc | 30.941 | 1.042 | 1.233 | 1.462 | 3.453 |
| springboot-undertow | 30.694 | 1.063 | 1.27 | 9.241 | 21.463 |
| springwebflux | 26.173 | 1.232 | 1.915 | 2.359 | 6.955 |
| springboot | 24.969 | 1.297 | 1.743 | 10.879 | 27.329 |
listUser
| framework | thrpt (ops/ms) | avgt (ms) | p90 (ms) | p99 (ms) | p999 (ms) |
|---|
| jupiter | 46.89 | 0.684 | 1.057 | 1.8 | 9.273 |
| turbo-rpc | 45.852 | 0.713 | 1.745 | 2.126 | 7.274 |
| servicecomb | 45.218 | 0.707 | 0.977 | 1.718 | 6.94 |
| thrift | 34.813 | 0.91 | 1.78 | 3.727 | 9.208 |
| grpc | 34.112 | 0.916 | 1.2 | 1.491 | 6.151 |
| motan | 32.584 | 0.982 | 1.632 | 2.998 | 10.928 |
| undertow | 32.094 | 1.01 | 1.352 | 2.171 | 9.29 |
| undertow-async | 32.094 | 0.994 | 1.298 | 2.494 | 10.943 |
| armeria-http | 31.701 | 1.018 | 1.579 | 2.9 | 9.945 |
| netty | 26.653 | 1.18 | 1.335 | 1.743 | 4.538 |
| rapidoid | 23.563 | 1.368 | 1.128 | 20.873 | 38.076 |
| turbo-rest | 21.274 | 1.516 | 1.823 | 3.166 | 9.929 |
| dubbo-kryo | 20.664 | 1.553 | 2.087 | 2.982 | 8.716 |
| hprose | 20.017 | 1.602 | 1.597 | 2.044 | 50.397 |
| springwebflux | 19.617 | 1.631 | 2.56 | 3.084 | 9.077 |
| springboot-undertow | 18.478 | 1.745 | 2.908 | 11.944 | 21.758 |
| springboot | 16.825 | 1.909 | 2.585 | 13.23 | 34.275 |
| dubbo | 4.683 | 6.922 | 9.224 | 12.534 | 19.741 |
更新说明
- 硬件变化, 升级为 ecs.hfc5.xlarge Intel Xeon Gold 6149
- 添加 3 个新的测评项目：armeria servicecomb springboot-undertow
- 其他: 常规版本升级, 都升级到了最新版本 (dubbo 2.6.1 存在 bug，继续使用 2.6.0)
致谢
特别感谢下列人员对本项目的大力支持
- turbo: hank-whu
- jupiter: fengjiachun
- hprose: andot
- servicecomb: imlidian
免责声明
快速链接
往期评测:
RPC Benchmark Round 2
RPC Benchmark Round 1
测试说明:
rpc-benchmark 测试说明
rpc-benchmark 项目代码
