Cosbench对象存储的测试
2020-09-17 本文已影响0人
圣地亚哥_SVIP
Cosbench下载地址:
https://github.com/intel-cloud/cosbench/releases/download/v0.4.0.1/0.4.0.1.zip
Read并发大的情况会存在读异常直接退出,需要关闭MD5校验:
- stop-all.sh 停止 cosbench 进程(controller, drivers)
- 编辑 cosbench-start.sh 文件,找到java启动命令行参数, 增加"-Dcom.amazonaws.services.s3.disableGetObjectMD5Validation=true" 关闭S3的MD5校验功能
- start-all.sh 启动所有的cosbench processes.
进入目录,上传一个任务:
./cli.sh submit ../conf/bjf/cosbench.conf
界面:
http://{ip}:19088/controller
配置用例如下:
workflow下定义多个workstage,workstage之间是串行运行,workstage下的work并行运行。workers指定了并发数。
<?xml version="1.0" encoding="UTF-8" ?>
<workload name="cosbench 64 driveer" description="64 drivers 10w ops">
<storage type="s3" config="accesskey={access-key};secretkey={secret-key};endpoint=http://{endpoint}" />
<workflow>
<workstage name="init">
<work type="init" workers="1" config="cprefix=cosbench;containers=r(1,1)" />
</workstage>
<workstage name="write">
<work name="write" workers="64" totalOps="100000">
<operation type="write" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000);sizes=c(1)MB" />
</work>
</workstage>
<workstage name="read">
<work name="read" workers="64" totalOps="100000">
<operation type="read" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000)" />
</work>
</workstage>
<workstage name="cleanup">
<work type="cleanup" workers="64" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000)" />
</workstage>
<workstage name="dispose">
<work type="dispose" workers="1" config="cprefix=cosbench;containers=r(1,1)" />
</workstage>
</workflow>
</workload>