1、bulk语法
POST /_bulk
{ "delete": { "_index": "shop", "_id": "2" }}
{ "create": { "_index": "shop", "_id": "3" }}
{ "name" : "vivo 20", "price" : "4890", "system" : "android9", "CPU" : "xiaolong 890" }
{ "index": { "_index": "shop", "_id": "1" }}
{ "name" : "iphone 12", "price" : "14890", "system" : "iOS 18", "CPU" : "xiaolong 990" }
{ "update": { "_index": "shop", "_id": "1"} }
{ "doc" : {"price" : "12890"} }
结果如下:
{
"took" : 69,
"errors" : false,
"items" : [
{
"delete" : {
"_index" : "shop",
"_type" : "_doc",
"_id" : "2",
"_version" : 3,
"result" : "deleted",
"_shards" : {
"total" : 2,
"successful" : 1,
"failed" : 0
},
"_seq_no" : 3,
"_primary_term" : 3,
"status" : 200
}
},
{
"create" : {
"_index" : "shop",
"_type" : "_doc",
"_id" : "3",
"_version" : 1,
"result" : "created",
"_shards" : {
"total" : 2,
"successful" : 1,
"failed" : 0
},
"_seq_no" : 4,
"_primary_term" : 3,
"status" : 201
}
},
{
"index" : {
"_index" : "shop",
"_type" : "_doc",
"_id" : "1",
"_version" : 2,
"result" : "updated",
"_shards" : {
"total" : 2,
"successful" : 1,
"failed" : 0
},
"_seq_no" : 5,
"_primary_term" : 3,
"status" : 200
}
},
{
"update" : {
"_index" : "shop",
"_type" : "_doc",
"_id" : "1",
"_version" : 3,
"result" : "updated",
"_shards" : {
"total" : 2,
"successful" : 1,
"failed" : 0
},
"_seq_no" : 6,
"_primary_term" : 3,
"status" : 200
}
}
]
}
每一个操作要两个json串,语法如下:
{"action": {"metadata"}}
{"data"}
举例,比如你现在要创建一个文档,放bulk里面,看起来会是这样子的:
{"index": {"_index": "test_index", "_type", "test_type", "_id": "1"}}
{"test_field1": "test1", "test_field2": "test2"}
有哪些类型的操作可以执行呢?
(1)delete
:删除一个文档,只要1个json串就可以了
(2)create
:PUT /index/_create/id/
,强制创建
(3)index
:普通的put操作,可以是创建文档,也可以是全量替换文档
(4)update
:执行的partial update
操作
bulk api 对json的语法,有严格的要求,每个json串不能换行,只能放一行,同时一个json串和一个json串之间,必须有一个换行
bulk操作中,任意一个操作失败,是不会影响其他的操作的,但是在返回结果里,会告诉你异常日志
POST /shop/_doc/_bulk
{ "delete": { "_id": "3" }}
{ "create": { "_id": "12" }}
{ "test_field": "test12" }
{ "index": { }}
{ "test_field": "auto-generate id test" }
{ "index": { "_id": "2" }}
{ "test_field": "replaced test2" }
{ "update": { "_id": "1", "_retry_on_conflict" : 3} }
{ "doc" : {"test_field2" : "bulk test1"} }
2、bulk size
最佳大小
bulk request
会加载到内存里,如果太大的话,性能反而会下降,因此需要反复尝试一个最佳的 bulk size
。一般从 1000~5000 条数据开始,尝试逐渐增加。 另外,如果看大小的话,最好是在5~15MB之间。