首页 > 解决方案 > ElasticSearch - 获取多次出现

问题描述

假设我在弹性搜索中有一些数据,我想检索一个特定字段多次出现的所有记录。例如:

{id:1, name: "bob", "age":30}
{id:2, name: "mike", "age":20}
{id:3, name: "bob", "age":30}
{id:4, name: "sarah", "age":40}
{id:5, name: "mike", "age":35}

我想要一个按名称返回多次出现的查询。所以它应该返回以下记录:

{id:1, name: "bob", "age":30}
{id:2, name: "mike", "age":20}
{id:3, name: "bob", "age":30}
{id:5, name: "mike", "age":35}

所以 id: 4 被排除在外,因为“sarah”这个名字只出现在一个文档中。更可取的回报是这样的:

{"name": "bob", "count":2}
{"name": "mike", "count":2}

但如果更容易,可以使用第一个查询返回。

标签: elasticsearch

解决方案


Aggregations您可以使用Elasticsearch中所谓的内容。如果您只是在寻找重复的名称,您可以使用Terms Aggregation.

这是一个例子。您可以像这样设置数据:

PUT testing/_doc/1
{
  "name": "bob",
  "age": 30
}

PUT testing/_doc/2
{
  "name": "mike",
  "age": 20
}

PUT testing/_doc/3
{
  "name": "bob",
  "age": 30
}

PUT testing/_doc/4
{
  "name": "sarah",
  "age": 40
}

PUT testing/_doc/5
{
  "name": "mike",
  "age": 20
}

然后运行你的聚合:

GET testing/_doc/_search
{
  "size": 0,
  "query": {
    "match_all": {}
  },
  "aggs": {
    "duplicates": {
      "terms": {
        "field": "name.keyword",
        "min_doc_count": 2
      }
    }
  }
}

这会给你这样的回应:

{
  "took": 6,
  "timed_out": false,
  "_shards": {
    "total": 5,
    "successful": 5,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 5,
    "max_score": 0,
    "hits": []
  },
  "aggregations": {
    "duplicates": {
      "doc_count_error_upper_bound": 0,
      "sum_other_doc_count": 0,
      "buckets": [
        {
          "key": "bob",
          "doc_count": 2
        },
        {
          "key": "mike",
          "doc_count": 2
        }
      ]
    }
  }
}

重要的部分是aggregations.duplicates.buckets"name"显示的位置"key"


推荐阅读