时间戳

首页 > 解决方案 > Mongo-Connector 不向 Elasticsearch 发送数据

mongodb - Mongo-Connector 不向 Elasticsearch 发送数据

问题描述

我想将 Elasticsearch 与我的本地 MongoDB 链接

这是我的mongoconnector.json配置

{
   "oplogFile": "/usr/local/etc/oplog.timestamp",
   "noDump": false,
   "batchSize": 500,
   "verbosity": 2,
   "continueOnError": false,
   "logging": {
       "type": "stream"
   },
   "docManagers": [
       {
           "docManager": "elastic2_doc_manager",
           "targetURL": "127.0.0.1:9200",
           "bulkSize": 10,
           "uniqueKey": "_id",
           "args": {
              "clientOptions": {"timeout": 5000}
           }
       }
   ]
}

和命令

mongo-connector -m "mongodb://127.0.0.1:27017/MyDatabase?replicaSet=rs0" -c ./mongoconnector.json

我第一次运行查询时，我得到了 POST 日志，这意味着这是有效的

2021-04-30 21:12:59,677 [INFO] elasticsearch:83 - POST http://127.0.0.1:9200/_bulk [status:200 request:0.062s]
2021-04-30 21:12:59,705 [INFO] elasticsearch:83 - POST http://127.0.0.1:9200/_bulk [status:200 request:0.028s]
2021-04-30 21:12:59,736 [INFO] elasticsearch:83 - POST http://127.0.0.1:9200/_bulk [status:200 request:0.030s]
2021-04-30 21:12:59,776 [INFO] elasticsearch:83 - POST http://127.0.0.1:9200/_bulk [status:200 request:0.038s]
2021-04-30 21:12:59,820 [INFO] elasticsearch:83 - POST http://127.0.0.1:9200/_bulk [status:200 request:0.043s]
2021-04-30 21:12:59,861 [INFO] elasticsearch:83 - POST http://127.0.0.1:9200/_bulk [status:200 request:0.040s]

然后我停止了修复 MongoDB 中的某些内容的过程，并手动删除了 elasticsearch 索引。

现在，当我运行相同的命令时，我会得到这些日志

2021-04-30 22:10:03,572 [INFO] mongo_connector.oplog_manager:78 - OplogThread for replica set 'rs0' is up to date with the oplog.
2021-04-30 22:10:33,577 [INFO] mongo_connector.oplog_manager:78 - OplogThread for replica set 'rs0' is up to date with the oplog.
2021-04-30 22:11:03,583 [INFO] mongo_connector.oplog_manager:78 - OplogThread for replica set 'rs0' is up to date with the oplog.
2021-04-30 22:11:33,588 [INFO] mongo_connector.oplog_manager:78 - OplogThread for replica set 'rs0' is up to date with the oplog.
2021-04-30 22:12:03,594 [INFO] mongo_connector.oplog_manager:78 - OplogThread for replica set 'rs0' is up to date with the oplog.
2021-04-30 22:12:33,597 [INFO] mongo_connector.oplog_manager:78 - OplogThread for replica set 'rs0' is up to date with the oplog.

...并且没有数据插入到弹性搜索中

有没有办法强制在 elasticsearch 中删除/插入数据？

谢谢

标签： mongodbelasticsearch

解决方案

找到了，删除 /usr/local/etc/oplog.timestamp

推荐阅读