python-3.x - How to retrieve data from influxdb RAM efficiently (without loading whole database in RAM)?
问题描述
I am performing operation with operation at large scale, with a billion data point. while I was inserting data into the database it overloaded my swap memory and then laptop freeze. I tried changing index type to "ts1" from "inmem" from config file then I was able to insert data with less swap memory usage.
Now when I start retrieving data even a single datapoint using below query it overloads RAM. Because of large RAM usage
SELECT s1 FROM m1 limit 1
When I further explored this problem I found that influxdb is inmemory database in order to optimize the performance. Is there any way to perform retrieve.
I am doing this operation via influxdb-python(5.3.1) package. Influxdb version(1.8.9)
解决方案
推荐阅读
- python - 为什么第 13 行 a = input() 会影响第 15 行 b = input(int() 上的变量?python3
- java - 将一个存储库用于多个 Dao 是最佳实践 MVVM 吗?
- c# - 实现接口与添加新方法之间有区别吗?
- python - 向多个人发送带有附件的电子邮件
- ios - Crashlytics Swift 中缺少 dSYM
- javascript - 如何应用2个动画?
- cmake - 包含在 C++ 主文件中时如何在 Clang 中编译 Cuda?
- javascript - 包含句点的 JSDoc 属性名称
- python - 如何更改 Pandas 查找自己文件的位置(特别是 parsers.pyx)?
- python - 使用延续令牌连接到 azure-datalakes 时出错