kubernetes - helm install 后 Grafana pod 不断重启
问题描述
我有一个干净的 AKS 集群,我部署了 prometheus-operator 图表。Grafana pod 显示了大量的重新启动。我的集群版本是 1.11.3。Grafana 日志如下。还有其他人遇到这个问题吗?
File in configmap grafana-dashboard-k8s-node-rsrc-use.json ADDED
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/urllib3/response.py", line 543, in _update_chunk_length
self.chunk_left = int(line, 16)
ValueError: invalid literal for int() with base 16: b''
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/urllib3/response.py", line 302, in _error_catcher
yield
File "/usr/local/lib/python3.6/site-packages/urllib3/response.py", line 598, in read_chunked
self._update_chunk_length()
File "/usr/local/lib/python3.6/site-packages/urllib3/response.py", line 547, in _update_chunk_length
raise httplib.IncompleteRead(line)
http.client.IncompleteRead: IncompleteRead(0 bytes read)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/app/sidecar.py", line 58, in <module>
main()
File "/app/sidecar.py", line 54, in main
watchForChanges(label, targetFolder)
File "/app/sidecar.py", line 23, in watchForChanges
for event in w.stream(v1.list_config_map_for_all_namespaces):
File "/usr/local/lib/python3.6/site-packages/kubernetes/watch/watch.py", line 124, in stream
for line in iter_resp_lines(resp):
File "/usr/local/lib/python3.6/site-packages/kubernetes/watch/watch.py", line 45, in iter_resp_lines
for seg in resp.read_chunked(decode_content=False):
File "/usr/local/lib/python3.6/site-packages/urllib3/response.py", line 626, in read_chunked
self._original_response.close()
File "/usr/local/lib/python3.6/contextlib.py", line 99, in __exit__
self.gen.throw(type, value, traceback)
File "/usr/local/lib/python3.6/site-packages/urllib3/response.py", line 320, in _error_catcher
raise ProtocolError('Connection broken: %r' % e, e)
urllib3.exceptions.ProtocolError: ('Connection broken: IncompleteRead(0 bytes read)', IncompleteRead(0 bytes read))
解决方案
基于Prometheus 操作员存储库... Grafana pod 上的 sidecar 容器无法联系 Grafana 并重新加载/刷新正在监视的 configmap 上定义的仪表板。
所以这是 Grafana 容器失败的症状......你能检查 Grafana 容器日志中的 Grafana 容器吗?
推荐阅读
- snmp4j - SNMP4J:无法让 SNMPv3 与多个目标一起工作
- node.js - 为具有异构数组的对象创建猫鼬模式
- javascript - 查找具有样式属性的元素并更改它
- ruby-on-rails - 在 ruby mechanize 中获取连接详细信息
- ios - 滚动 react-native 时如何防止对 textInput 的关注?
- dask - Dask.dataframe.to_parquet 制作非常大的文件
- python - Project Euler - 寻找除数问题 12
- tensorflow - raise ValueError('boxlists 的所有元素都应该是 BoxList 对象')
- nginx - rtmp模块流没有,如何解决?
- c# - 是否可以创建一个可以添加两个不同类的列表?