apache-flink - 无法完成 Apache Flink 中的快照错误
问题描述
部署后我有一个反复出现的问题,我无法在本地重现。很高兴得到您的帮助。查看日志:
[realtime-event-processor-flink-job-cluster-cc4d4b46c-8cghx] {"timestamp":"2019-04-21T08:02:15+0000","level":"INFO","thread":"flink-akka.actor.default-dispatcher-39018","logger":"org.apache.flink.runtime.executiongraph.ExecutionGraph","message":"Job (00000000000000000000000000000000) switched from state RUNNING to FAILING.","context":"default","exception":"java.lang.Exception: Could not perform checkpoint 18039 for operator dynamic rule process -> Timestamps/Watermarks -> one to one (1/1).
org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:595)
org.apache.flink.streaming.runtime.io.BarrierBuffer.notifyCheckpoint(BarrierBuffer.java:396)
org.apache.flink.streaming.runtime.io.BarrierBuffer.processBarrier(BarrierBuffer.java:292)
org.apache.flink.streaming.runtime.io.BarrierBuffer.getNextNonBlocked(BarrierBuffer.java:200)
org.apache.flink.streaming.runtime.io.StreamTwoInputProcessor.processInput(StreamTwoInputProcessor.java:273)
org.apache.flink.streaming.runtime.tasks.TwoInputStreamTask.run(TwoInputStreamTask.java:117)
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
org.apache.flink.runtime.taskmanager.Task.run(Task.java:704)
java.lang.Thread.run(Thread.java:748)nCaused by: java.lang.Exception: Could not complete snapshot 18039 for operator dynamic rule process -> Timestamps/Watermarks -> one to one (1/1).
org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:422)
org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.checkpointStreamOperator(StreamTask.java:1113)
org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.executeCheckpointing(StreamTask.java:1055)
org.apache.flink.streaming.runtime.tasks.StreamTask.checkpointState(StreamTask.java:729)
org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:641)
org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:586)nt... 8 common frames omittednCaused by: java.lang.NullPointerException: nulln"}
运营商:
class DynamicRuleProcess
extends KeyedBroadcastProcessFunction[String, Event, Event, DynamicRuleProcessOutput]
with LazyLogging ...
解决方案
推荐阅读
- node.js - Mongoose bulkwrite 更新 - 如何将新的 obj 推送到数组中?
- xcode - Xcode 版本控制:致命:在合并期间无法进行部分提交
- ios - 在 swift 4 IOS 应用程序中手动添加和引用控件
- python - BeautifulSoup - AttributeError:“NavigableString”对象没有属性“find_all”
- c# - 使用 32feet.net 和 c# 接收蓝牙呼叫
- r - How to merge dataframe within a list by the same name in R?
- asp.net-core - 相对页面路径“关于”只能在执行 Razor 页面时使用。指定一个
- python - 使用牛顿法在 Python 中求解非线性方程组
- r - Rvest 正在抓取一些东西,但不是网站上的内容
- c++ - 金属防护设备地址模式