apache-nifi - nifi 1.11.4 版本加载时间较长
问题描述
After migrating flows from 1.8 to 1.11, The env taking 10 minutes to load the flow and up the cluster.
it was 2 min in 1.8 env to load the flow and up the cluster.
few warning in logs which i am suspecting the delay.
但是我在 1.8 env 中也看到了这些警告,请您告诉我这个问题。
WARN [Process Cluster Protocol Request-10] o.a.n.c.p.impl.SocketProtocolListener Failed processing protocol message from “**HOSTIP address**”com due to org.apache.nifi.cluster.protocol.ProtocolException: Failed marshalling protocol message in response to message type: CONNECTION_REQUEST due to javax.net.ssl.SSLException: Broken pipe (Write failed)
org.apache.nifi.cluster.protocol.ProtocolException: Failed marshalling protocol message in response to message type: CONNECTION_REQUEST due to javax.net.ssl.SSLException: Broken pipe (Write failed)
at org.apache.nifi.cluster.protocol.impl.SocketProtocolListener.dispatchRequest(SocketProtocolListener.java:184)
at org.apache.nifi.io.socket.SocketListener$2$1.run(SocketListener.java:136)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: javax.net.ssl.SSLException: Broken pipe (Write failed)
at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:127)
at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:326)
at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:269)
at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:264)
at java.base/sun.security.ssl.SSLSocketImpl$AppOutputStream.write(SSLSocketImpl.java:980)
at java.base/java.io.DataOutputStream.write(DataOutputStream.java:107)
at java.base/java.io.FilterOutputStream.write(FilterOutputStream.java:108)
at org.apache.nifi.cluster.protocol.jaxb.JaxbProtocolContext$1.marshal(JaxbProtocolContext.java:86)
at org.apache.nifi.cluster.protocol.impl.SocketProtocolListener.dispatchRequest(SocketProtocolListener.java:182)
... 4 common frames omitted
Suppressed: java.net.SocketException: Broken pipe (Write failed)
at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
at java.base/sun.security.ssl.SSLSocketOutputRecord.encodeAlert(SSLSocketOutputRecord.java:81)
at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:357)
... 11 common frames omitted
Caused by: java.net.SocketException: Broken pipe (Write failed)
at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
at java.base/sun.security.ssl.SSLSocketOutputRecord.deliver(SSLSocketOutputRecord.java:319)
at java.base/sun.security.ssl.SSLSocketImpl$AppOutputStream.write(SSLSocketImpl.java:975)
... 8 common frames omitted
2020-08-13 00:23:51,002 WARN [Process Cluster Protocol Request-6] org.apache.nifi.io.socket.SocketListener Dispatching socket request encountered exception due to: java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
第二个可疑警告:WARN [Process Cluster Protocol Request-6] org.apache.nifi.io.socket.SocketListener 调度套接字请求遇到异常,原因是:java.lang.OutOfMemoryError: Java heap space java.lang.OutOfMemoryError: Java heap space在 java.base/java.util.Arrays.copyOf(Arrays.java:3745) 在 java.base/java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:120) 在 java.base/java.io.ByteArrayOutputStream.ensureCapacity (ByteArrayOutputStream.java:95) 在 java.base/java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:156) 在 com.sun.xml.bind.v2.runtime.output.UTF8XmlOutput.flushBuffer(UTF8XmlOutput.java:418) ) 在 com.sun.xml.bind.v2.runtime.output.UTF8XmlOutput.text(UTF8XmlOutput.java:371) 在 com.sun.xml.bind.v2.runtime.unmarshaller.Base64Data.writeTo(Base64Data.java:314 ) 在 com.sun.xml.bind.v2.runtime.output。UTF8XmlOutput.text(UTF8XmlOutput.java:312) 在 com.sun.xml.bind.v2.runtime.XMLSerializer.leafElement(XMLSerializer.java:356) 在 com.sun.xml.bind.v2.model.impl.RuntimeBuiltinLeafInfoImpl$ PcdataImpl.writeLeafElement(RuntimeBuiltinLeafInfoImpl.java:191) 在 com.sun.xml.bind.v2.runtime.reflect.TransducedAccessor$CompositeTransducedAccessorImpl.writeLeafElement(TransducedAccessor.java:254) 在 com.sun.xml.bind.v2.runtime。 property.SingleElementLeafProperty.serializeBody(SingleElementLeafProperty.java:130) 在 com.sun.xml.bind.v2.runtime.ClassBeanInfoImpl.serializeBody(ClassBeanInfoImpl.java:360) 在 com.sun.xml.bind.v2.runtime.XMLSerializer。 childAsXsiType(XMLSerializer.java:696) 在 com.sun.xml.bind.v2.runtime.property.SingleElementNodeProperty.serializeBody(SingleElementNodeProperty.java:158) 在 com.sun.xml.bind.v2.runtime.ClassBeanInfoImpl。com.sun.xml.bind.v2.runtime.XMLSerializer.childAsXsiType(XMLSerializer.java:696) com.sun.xml.bind.v2.runtime.property.SingleElementNodeProperty.serializeBody( SingleElementNodeProperty.java:158) 在 com.sun.xml.bind.v2.runtime.ClassBeanInfoImpl.serializeBody(ClassBeanInfoImpl.java:360) 在 com.sun.xml.bind.v2.runtime.XMLSerializer.childAsSoleContent(XMLSerializer.java: 593)在com.sun.xml.bind.v2.runtime.XMLSerializer.childAsRoot(XMLSerializer.java:494)在com.sun.xml.bind.v2.runtime. .sun.xml.bind.v2.runtime.MarshallerImpl.write(MarshallerImpl.java:328) 在 com.sun.xml.bind.v2.runtime.MarshallerImpl.marshal(MarshallerImpl.java:256) 在 javax.xml.bind .helpers.AbstractMarshallerImpl.marshal(AbstractMarshallerImpl.java:110) 在 org.apache.nifi。cluster.protocol.jaxb.JaxbProtocolContext$1.marshal(JaxbProtocolContext.java:75) 在 org.apache.nifi.cluster.protocol.impl.SocketProtocolListener.dispatchRequest(SocketProtocolListener.java:182) 在 org.apache.nifi.io.socket .SocketListener$2$1.run(SocketListener.java:136) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:628) 在 java.base/java.lang.Thread.run(Thread.java:834)java:1128) 在 java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 在 java.base/java.lang.Thread.run(Thread.java:834)java:1128) 在 java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 在 java.base/java.lang.Thread.run(Thread.java:834)
解决方案
推荐阅读
- javascript - 如何使用 Javascript 设置滑块元素的值?
- python - 如何将两个值作为字符串连接到odoo Char字段中?
- javascript - Bokeh CustomJS 回调以在滑块移动时更改 DataFrame 的行
- snowflake-cloud-data-platform - 在雪花的创建脚本中添加当前日期
- python - 当原始程序关闭时,如何停止从另一个 python 程序中启动的烧瓶应用程序?
- mariadb - mysqldump:无法执行'show create table `xxx.yyy`':引擎中不存在表'yyy'(1932)
- python - 如何将嵌入式 URL 列表发送到第二个解析 scrapy 函数?
- php - 如何将此 SQL 转换为 Laravel Eloquent?
- javascript - Jest mockedCoeus.mockImplementation 抛出 TypeError
- mongodb - 对于 4.2 之前的 mongo 版本,聚合管道中 $set 的 MongoDB 替代方案?