首页 > 解决方案 > nifi 1.11.4 版本加载时间较长

问题描述

After migrating flows from 1.8 to 1.11, The env taking 10 minutes to load the flow and up the cluster.
it was 2 min in 1.8 env to load the flow and up the cluster.

few warning in logs which i am suspecting the delay.

但是我在 1.8 env 中也看到了这些警告,请您告诉我这个问题。

 WARN [Process Cluster Protocol Request-10] o.a.n.c.p.impl.SocketProtocolListener Failed processing protocol message from “**HOSTIP address**”com due to org.apache.nifi.cluster.protocol.ProtocolException: Failed marshalling protocol message in response to message type: CONNECTION_REQUEST due to javax.net.ssl.SSLException: Broken pipe (Write failed)
org.apache.nifi.cluster.protocol.ProtocolException: Failed marshalling protocol message in response to message type: CONNECTION_REQUEST due to javax.net.ssl.SSLException: Broken pipe (Write failed)
        at org.apache.nifi.cluster.protocol.impl.SocketProtocolListener.dispatchRequest(SocketProtocolListener.java:184)
        at org.apache.nifi.io.socket.SocketListener$2$1.run(SocketListener.java:136)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: javax.net.ssl.SSLException: Broken pipe (Write failed)
        at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:127)
        at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:326)
        at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:269)
        at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:264)
        at java.base/sun.security.ssl.SSLSocketImpl$AppOutputStream.write(SSLSocketImpl.java:980)
        at java.base/java.io.DataOutputStream.write(DataOutputStream.java:107)
        at java.base/java.io.FilterOutputStream.write(FilterOutputStream.java:108)
        at org.apache.nifi.cluster.protocol.jaxb.JaxbProtocolContext$1.marshal(JaxbProtocolContext.java:86)
        at org.apache.nifi.cluster.protocol.impl.SocketProtocolListener.dispatchRequest(SocketProtocolListener.java:182)
        ... 4 common frames omitted
        Suppressed: java.net.SocketException: Broken pipe (Write failed)
                at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
                at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
                at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
                at java.base/sun.security.ssl.SSLSocketOutputRecord.encodeAlert(SSLSocketOutputRecord.java:81)
                at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:357)
                ... 11 common frames omitted
Caused by: java.net.SocketException: Broken pipe (Write failed)
        at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
        at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
        at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
        at java.base/sun.security.ssl.SSLSocketOutputRecord.deliver(SSLSocketOutputRecord.java:319)
        at java.base/sun.security.ssl.SSLSocketImpl$AppOutputStream.write(SSLSocketImpl.java:975)
        ... 8 common frames omitted
2020-08-13 00:23:51,002 WARN [Process Cluster Protocol Request-6] org.apache.nifi.io.socket.SocketListener Dispatching socket request encountered exception due to: java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space

第二个可疑警告:WARN [Process Cluster Protocol Request-6] org.apache.nifi.io.socket.SocketListener 调度套接字请求遇到异常,原因是:java.lang.OutOfMemoryError: Java heap space java.lang.OutOfMemoryError: Java heap space在 java.base/java.util.Arrays.copyOf(Arrays.java:3745) 在 java.base/java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:120) 在 java.base/java.io.ByteArrayOutputStream.ensureCapacity (ByteArrayOutputStream.java:95) 在 java.base/java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:156) 在 com.sun.xml.bind.v2.runtime.output.UTF8XmlOutput.flushBuffer(UTF8XmlOutput.java:418) ) 在 com.sun.xml.bind.v2.runtime.output.UTF8XmlOutput.text(UTF8XmlOutput.java:371) 在 com.sun.xml.bind.v2.runtime.unmarshaller.Base64Data.writeTo(Base64Data.java:314 ) 在 com.sun.xml.bind.v2.runtime.output。UTF8XmlOutput.text(UTF8XmlOutput.java:312) 在 com.sun.xml.bind.v2.runtime.XMLSerializer.leafElement(XMLSerializer.java:356) 在 com.sun.xml.bind.v2.model.impl.RuntimeBuiltinLeafInfoImpl$ PcdataImpl.writeLeafElement(RuntimeBuiltinLeafInfoImpl.java:191) 在 com.sun.xml.bind.v2.runtime.reflect.TransducedAccessor$CompositeTransducedAccessorImpl.writeLeafElement(TransducedAccessor.java:254) 在 com.sun.xml.bind.v2.runtime。 property.SingleElementLeafProperty.serializeBody(SingleElementLeafProperty.java:130) 在 com.sun.xml.bind.v2.runtime.ClassBeanInfoImpl.serializeBody(ClassBeanInfoImpl.java:360) 在 com.sun.xml.bind.v2.runtime.XMLSerializer。 childAsXsiType(XMLSerializer.java:696) 在 com.sun.xml.bind.v2.runtime.property.SingleElementNodeProperty.serializeBody(SingleElementNodeProperty.java:158) 在 com.sun.xml.bind.v2.runtime.ClassBeanInfoImpl。com.sun.xml.bind.v2.runtime.XMLSerializer.childAsXsiType(XMLSerializer.java:696) com.sun.xml.bind.v2.runtime.property.SingleElementNodeProperty.serializeBody( SingleElementNodeProperty.java:158) 在 com.sun.xml.bind.v2.runtime.ClassBeanInfoImpl.serializeBody(ClassBeanInfoImpl.java:360) 在 com.sun.xml.bind.v2.runtime.XMLSerializer.childAsSoleContent(XMLSerializer.java: 593)在com.sun.xml.bind.v2.runtime.XMLSerializer.childAsRoot(XMLSerializer.java:494)在com.sun.xml.bind.v2.runtime. .sun.xml.bind.v2.runtime.MarshallerImpl.write(MarshallerImpl.java:328) 在 com.sun.xml.bind.v2.runtime.MarshallerImpl.marshal(MarshallerImpl.java:256) 在 javax.xml.bind .helpers.AbstractMarshallerImpl.marshal(AbstractMarshallerImpl.java:110) 在 org.apache.nifi。cluster.protocol.jaxb.JaxbProtocolContext$1.marshal(JaxbProtocolContext.java:75) 在 org.apache.nifi.cluster.protocol.impl.SocketProtocolListener.dispatchRequest(SocketProtocolListener.java:182) 在 org.apache.nifi.io.socket .SocketListener$2$1.run(SocketListener.java:136) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:628) 在 java.base/java.lang.Thread.run(Thread.java:834)java:1128) 在 java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 在 java.base/java.lang.Thread.run(Thread.java:834)java:1128) 在 java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 在 java.base/java.lang.Thread.run(Thread.java:834)

标签: apache-nifi

解决方案


推荐阅读