时间戳

首页 > 解决方案 > Hazelcast Jet 0.6.1 + Pipeline API + 定制处理器

hazelcast-jet - Hazelcast Jet 0.6.1 + Pipeline API + 定制处理器

问题描述

我正在尝试将自定义处理器附加到 Hazelcast Jet Pipeline 定义。

这是示例代码。

private Pipeline buildPipeline() {

   Pipeline p = Pipeline.create();
    p.drawFrom(Sources.<String, Record>remoteMapJournal("record", 
   getClientConfig(), START_FROM_OLDEST))
      .addTimestamps((v) ->  getTimeStamp(v), 3000)
      .peek()
      .groupingKey((v) -> Tuple2.tuple2(getUserID(v),getTranType(v)))
      .window(WindowDefinition.sliding(SLIDING_WINDOW_LENGTH_MILLIS, 
      SLIDE_STEP_MILLIS))
      .aggregate(counting())
      .map((v)-> getMapKey(v))
      .customTransform("test2", ()-> this);

     return p;

    }

这是 tryProcess() 方法的示例代码

    protected boolean tryProcess(int ordinal, Object item) {
    TimestampedEntry entry = (TimestampedEntry)item;
    System.out.println("Item value is "+ item);
    map1.put(entry.getKey(), entry.getValue());
    return true;
}

在执行时，我得到了以下异常

java.lang.IllegalArgumentException: These transforms have nothing attached to them: [test2]
    at com.hazelcast.jet.impl.pipeline.Planner.validateNoLeakage(Planner.java:104)
    at com.hazelcast.jet.impl.pipeline.Planner.createDag(Planner.java:65)
    at com.hazelcast.jet.impl.pipeline.PipelineImpl.toDag(PipelineImpl.java:85)
    at com.hazelcast.jet.JetInstance.newJob(JetInstance.java:94)
    at com.sap.banking.bc.AbstractAuditLogProcessor1.start(AbstractAuditLogProcessor1.java:132)
    at com.sap.banking.bc.JobProcessor.main(JobProcessor.java:18)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:282)
    at java.lang.Thread.run(Thread.java:812)

有什么遗漏吗？你能帮我解决这个问题吗？

标签： hazelcast-jet

解决方案

例外是你错过了一个接收器，一个drainTo电话。

推荐阅读