avro - 尝试将 JSON 转换为 AVRO 时没有类型错误
问题描述
我正在尝试将 JSON 有效负载转换为 Avro 以发布到 Kafka 主题。但是,当我进行 Dataweave 转换时,我收到“无类型”错误。我不确定是什么导致了错误。我最初认为这可能是由于转换不知道入站有效负载上的 MIME 类型。所以,我已经确定它设置为,application/json
但这没有任何区别。
Avro 架构
{
"compatibility" : "forward",
"name": "ContentManagerCoupons",
"type": "record",
"namespace": "com.rentpath",
"fields": [
{
"name": "clientID",
"type": "string"
},
{
"name": "outputHistoryId",
"type": "string"
},
{
"name": "categoryCoupons",
"type": {
"type": "array",
"items": {
"name": "categoryCoupons_record",
"type": "record",
"fields": [
{
"name": "applyBy",
"type": [
"string",
"int",
"null"
]
},
{
"name": "applyPeriod",
"type": [
"string",
"null"
]
},
{
"name": "cashValue",
"type": [
"int",
"null"
]
},
{
"name": "couponCategory",
"type": "string"
},
{
"name": "cashOffDesc",
"type": [
"string",
"null"
]
},
{
"name": "endDate",
"type": [
"string",
"null"
]
},
{
"name": "feeType",
"type": [
"string",
"null"
]
},
{
"name": "freeWeeks",
"type": [
"string",
"null"
]
},
{
"name": "generatedText",
"type": "string"
},
{
"name": "leaseby",
"type": [
"string",
"null"
]
},
{
"name": "leaseTerm",
"type": [
"int",
"null"
]
},
{
"name": "offerText",
"type": [
"string",
"null"
]
},
{
"name": "startDate",
"type": "string"
},
{
"name": "unitType",
"type": [
"string",
"null"
]
}
]
}
}
}
]
}
JSON消息
{
"outputHistoryId": "55324456",
"clientID": "112345",
"categoryCoupons": [
{
"unitType": null,
"startDate": "07/21/2020",
"offerText": "This would be the special offer message.",
"leaseTerm": null,
"leaseby": null,
"generatedText": "This would be the special offer message..",
"freeWeeks": null,
"feeType": null,
"endDate": "10/01/2020",
"couponCategory": "Special Offer",
"cashValue": null,
"cashOffDesc": null,
"applyPeriod": null,
"applyBy": null
}
]
}
数据波
%dw 2.2
output application/avro schemaUrl="http://schema-registry.domain.com:8081/subjects/Coupon-value/versions/1"
---
payload
错误信息
"org.apache.avro.SchemaParseException - 无类型:{"subject":"ContentManager.Coupon-value","version":1,"id":342,"schema":"{"type":"record" ,"name":"ContentManagerCoupons","namespace":"com.rentpath","fields":[{"name":"clientID","type":"string"},{"name":"outputHistoryId" ,"type":"string"},{"name":"categoryCoupons","type":{"type":"array","items":{"type":"record","name":" categoryCoupons_record","fields":[{"name":"applyBy","type":["string","int","null"]},{"name":"applyPeriod","type":["string","null"]},{"name":"cashValue","type":["int","null"]},{"name":"couponCategory" ,"type":"string"},{"name":"cashOffDesc","type":["string","null"]},{"name":"endDate","type":["string ","null"]},{"name":"feeType","type":["string","null"]},{"name":"freeWeeks","type":["string", "null"]},{"name":"generatedText","type":"string"},{"name":"leaseby","type":["string","null"]},{"名称":"租期","type":["int","null"]},{"name":"offerText","type":["string","null"]},{"name":"startDate","type" :"string"},{"name":"unitType","type":["string","null"]}]}}}],"compatibility":"forward"}"} org.apache.avro .SchemaParseException: 无类型:{"subject":"ContentManager.Coupon-value","version":1,"id":342,"schema":"{"type":"record","name":" ContentManagerCoupons","namespace":"com.rentpath","fields":[{"name":"clientID","type":"string"},{"name":"outputHistoryId","type":"细绳”},{"name":"categoryCoupons","type":{"type":"array","items":{"type":"record","name":"categoryCoupons_record","fields":[ {"name":"applyBy","type":["string","int","null"]},{"name":"applyPeriod","type":["string","null"] },{"name":"cashValue","type":["int","null"]},{"name":"couponCategory","type":"string"},{"name":" cashOffDesc","type":["string","null"]},{"name":"endDate","type":["string","null"]},{"name":"feeType" ,“类型”:["string","null"]},{"name":"freeWeeks","type":["string","null"]},{"name":"generatedText","type":"string "},{"name":"leaseby","type":["string","null"]},{"name":"leaseTerm","type":["int","null"]} ,{"name":"offerText","type":["string","null"]},{"name":"startDate","type":"string"},{"name":"unitType ","type":["string","null"]}]}}}],"compatibility":"forward"}"} at org.apache.avro.Schema.getRequiredText(Schema.java:1753) at org.apache.avro.Schema.parse(Schema.java:1604) 在 org.apache.avro。Schema$Parser.parse(Schema.java:1394) at org.apache.avro.Schema$Parser.parse(Schema.java:1365) at org.mule.weave.v2.module.avro.AvroWriter.doWriteValue(AvroWriter. scala:195) 在 org.mule.weave.v2.module.writer.Writer.writeValue(Writer.scala:41) 在 org.mule.weave.v2.module.writer.Writer.writeValue$(Writer.scala:39 ) 在 org.mule.weave.v2.module.avro.AvroWriter.writeValue(AvroWriter.scala:44) 在 org.mule.weave.v2.module.writer.DeferredWriter.doWriteValue(DeferredWriter.scala:73) 在 org. mule.weave.v2.module.writer.Writer.writeValue(Writer.scala:41) at org.mule.weave.v2.module.writer.Writer.writeValue$(Writer.scala:39) at org.mule.weave .v2.module.writer.DeferredWriter.writeValue(DeferredWriter.scala:16) 在 org.mule.weave.v2.module.writer.WriterHelper$.writeValue(Writer.scala:120) 在 org.mule.weave.v2。 module.writer.WriterHelper$.writeAndGetResult(Writer.scala:98) 在 org.mule.weave.v2.interpreted.InterpretedMappingExecutableWeave.write(InterpreterMappingCompilerPhase.scala:236) 在 org.mule.weave.v2.el.WeaveExpressionLanguageSession.evaluateWithTimeout(WeaveExpressionLanguageSession.scala:243) 在 org.mule .weave.v2.el.WeaveExpressionLanguageSession.evaluate(WeaveExpressionLanguageSession.scala:108) 在 org.mule.runtime.core.internal.el.dataweave.DataWeaveExpressionLanguageAdaptor$1.evaluate(DataWeaveExpressionLanguageAdaptor.java:308) 在 org.mule.runtime。 core.internal.el.DefaultExpressionManagerSession.evaluate(DefaultExpressionManagerSession.java:105) 在 com.mulesoft.mule.runtime.core.internal.processor.SetPayloadTransformationTarget.process(SetPayloadTransformationTarget.java:32) 在 com.mulesoft.mule.runtime。 core.internal.processor.TransformMessageProcessor.lambda$0(TransformMessageProcessor.java:92) 在 java.util.Optional.ifPresent(Optional.java:159) 在 com.mulesoft.mule.runtime.core.internal.processor.TransformMessageProcessor.process(TransformMessageProcessor.java:92) 在 org.mule.runtime.core .api.util.func.CheckedFunction.apply(CheckedFunction.java:25) 在 org.mule.runtime.core.api.rx.Exceptions.lambda$checkedFunction$2(Exceptions.java:84) 在 org.mule.runtime。 core.internal.util.rx.Operators.lambda$nullSafeMap$0(Operators.java:47) at reactor.core.publisher.FluxHandleFuseable$HandleFuseableSubscriber.onNext(FluxHandleFuseable.java:165) at org.mule.runtime.core.privileged .processor.chain.AbstractMessageProcessorChain$2.onNext(AbstractMessageProcessorChain.java:425) 在 org.mule.runtime.core.privileged.processor.chain.AbstractMessageProcessorChain$2.onNext(AbstractMessageProcessorChain.java:420) 在 reactor.core.publisher。FluxHide$SuppressFuseableSubscriber.onNext(FluxHide.java:127) 在 reactor.core.publisher.FluxPeekFuseable$PeekFuseableSubscriber.onNext(FluxPeekFuseable.java:204) 在 reactor.core.publisher.FluxOnAssembly$OnAssemblySubscriber.onNext(FluxOnAssembly.java:345)在 reactor.core.publisher.FluxSubscribeOnValue$ScheduledScalar.run(FluxSubscribeOnValue.java:178) 在 reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:50) 在 reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java :27) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.mule.service.scheduler.internal.AbstractRunnableFutureDecorator.doRun(AbstractRunnableFutureDecorator.java:111) at org.mule.service.scheduler。 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.internal.RunnableFutureDecorator.run(RunnableFutureDecorator.java:54)。util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 在 java.lang.Thread.run(Thread.java:748),同时在有效负载上编写 Avro。
解决方案
它似乎对我有用。尝试访问架构时可能存在问题。因为我无权访问该 URL,所以我将其替换为本地文件:
output application/avro schemaUrl="classpath://schema.json"
推荐阅读
- html - 如何使导航栏居中?
- antlr - 没有可行的替代解析宏和覆盖
- javascript - 在输入字段中输入 3 个字符后如何显示 mat-menu?
- c++ - 当我们将基类复制构造函数设为私有时会发生什么?
- php - 从 Woocommerce 标签获取缩略图
- regex - 已编辑:Grep/Awk- 从表中打印特定信息
- c# - MahApps.Metro DropDownButton click event
- typescript - Is it possible to set conditions within types or interfaces in TypeScript
- windows - TwinCat project in Visual Studio files show up with yellow triangle and examination mark
- c++ - 标准::变体
作为模板函数的最后一个参数,采用多个可变参数