首页 > 解决方案 > 本地类不兼容:流 classdesc

问题描述

test = FOREACH data { a = (IsNumeric(age) ? (int)age : null); GENERATE (a IS NULL ? NULL : 0) AS age_bucket:int;};

年龄:数据中的chararray。脚本失败并出现错误:

引起:org.apache.pig.backend.executionengine.ExecException:错误0:org.apache.pig.backend.executionengine.ExecException:错误2997:无法从支持的错误重新创建异常:错误:java.lang.RuntimeException:问题在配置reduce计划时。在 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.setup(PigGenericMapReduce.java:351) 在 org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:168) 在 org.apache .hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) 在 org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) 在 org.apache.hadoop.mapred.YarnChild$2.run(YarnChild. java:168) 在 java.security.AccessController.doPrivileged(Native Method) 在 javax.security.auth.Subject.doAs(Subject.java:422) 在 org.apache.hadoop。security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) 原因:java.io.IOException:反序列化错误:org.apache.pig.backend .hadoop.executionengine.physicalLayer.expressionOperators.UnaryComparisonOperator;本地类不兼容:流 classdesc serialVersionUID = -1153715670674229029,本地类 serialVersionUID = -4935333078211151221 at org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:62)

标签: javahadoopserializationmapreduceapache-pig

解决方案


推荐阅读