首页 > 解决方案 > 如何将 CSV 从 HDFS 导出到 Postgresql

问题描述

我是新手,我正在尝试将数据(CSV)从 HDFS 导出到 Postgresql 数据库,但它给了我以下错误。

21/07/01 12:49:45 INFO mapreduce.Job: Job job_1621428059819_0452 failed with state FAILED due to: Task failed task_1621428059819_0452_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

21/07/01 12:49:45 INFO mapreduce.Job: Counters: 8
        Job Counters
                Failed map tasks=1
                Launched map tasks=1
                Data-local map tasks=1
                Total time spent by all maps in occupied slots (ms)=19208
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=4802
                Total vcore-milliseconds taken by all map tasks=4802
                Total megabyte-milliseconds taken by all map tasks=19668992
21/07/01 12:49:45 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
21/07/01 12:49:45 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 18.2184 seconds (0 bytes/sec)
21/07/01 12:49:45 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
21/07/01 12:49:45 INFO mapreduce.ExportJobBase: Exported 0 records.
21/07/01 12:49:45 ERROR mapreduce.ExportJobBase: Export job failed!
21/07/01 12:49:45 ERROR tool.ExportTool: Error during export: Export job failed!

这是命令:

sqoop export --driver "org.postgresql.Driver" --connect jdbc:postgresql://servidor:5432/prueba  --username admin --password xxxx--table xxx--export-dir /out/staging/xxx/xxx/prueba.csv  --input-fields-terminated-by ';' -- --schema public 

帮助!

标签: postgresqlhadoopsqoop

解决方案


推荐阅读