postgresql - 如何将 CSV 从 HDFS 导出到 Postgresql
问题描述
我是新手,我正在尝试将数据(CSV)从 HDFS 导出到 Postgresql 数据库,但它给了我以下错误。
21/07/01 12:49:45 INFO mapreduce.Job: Job job_1621428059819_0452 failed with state FAILED due to: Task failed task_1621428059819_0452_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
21/07/01 12:49:45 INFO mapreduce.Job: Counters: 8
Job Counters
Failed map tasks=1
Launched map tasks=1
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=19208
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=4802
Total vcore-milliseconds taken by all map tasks=4802
Total megabyte-milliseconds taken by all map tasks=19668992
21/07/01 12:49:45 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
21/07/01 12:49:45 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 18.2184 seconds (0 bytes/sec)
21/07/01 12:49:45 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
21/07/01 12:49:45 INFO mapreduce.ExportJobBase: Exported 0 records.
21/07/01 12:49:45 ERROR mapreduce.ExportJobBase: Export job failed!
21/07/01 12:49:45 ERROR tool.ExportTool: Error during export: Export job failed!
这是命令:
sqoop export --driver "org.postgresql.Driver" --connect jdbc:postgresql://servidor:5432/prueba --username admin --password xxxx--table xxx--export-dir /out/staging/xxx/xxx/prueba.csv --input-fields-terminated-by ';' -- --schema public
帮助!
解决方案
推荐阅读
- python - 聚合两列(总和和最小值)
- python - 在 python 中打印 2048 板,带有标准库的间距
- javascript - 如何捕获 API 调用的进度并使用自定义文本消息在 MAT-Progress 栏中显示?
- python - pyodbc.ProgrammingError:42000
- snowflake-cloud-data-platform - 减去雪花/DBT 中的列
- php - 如何在php分页中显示前3页和后3页
- solidity - Solidity TronIDE - 恢复在返回值上执行的操作码
- reactjs - TypeScript:KeyboardEvent/Event 类型和 addEventListener 的问题
- css - 如何使用 css 转换将我的图片适合 3d 图片?
- xml - XSLT 从没有 xml 声明或 .xml 文件扩展名的文本文件中读取 xml 内容