apache-spark - 逐行合并火花数据帧

Question

我有两个火花数据框：

df1

+------+--------------------+
|   id |            feature |           
+------+--------------------+
|     1|                 aaa|
+------+--------------------+

df2

+------+--------------------+
|   id |            feature |           
+------+--------------------+
|     2|                 bbb|
+------+--------------------+

现在我想将 df1 和 df2 合并到：

+------+--------------------+
|   id |            feature |           
+------+--------------------+
|     1|                 aaa|
+------+--------------------+
|     2|                 bbb|
+------+--------------------+

我该怎么办？

标签： apache-sparkapache-spark-sql

Answer 1

df1.unionByName(df2)

UnionByName 函数：https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/Dataset.html#unionByName(other:org.apache.spark.sql.Dataset[T]) :org.apache.spark.sql.Dataset[T]