首页 > 解决方案 > HIVE output shows timestamps are being converted to UTC

问题描述

We recently implemented the following change to the spark properties:

"spark.driver.extraJavaOptions" : "-Duser.timezone=\"UTC\"","

"spark.executor.extraJavaOptions" : "-Duser.timezone=\"UTC\"",

"spark.yarn.am.extraJavaOptions": "-Duser.timezone=\"UTC\""

After above change, the HIVE output shows timestamps are being converted to UTC. The expectation is to be in EDT. Is this because of the side effects of changing JVM settings user.timezone to UTC?

标签: apache-sparkhive

解决方案


推荐阅读