azkaban报错:azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64

azkaban报错:azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64,第1张

azkaban报错:azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64

报错如下:

05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: account_id, v_uuid, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:04 CST ods_to_dwd_log INFO - FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session 4492e628-e0f9-430e-a994-9e9e476586d6
05-01-2022 10:21:05 CST ods_to_dwd_log INFO - Process with id 11720 completed unsuccessfully in 10 seconds.
05-01-2022 10:21:05 CST ods_to_dwd_log ERROR - Job run failed!
java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64
	at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:312)
	at azkaban.execapp.JobRunner.runJob(JobRunner.java:823)
	at azkaban.execapp.JobRunner.doRun(JobRunner.java:602)
	at azkaban.execapp.JobRunner.run(JobRunner.java:563)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64
	at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:125)
	at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:304)
	... 8 more
05-01-2022 10:21:05 CST ods_to_dwd_log ERROR - azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64 cause: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64
05-01-2022 10:21:05 CST ods_to_dwd_log INFO - Finishing job ods_to_dwd_log at 1641349265106 with status FAILED

看到这个错误我就网上一顿搜索并修改,但是都没有找到解决方案。

在我灰心意冷的时候看到了错误中关于sql的日志,如下:

No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: account_id, v_uuid, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time

我心想,为什么会有这个日志线上呢,是不是我使用了“select * from” ,因为对于hive来说最好把要查询的列都写出来,那我就改一下这个问题吧,省的看的心烦。

奇迹出现了,改完这个问题后,重新跑azkaban竟然跑成功了。

启发,日志有时候并不能很明确的爆出错误,但是要尽量去看去解决,也许一些小问题就是导致错误的根本原因!!!!

欢迎分享,转载请注明来源:内存溢出

原文地址: https://outofmemory.cn/zaji/5699893.html

(0)
打赏 微信扫一扫 微信扫一扫 支付宝扫一扫 支付宝扫一扫
上一篇 2022-12-18
下一篇 2022-12-17

发表评论

登录后才能评论

评论列表(0条)

保存