报错如下:
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time 05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: account_id, v_uuid, id, event_time 05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time 05-01-2022 10:21:04 CST ods_to_dwd_log INFO - FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session 4492e628-e0f9-430e-a994-9e9e476586d6 05-01-2022 10:21:05 CST ods_to_dwd_log INFO - Process with id 11720 completed unsuccessfully in 10 seconds. 05-01-2022 10:21:05 CST ods_to_dwd_log ERROR - Job run failed! java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64 at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:312) at azkaban.execapp.JobRunner.runJob(JobRunner.java:823) at azkaban.execapp.JobRunner.doRun(JobRunner.java:602) at azkaban.execapp.JobRunner.run(JobRunner.java:563) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64 at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:125) at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:304) ... 8 more 05-01-2022 10:21:05 CST ods_to_dwd_log ERROR - azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64 cause: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64 05-01-2022 10:21:05 CST ods_to_dwd_log INFO - Finishing job ods_to_dwd_log at 1641349265106 with status FAILED
看到这个错误我就网上一顿搜索并修改,但是都没有找到解决方案。
在我灰心意冷的时候看到了错误中关于sql的日志,如下:
No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time 05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: account_id, v_uuid, id, event_time 05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
我心想,为什么会有这个日志线上呢,是不是我使用了“select * from” ,因为对于hive来说最好把要查询的列都写出来,那我就改一下这个问题吧,省的看的心烦。
奇迹出现了,改完这个问题后,重新跑azkaban竟然跑成功了。
启发,日志有时候并不能很明确的爆出错误,但是要尽量去看去解决,也许一些小问题就是导致错误的根本原因!!!!
欢迎分享,转载请注明来源:内存溢出
评论列表(0条)