impala+hive自定义函数

impala+hive自定义函数,第1张

impala+hive自定义函数

impala:
create function fuzzyMatch(string,string) returns double location '/user/hive/udf/common_project-1.0-SNAPSHOT.jar' symbol='utils.FuzzyMatch';

create function getDistance(double,double,double,double) returns double location '/user/hive/udf/common_project-1.0-SNAPSHOT.jar' symbol='utils.Distance';

hive:
add jar /data/common_project-1.0-SNAPSHOT.jar
create temporary function fuzzyMatch as 'utils.FuzzyMatch';

create temporary function getDistance as 'utils.Distance';


create function getDistance as 'utils.Distance' using jar 'hdfs:///user/hive/udf/common_project-1.0-SNAPSHOT.jar';  
create function fuzzyMatch as 'utils.FuzzyMatch' using jar 'hdfs:///user/hive/udf/common_project-1.0-SNAPSHOT.jar';  

sqoop导入:
sqoop import --connect jdbc:mysql://192.168.16.126:3306/sinohealth_test  --username hefeng --password hefeng%123 --table student --fields-terminated-by 't'  --hive-import  --hive-overwrite  --hive-database sinohealth_test --hive-table student  --null-string '\N'  --null-non-string '\N' 

sqoop导出:
sqoop export --connect jdbc:mysql://192.168.52.23:3306/test  --username hefeng --password hefeng%123 --table student --fields-terminated-by 't'    --hcatalog-database sinohealth_test --hcatalog-table student  

impala命令登陆:
impala-shell -i hadoop04:21000 -u hive -l --auth_creds_ok_in_clear 

impala-shell -i hadoop04:21000 -u data_tool_hadoop -l --auth_creds_ok_in_clear 

欢迎分享,转载请注明来源:内存溢出

原文地址: https://outofmemory.cn/zaji/5705897.html

(0)
打赏 微信扫一扫 微信扫一扫 支付宝扫一扫 支付宝扫一扫
上一篇 2022-12-17
下一篇 2022-12-17

发表评论

登录后才能评论

评论列表(0条)

保存