Presto连接Clickhouse

1. 首先安装presto

安装教程可以参考官网及下面这篇文章
官方文档
presto安装部署

2. 下载presto-clickhouse

这里已有大佬实现presto-clickhouse的Connectors,我们直接下载来用就好
https://github.com/zeeshanabid94/presto/tree/presto-clickhouse/presto-clickhouse

3. 编译presto-clickhouse

我们只需要编译presto-clickhouse部分,这里有两种方式
直接在下载的项目里编译,不过有很多check,对maven、jdk版本进行检测,这些按照官网要求来,当然也可以在主pom中关掉check
也可以直接新建一个项目编译
这里我选择新建项目

①:新建项目,拷贝代码
这里我们选择新建一个项目,把下载的presto_clickhouse中的代码拷贝进去

②:添加clickhouse Connector
在resource下新建META-INF/services 目录,在此目录下新建com.facebook.presto.spi.Plugin文件,在文件中添加com.facebook.presto.plugin.clickhouse.ClickhousePlugin,如下图
这一步主要是为了ConnectorFactory能识别clcikhouse的Connector

③:修改pom文件

<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <parent>
        <artifactId>base_moduleartifactId>
        <groupId>idea_workspacegroupId>
        <version>1.0-SNAPSHOTversion>
    parent>

    <modelVersion>4.0.0modelVersion>

    <artifactId>presto-clickhouseartifactId>


    <dependencies>

        
        <dependency>
            <groupId>ru.yandex.clickhousegroupId>
            <artifactId>clickhouse-jdbcartifactId>
            <version>0.1.50version>
        dependency>

        <dependency>
            <groupId>com.facebook.prestogroupId>
            <artifactId>presto-spiartifactId>
            <version>0.223version>
            <scope>providedscope>
        dependency>

        <dependency>
            <groupId>com.fasterxml.jackson.coregroupId>
            <artifactId>jackson-annotationsartifactId>
            <version>2.9.7version>
        dependency>

        <dependency>
            <groupId>io.airliftgroupId>
            <artifactId>logartifactId>
            <version>0.178version>
        dependency>

        <dependency>
            <groupId>io.airliftgroupId>
            <artifactId>configurationartifactId>
            <version>0.178version>
        dependency>

        <dependency>
            <groupId>javax.injectgroupId>
            <artifactId>javax.injectartifactId>
            <version>1version>
        dependency>


        <dependency>
            <groupId>com.google.guavagroupId>
            <artifactId>guavaartifactId>
            <version>24.1-jreversion>
        dependency>


        <dependency>
            <groupId>com.google.injectgroupId>
            <artifactId>guiceartifactId>
            <version>4.2.0version>
        dependency>

        <dependency>
            <groupId>com.facebook.prestogroupId>
            <artifactId>presto-base-jdbcartifactId>
            <version>0.223version>
        dependency>



    dependencies>

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.pluginsgroupId>
                <artifactId>maven-shade-pluginartifactId>
                <version>2.4.3version>
                <executions>
                    <execution>
                        <phase>packagephase>
                        <goals>
                            <goal>shadegoal>
                        goals>
                        <configuration>
                            <filters>
                                <filter>
                                    <artifact>*:*artifact>
                                    <excludes>
                                        <exclude>META-INF/*.SFexclude>
                                        <exclude>META-INF/*.DSAexclude>
                                        <exclude>META-INF/*.RSAexclude>
                                    excludes>
                                filter>
                            filters>
                        configuration>
                    execution>
                executions>
            plugin>

        plugins>
        <finalName>presto-clickhouse-0.223finalName>
    build>

project>

④:打包上传
将上述修改好的项目打成jar
在presto安装目录的plugin目录下新建clickhouse目录
mkdir /opt/soft/presto-server-0.223/plugin/clickhouse
将打好的jar上传至该目录
然后在catalog下新建clickhouse.properties

vim /opt/soft/presto-server-0.223/etc/catalog/clickhouse.properties


#写入clickhouse的连接信息
connector.name=clickhouse
connection-url=jdbc:clickhouse://ip:8123
connection-user=**
connection-password=**

然后前台启动presto

bin/launcher run 

如果出现server started证明clickhouse Connector注册成功

【注意】 提示：如果启动中出现报错 ERROR main com.facebook.presto.server.PrestoServer No factory for connector clickhouse 那么一定是

②:添加clickhouse Connector 这一步没有做好 META-INF/services
是两层目录，虽然最后显示的是META-INF.services.

下面用客户端测试
java -jar presto-cli-0.224-executable.jar --server localhost:9000 --catalog clickhouse --schema test
执行show tables;

如果出现表则成功,如果bin/launcher run 出现ClassNotFoundException异常则是打包过程有问题,看一下缺少什么包引入依赖重新打包即可