CDH环境下kylin的安装教程

 

1.软件版本介绍:  

cdh5.10.1

Kylin: 2.1.0

 

2.环境检查

   环境中需要启动的角色:

 

Hive Metastore Server

yarn的JobHistory Server

3.正式安装

3.1 kylin2.1.0下载软件

http://mirrors.hust.edu.cn/apache/kylin/apache-kylin-2.1.0/apache-kylin-2.1.0-bin-cdh57.tar.gz

 

3.2 正式安装

   1.移动软件包到/usr/local/apps目录下

mkdir /usr/local/apps

cd /usr/local/apps

mv  ~/apache-kylin-2.1.0-bin-cdh57.tar.gz ./

   2.解压

[[email protected] apps]# tar -zxvf apache-kylin-2.1.0-bin-cdh57.tar.gz

   

   3.建立软连接

     [[email protected] apps]# ln -s apache-kylin-2.1.0-bin-cdh57 kylin

   4.添加环境变量到当前用户的bashrc下:  命令:  vi  ~/.bashrc

 

export BASE_PATH=/opt/cloudera/parcels/CDH/lib

#added by hbase

      export HBASE_HOME=$BASE_PATH/hbase

export PATH=$HBASE_HOME/bin:$PATH

 

#added by HCat

export HCAT_HOME=$BASE_PATH/hive-hcatalog

 

#added by kylin

export KYLIN_HOME=/usr/local/apps/kylin

 

#added by java

export JAVA_HOME=/usr/java/latest

 

5.生效环境配置

[[email protected] latest]# source ~/.bashrc

 

6.修改kylin.properties配置文件

[[email protected] conf]# pwd

/usr/local/apps/kylin/conf

[[email protected] conf]# vi kylin.properties

#修改

kylin.server.cluster-servers=192.168.1.201:7070

#添加配置

kylin.job.jar=/usr/local/apps/kylin/lib/kylin-job-2.1.0.jar

kylin.coprocessor.local.jar=/usr/local/apps/kylin/lib/kylin-coprocessor-2.1.0.jar

kylin.job.yarn.app.rest.check.status.url=http://192.168.1.202:8088/ws/v1/cluster/apps/${job_id}?anonymous=true

 

7.检查

       [[email protected] bin]# cd /usr/local/apps/kylin/bin

执行下面检查命令  会创建kylin目录在hdfs上

       [[email protected] bin]# ./check-env.sh

Retrieving hadoop conf dir...

KYLIN_HOME is set to /usr/local/apps/kylin

[[email protected] bin]# hadoop fs -ls /

Found 8 items

drwxr-xr-x   - hdfs  supergroup          0 2017-06-02 17:55 /CONFIG

drwxr-xr-x   - hbase hbase               0 2017-08-31 19:11 /hbase

drwxr-xr-x   - root  supergroup          0 2017-09-01 10:23 /kylin

 

 

 

[[email protected] bin]# ./find-hbase-dependency.sh

Retrieving hbase dependency...

[[email protected] bin]# ./find-hive-dependency.sh

Retrieving hive dependency...

 

8.启动kylin

  [[email protected] kylin]# bin/kylin.sh  start

  查看kylinUI日志  

[[email protected] kylin]# tailf logs/kylin.out

  

INFO: Starting ProtocolHandler ["http-bio-7070"] Sep 01, 2017 10:35:28 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["ajp-bio-9009"] Sep 01, 2017 10:35:28 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 22057 ms

  启动完成

 

  查看kylin server日志

[[email protected] kylin]# tailf logs/kylin.log

无报错,启动完成

 

9.登陆kylin

      http://<ip>:7070/kylin

      User: ADMIN

      Pass: KYLIN

登陆完成

4.导入官方测试数据进行测试

4.1导入数据

查看Hive default库中的表

hive> show tables; OK t1 Time taken: 0.034 seconds, Fetched: 1 row(s) hive>

 

执行命令

/usr/local/apps/kylin/bin

[[email protected] bin]# ./sample.sh

日志倒数两行

Sample cube is created successfully in project 'learn_kylin'. Restart Kylin Server or click Web UI => System Tab => Reload Metadata to take effect #这句话的意思是  例子cube已成成功创建在了  工程名称叫'learn_kylin'里面了 #重启kylin或者通过webUI => System选项卡=> 重新导入元数据信息

 

查看Hive default库中的表,多了五张表

hive> show tables; OK kylin_account kylin_cal_dt kylin_category_groupings kylin_country kylin_sales t1 Time taken: 0.015 seconds, Fetched: 6 row(s) hive>

重新加载元数据操作图

共3步

步骤1

步骤2

步骤3

4.2查看导入模型

查看导入的信息  => 点击最上面选项卡  Model

4.3 开始cube的构建

1.点击Cube的Actions现象---->再点击Build

2.选择数据分区范围

3.查看正在构建的cube任务,点击monitor

4.坐等构建完成吧

5.好了,终于完成了

4.4 查询构建完成的cube信息

结果数据