Kafka环境搭建
2022-11-15 本文已影响0人
mfsh
1、下载安装包到software
curl -O https://archive.apache.org/dist/kafka/0.10.0.0/kafka_2.11-0.10.0.0.tgz
2、解压到~/application
tar -zxvf kafka_2.11-0.10.0.0.tgz -C ~/application
3、添加系统环境变量
sudo vim ~/.bash_profile
# Setting Path for Kafka
export KAFKA_HOME=~/application/kafka_2.11-0.10.0.0
export PATH=$PATH:$KAFKA_HOME/bin
source ~/.bash_profile
**
单结点单broker
**
4、配置Kafka
cd ~/application/kafka_2.11-0.10.0.0/conf
#修改server-properties.sh
vim server-properties.sh
host.name=127.0.0.1
log.dirs=~/application/tmp/kafka
zookeeper.connect=127.0.0.1:2181
5、Kafka启动/停止
cd ~/application/kafka_2.11-0.10.0.0/bin
./kafka-server-start.sh -daemon $KAFKA_HOME/config/server.properties
6、创建topic
cd ~/application/kafka_2.11-0.10.0.0/bin
./kafka-topics.sh --create -zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic test_kafka
注意:指定zookeeper
7、查看topic相关命令
cd ~/application/kafka_2.11-0.10.0.0/bin
#查看所有topic
./kafka-topics.sh --list -zookeeper 127.0.0.1:2181
#查看所有topic的详细信息
./kafka-topics.sh --describe -zookeeper 127.0.0.1:2181
#查看指定topic的详细信息
./kafka-topics.sh --describe -zookeeper 127.0.0.1:2181 --topic test_kafka
8、启动topic生产者
cd ~/application/kafka_2.11-0.10.0.0/bin
./kafka-console-producer.sh --broker-list 127.0.0.1:9092 --topic test_kafka
注意:指定broker
9、启动topic消费者
cd ~/application/kafka_2.11-0.10.0.0/bin
#只消费最新接收的消息
./kafka-console-consumer.sh --zookeeper 127.0.0.1:2181 --topic test_kafka
#从头消费
./kafka-console-consumer.sh --zookeeper 127.0.0.1:2181 --topic test_kafka --from-beginning
注意:指定zookeeper