kafkaserver installation on Red Hat 8.4

 yum install java -y
wget https://ftp.itu.edu.tr/Mirror/Apache/kafka/2.8.0/kafka_2.13-2.8.0.tgz
mv kafka_2.13-2.8.0.tgz /opt/
cd /opt/
tar -zxf kafka_2.13-2.8.0.tgz
ln -s /opt/kafka_2.13-2.8.0 /opt/kafka
useradd kafka
chown -R kafka:kafka /opt/kafka*

Edit: /etc/systemd/system/zookeeper.service
[Unit]
Description=zookeeper
After=syslog.target network.target

[Service]
Type=simple

User=kafka
Group=kafka

ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh

[Install]
WantedBy=multi-user.target

Edit: /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka
Requires=zookeeper.service
After=zookeeper.service

[Service]
Type=simple

User=kafka
Group=kafka

ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh

[Install]
WantedBy=multi-user.target




systemctl start zookeeper
systemctl start kafka

unix domain socket interface for kafka server

Bruce is a producer daemon for Apache Kafka. Bruce simplifies clients that send messages to Kafka, freeing them from the complexity of direct interaction with the Kafka cluster. Specifically, it handles the details of:

• Routing messages to the proper brokers, and spreading the load evenly across multiple partitions for a given topic. Clients may optionally exercise control over partition assignment, such as ensuring that a group of related messages are all routed to the same partition, or even directly choosing a partition if the client knows the cluster topology.
• Waiting for acknowledgements, and resending messages as necessary due to communication failures or Kafka-reported errors
• Buffering messages to handle transient load spikes and Kafka-related problems
• Tracking message discards when serious problems occur; Providing web-based discard reporting and status monitoring interfaces
• Batching and compressing messages in a configurable manner for improved performance
• Optional rate limiting of messages on a per-topic basis. This guards against buggy client code overwhelming the Kafka cluster with too many messages.

command:

bruce --msg_buffer_max 65536 --receive_socket_name /var/run/bruce/bruce.socket --config_path /etc/bruce/bruce_conf.xml --log_echo --log_level LOG_DEBUG