How to view kafka message

Question

Is there any way I can view the message content sent to kafka for a given topic  Say some thing like view last 5 messages for this topic  if that it possible

User · Answer

Old version includes kafka-simple-consumer-shell sh  https   kafka apache org downloads 1 1 1  which is convenient since we do not need cltr c to exit    For example  kafka-simple-consumer-shell sh --broker-list  BROKERIP  BROKERPORT --topic  TOPIC1 --property print key true --property key separator      --no-wait-at-logend

User · Answer

You can try Kafka Magic - it s free and you can write complex queries in JavaScript referencing message properties and metadata  Works with Avro serialization too

User · Answer

If you re wondering why the original answer is not working  Well it might be that you re not in the home directory  Try this    KAFKA HOME bin kafka-console-consumer sh --bootstrap-server localhost 9092 --topic test --from-beginning

User · Answer

You can use console consumer to view messages produced on some topic   bin kafka-console-consumer sh --bootstrap-server localhost 9092 --topic test --from-beginning

User · Answer

On server where your admin run kafka find kafka-console-consumer sh by command find   -name kafka-console-consumer sh then go to that directory and run for read message from your topic     kafka-console-consumer sh --bootstrap-server localhost 9092 --topic test --from-beginning --max-messages 10  note that in topic may be many messages in that case I use --max-messages key

User · Answer

I work for a company with hundreds of developers who obviously need to check Kafka messages on a regular basis  Employees come and go and therefore we want to avoid the setup  dedicated SASL credentials  certificates  ACLs       for each new employee  Our platform teams operate a deployment of Kowl  https   github com cloudhut kowl  so that everyone can access it without going through the usual setup  We also use it when developing locally using a docker-compose file

User · Answer

Use the Kafka consumer provided by Kafka    bin kafka-console-consumer sh --bootstrap-server BROKERS --topic TOPIC NAME   It will display the messages as it will receive it  Add --from-beginning if you want to start from the beginning

User · Answer

If you doing from windows folder  I mean if you are using the kafka from windows machine  kafka-console-consumer bat --bootstrap-server localhost 9092 -- lt topic-name gt  test --from-beginning

[apache-kafka] How to view kafka message

Examples related to apache-kafka