java - Spring integration Kafka and managing offsets -
java - Spring integration Kafka and managing offsets -
i'm using spring integration kafka extension read , process messages kafka in java application. know uses high-level consumer api doesn't allow manage offsets in zookeeper.
in case have auto.commit.enable=false in order commit offset zookeeper after message processed. if processing fails offset won't committed , should seek process same message 1 time again in configured time starting offset zookeeper. doesn't work because, assume, apache kafka client keeps offset in memory.
i've found out kafka.consumer.consumeriterator handles offsets , if consumedoffset in greater in zookeeper read message using consumed one.
so, i'm wondering there ways reset offset in kafka client start reading offset in zookeeper?
wouldn't mind share <int-kafka>
config , point out have issue?
maybe plenty messageleftovertracker.clearmessagesleftover()
?
i'm not kafka, know spring integration does.
java spring spring-integration apache-kafka
Comments
Post a Comment