admin管理员组文章数量:1386678
I have a Kafka DLQ (dead-letter queue) topic where I'm sending the failed records, but I don't want to keep reprocessing them until a patch is deployed. Thus, the idea would be to have the consumer stopped until the fix is applied.
The Spring Kafka gives has the KafkaListenerEndpointRegistry
, which allows managing the pause/resume of the Kafka consumer, and from the small local tests I have done, it seems to be working. However, I feel that pausing a Kafka Consumer is not a good practice, and I wonder if this could be done with a different approach.
Another possible approach could be having the DLQ messages constantly being retried (which would keep failing until the fix is applied), but I believe that it would only put a load on the cluster and wouldn't bring any benefit.
Has anyone had experience with a similar situation, and how have you dealt with it? Does pausing a consumer is/isn't a good practice? Any suggestions for this problem are welcome.
本文标签: springPause Kafka Consumer on DLQ topic at reprocessStack Overflow
版权声明:本文标题:spring - Pause Kafka Consumer on DLQ topic at reprocess - Stack Overflow 内容由网友自发贡献,该文观点仅代表作者本人, 转载请联系作者并注明出处:http://www.betaflare.com/web/1744507044a2609651.html, 本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容,一经查实,本站将立刻删除。
发表评论