kafka idempotent code example

Example: kafka idempotent producer

Sample msg: m=1
Sample msg: m=300000
Sample msg: m=600000
Sample msg: m=900000
Sample msg: m=1200000
Sample msg: m=1500000
Sample msg: m=1800000
Sample msg: m=2100000
Sample msg: m=2400000
Sample msg: m=2700000
Sample msg: m=3000000
Sample msg: m=3300000
Sample msg: m=3510000
Msg: m=3518222 Last-acked=3521706 JUMP BACK 3484 DUPLICATE
Msg: m=3518223 DUPLICATE
Msg: m=3518224 DUPLICATE
Msg: m=3518225 DUPLICATE
Msg: m=3518226 DUPLICATE
Msg: m=3518227 DUPLICATE
Msg: m=3518228 DUPLICATE
Msg: m=3518229 DUPLICATE
Msg: m=3518230 DUPLICATE
Msg: m=3518231 DUPLICATE
Msg: m=3518232 DUPLICATE
Too many duplicates...
Run of duplicates ended with 3484 duplicates and msg: m=3521706
Sample msg: m=3626515
Msg: m=3643252 Last-acked=3646268 JUMP BACK 3016 DUPLICATE
Msg: m=3643253 DUPLICATE
Msg: m=3643254 DUPLICATE
Msg: m=3643255 DUPLICATE
Msg: m=3643256 DUPLICATE
Msg: m=3643257 DUPLICATE
Msg: m=3643258 DUPLICATE
Msg: m=3643259 DUPLICATE
Msg: m=3643260 DUPLICATE
Msg: m=3643261 DUPLICATE
Msg: m=3643262 DUPLICATE
Too many duplicates...
Run of duplicates ended with 3016 duplicates and msg: m=3646268
Sample msg: m=3653498
Sample msg: m=3923498
Sample msg: m=4193498
Sample msg: m=4523498
Sample msg: m=4823498
Sample msg: m=5123498
Sample msg: m=5423498
Sample msg: m=5723498
Sample msg: m=6023498
Sample msg: m=6323498
Sample msg: m=6623498
Sample msg: m=6713498
RESULTS------------------------------------
Confirmed count: 6723843 Received count: 6733622 Unique received: 6727120
Duplication count: 6502
RESULTS END------------------------------------