You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I saw events lying in my kinesis consumer which were never getting consumed since multiple days and they would be lost after retention time so I decided to change consumer property for shardIteratorType from default LATEST to TRIM_HORIZON. But my idle events present in queue are still not consumed, but new events are getting consumed properly.
The [ShardConsumer{shardOffset=KinesisShardOffset{iteratorType=TRIM_HORIZON, sequenceNumber='null', timestamp=null, stream='message_queue', shard='shardId-000000000000', reset=false}, state=NEW}]
has been started.
Got an exception java.lang.NullPointerException during
[ShardConsumer{shardOffset=KinesisShardOffset{iteratorType=TRIM_HORIZON, sequenceNumber='null', timestamp=null, stream='message_queue', shard='shardId-000000000000', reset=false}, state=CONSUME}] task invocation.
Process will be retried on the next iteration.
Here are some more details :
Java 8, normal kinesis consumer and not fan out.
I saw events lying in my kinesis consumer which were never getting consumed since multiple days and they would be lost after retention time so I decided to change consumer property for shardIteratorType from default LATEST to TRIM_HORIZON. But my idle events present in queue are still not consumed, but new events are getting consumed properly.
kinesis.bindings.consumeMessage-in-0.consumer.checkpointMode=manual,
kinesis.bindings.consumeMessage-in-0.consumer.listenerMode=batch,
kinesis.bindings.consumeMessage-in-0.consumer.shardIteratorType=TRIM_HORIZON,
kinesis.binder.kplKclEnabled=true
I got following in the logs :
The [ShardConsumer{shardOffset=KinesisShardOffset{iteratorType=TRIM_HORIZON, sequenceNumber='null', timestamp=null, stream='message_queue', shard='shardId-000000000000', reset=false}, state=NEW}]
has been started.
Got an exception java.lang.NullPointerException during
[ShardConsumer{shardOffset=KinesisShardOffset{iteratorType=TRIM_HORIZON, sequenceNumber='null', timestamp=null, stream='message_queue', shard='shardId-000000000000', reset=false}, state=CONSUME}] task invocation.
Process will be retried on the next iteration.
Here are some more details :
Java 8, normal kinesis consumer and not fan out.
dependencies :
'org.springframework.boot:spring-boot-starter-web'
'org.springframework.boot:spring-boot-starter-actuator'
'io.micrometer:micrometer-registry-influx'
'org.springframework.cloud:spring-cloud-stream-binder-kinesis:2.2.0'
'com.amazonaws:aws-java-sdk-kinesis:1.12.376'
'com.amazonaws:amazon-kinesis-client:1.14.9'
The text was updated successfully, but these errors were encountered: