请教下数据传输DTS订阅数据变更消息,client启动时报这个错误是什么原因?订阅配置检查过都没有问题。2023-12-21 12:10:09.816 INFO 77013 — [kaRecordFetcher] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=consumer-dtspe912tjp198628x-1, groupId=dtspe912tjp198628x] Seeking to offset 9192370 for partition cn_qingdao_vpc_pc_m5e1owklp83iu22c2_dev_version2-0
2023-12-21 12:10:09.817 INFO 77013 — [kaRecordFetcher] c.a.d.s.c.recordfetcher.ConsumerWrap : RecordFetcher consumer: subscribe for [cn_qingdao_vpc_pc_m5e1owklp83iu22c2_dev_version2-0] with checkpoint [Checkpoint[ topicPartition: nulltimestamp: 1703131717, offset: -1, info: ]] first start
2023-12-21 12:10:09.874 INFO 77013 — [RecordGenerator] c.a.d.s.c.r.UserRecordGenerator : UserRecordGenerator: haven’t receive records from generator for 5s
2023-12-21 12:10:09.874 INFO 77013 — [RecordProcessor] c.a.d.s.c.r.EtlRecordProcessor : EtlRecordProcessor: haven’t receive records from generator for 5s
2023-12-21 12:10:09.876 WARN 77013 — [kaRecordFetcher] c.a.d.s.c.r.KafkaRecordFetcher : KafkaRecordFetcher: error meet cause Error reading field ‘session_id’: java.nio.BufferUnderflowException, recover time [1]
org.apache.kafka.common.protocol.types.SchemaException: Error reading field ‘session_id’: java.nio.BufferUnderflowException
at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:110)
at org.apache.kafka.common.protocol.ApiKeys.parseResponse(ApiKeys.java:313)
at org.apache.kafka.clients.NetworkClient.parseStructMaybeUpdateThrottleTimeMetrics(NetworkClient.java:726)
at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:840)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:559)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:262)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:233)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1307)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1243)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1173)
at com.aliyun.dts.subscribe.clients.recordfetcher.ConsumerWrap$DefaultConsumerWrap.poll(ConsumerWrap.java:123)
at com.aliyun.dts.subscribe.clients.recordfetcher.KafkaRecordFetcher.run(KafkaRecordFetcher.java:105)
at java.lang.Thread.run(Thread.java:748)
以下为热心网友提供的参考意见
您好,目前看DTS服务端没有延迟,异常原因在消费client侧,根据您提供的客户端报错信息未定位到原因,建议您通过dts提供的工具包排查下客户端问题,详细参考:https://help.aliyun.com/document_detail/448414.html 或者按该文档操作下 ,此回答整理自钉群“DTS客户交流群-2”