-
Notifications
You must be signed in to change notification settings - Fork 120
Description
使用的rocketmq版本:4.9.4
github下载的最新rocketmq connect。
按照这个文档安装完出现问题。
MySQL Source(CDC) - >RocketMQ Connect:https://rocketmq.apache.org/zh/docs/4.x/connect/04RocketMQ%20Connect%20In%20Action1/
配置和日志如下:
curl -X POST -H "Content-Type: application/json" http://127.0.0.1:8082/connectors/MySQLCDCSourceTestTable -d '{
"connector.class": "org.apache.rocketmq.connect.debezium.mysql.DebeziumMysqlConnector",
"max.task": "1",
"connect.topicname": "debezium-mysql-source-topic",
"kafka.transforms": "Unwrap",
"kafka.transforms.Unwrap.delete.handling.mode": "none",
"kafka.transforms.Unwrap.type": "io.debezium.transforms.ExtractNewRecordState",
"kafka.transforms.Unwrap.add.headers": "op,source.db,source.table",
"database.history.skip.unparseable.ddl": true,
"database.history.name.srv.addr": "localhost:9876",
"database.history.rocketmq.topic": "db-history-debezium-topic",
"database.history.store.only.captured.tables.ddl": true,
"include.schema.changes": false,
"database.server.name": "ecs-1",
"database.port": 3306,
"database.hostname": "",
"database.connectionTimezone": "Asia/Shanghai",
"database.user": "**",
"database.password": "",
"table.include.list": "data.test_table",
"max.batch.size": 50,
"database.include.list": "data",
"snapshot.mode": "never",
"database.server.id": "189054",
"key.converter": "org.apache.rocketmq.connect.runtime.converter.record.json.JsonConverter",
"value.converter": "org.apache.rocketmq.connect.runtime.converter.record.json.JsonConverter"
}'
connect_default.log:
"""
2025-03-17 10:37:53 WARN task-thread-MySQLCDCSourceTest-0 - Unable to register the MBean 'debezium.mysql:type=connector-metrics,context=schema-history,server=ecs_2': debezium.mysql:type=connector-metrics,context=schema-history,server=ecs_2
2025-03-17 10:37:53 WARN debezium-mysqlconnector-ecs_2-change-event-source-coordinator - After applying the include/exclude list filters, no changes will be captured. Please check your configuration!
"""
connect_runtime.log:
"""
2025-03-17 10:37:53 WARN StateMachineService - no transforms config, {"epoch":1742176661696,"properties":{"connector.class":"org.apache.rocketmq.connect.debezium.mysql.DebeziumMysqlConnector","kafka.transforms.Unwrap.type":"io.debezium.transforms.ExtractNewRecordState","include.schema.changes":"false","kafka.transforms.Unwrap.add.headers":"op,source.db,source.table","connect.topicname":"debezium-mysql-source-topic","database.history.skip.unparseable.ddl":"true","database.history.store.only.captured.tables.ddl":"true","value.converter":"org.apache.rocketmq.connect.runtime.converter.record.json.JsonConverter","key.converter":"org.apache.rocketmq.connect.runtime.converter.record.json.JsonConverter","database.connectionTimezone":"Asia/Shanghai","database.user":"repl","kafka.transforms.Unwrap.delete.handling.mode":"none","database.server.id":"186054","database.server.name":"ecs_2","database.port":"3306","max.task":"1","database.history.rocketmq.topic":"db-history-debezium-topic","ordering.msg.enable":"false","task.class":"org.apache.rocketmq.connect.debezium.mysql.DebeziumMysqlSource","database.history.name.srv.addr":"localhost:9876","database.hostname":"","database.password":"","task.id":"0","table.include.list":"data.test_table","max.batch.size":"50","kafka.transforms":"Unwrap","database.include.list":"data","snapshot.mode":"never","database.history":"org.apache.rocketmq.connect.debezium.RocketMqDatabaseHistory"}}
2025-03-17 10:37:53 INFO StateMachineService - [RACE CONDITION] we checked the pending tasks before state turns to PENDING
2025-03-17 10:37:53 ERROR StateMachineService - [BUG] future is null or Stopped task should have its Future.isDone() true, but false
2025-03-17 10:37:53 INFO task-thread-MySQLCDCSourceTest-0 - org.apache.rocketmq.connect.runtime.connectorwrapper.WorkerSourceTask@399c0bc5 Source task finished initialization and start
2025-03-17 10:37:53 INFO task-thread-MySQLCDCSourceTestTable-0 - org.apache.rocketmq.connect.runtime.connectorwrapper.WorkerSourceTask@70d775d3 Source task finished initialization and start
2025-03-17 10:37:56 WARN StateMachineService - Task MySQLCDCSourceTestTable-0, Old task status is AbstractStatus{id=MySQLCDCSourceTestTable-0, state=UNASSIGNED, workerId='standalone-worker', generation=1742179074162, trace='null'}, new task status AbstractStatus{id=MySQLCDCSourceTestTable-0, state=RUNNING, workerId='standalone-worker', generation=1742179076162, trace='null'}
"""