Aurora for MySQL 到 Redis
| 功能 | 说明 |
|---|---|
Full Data Migration | Migrate data by sequentially scanning data in tables and writing it in batches to the target database. The default data format is JSON. |
Incremental Data Sync | Sync of common DML like INSERT, UPDATE, DELETE is supported. |
Data Verification and Correction | Verify all existing data. Optionally, you can correct the inconsistent data based on verification results. Scheduled DataTasks are supported. |
Subscription Modification | Add, delete, or modify the subscribed tables with support for historical data migration. For more information, see Modify Subscription. |
Position Resetting | Reset positions by file position or timestamp. Allow re-consumption of incremental data logs in a past period or since a specific Binlog file and position. |
高级功能
| 功能 | 说明 |
|---|---|
缓存失效时间 | 支持设置数据到 Redis 后缓存失效时间(单位:秒) |
Concatenated Key | Form the target cache key by concatenating source database, table, and primary key value with colons. |
JSON Data Format | Serialize structured source data into JSON format. Allow field name conversion based on the rules, such as keeping the name the same as that in Source, converting the text to lowercase, converting the text to uppercase, or camel case. |
限制和注意点
| 限制项 | 说明 |
|---|---|
MySQL 存储引擎 | 支持 InnoDB, MySIAM, 阿里云 XEngine, 其他存储引擎暂未测试 |
MySQL 字符集 | 支持 utf8, utf8mb4, latin1, 其他编码暂未测试 |
前置条件
| 条件 | 说明 |
|---|---|
账号权限 | |
开启 Binlog | [mysqld] |
任务参数
| 参数名称 | 说明 |
|---|---|
parseBinlogParallel | 增量解析 Binlog 的并发数 |
parseBinlogBufferSize | 用于增量解析 Binlog 的环形队列大小 |
maxTransactionSize | 单事务最大数据条数,超过则分段刷出 |
limitThroughputMb | 限制增量 Binlog 流量 |
extraDDL | 兼容额外的 DDL 同步,包括 PT, GHOST, ALI_DMS, PT_GHOST |
fullDataSqlConditionEnabled | 将过滤条件拼入 SQL 中进行源端数据扫描,此参数只针对全量迁移有效 |
srcTimeZone | 源端时区,例如 +08:00, Asia/Shanghai, America/New_York 等 |
Tips: 通用参数配置请参考 通用参数及功能
任务参数
| 参数名称 | 说明 |
|---|---|
isSentinel | true 代表 Redis Sentinel 集群,false 则代表 单机或分片集群 |
sentinelUser | 连接 Sentinel 的用户名 |
sentinelPassword | 连接 Sentinel 的密码 |
sentinelMasterName | Redis Sentinel 配置中指定的 Master Name |
secondsToExpire | 通过 set 指令写入对端数据的 过期时间,-1 则不做限制 |
Tips: 通用参数配置请参考 通用参数及功能