SQL Server 到 Tunnel
| 功能 | 说明 |
|---|---|
Schema Migration | If the target schema does not exist, BladePipe will automatically generate and execute CREATE statements based on the source metadata and the mapping rule. |
Full Data Migration | Migrate data by sequentially scanning data in tables and writing it in batches to the target database. |
Incremental Data Sync | Sync of common DML like INSERT, UPDATE, DELETE is supported. |
Table Name Mapping | Support the mapping rules, namely, keeping the name the same as that in Source, converting the text to lowercase, converting the text to uppercase, truncating the name by "_digit" suffix. |
DDL Sync | Supports ALTER TABLE ADD COLUMN and DROP COLUMN. |
高级功能
| 功能 | 说明 |
|---|---|
Custom Code | For more information, see Custom Code Processing, Debug Custom Code and Logging in Custom Code. |
Data Filtering Conditions | Support data filtering using WHERE conditions, with SQL-92 as the SQL language. For more information, see Data Filtering. |
Setting Target Primary Key | Change the primary key to another field to facilitate data aggregation and other operations. |
任务参数
| 参数名称 | 说明 |
|---|---|
maxTxsPerIteration | SQL Server 增量源端 CDC 每次最大扫描事务数 |
scanParallel | 全量阶段:并发扫描表数量 |
eventStoreSize | 缓存解析完毕的增量事件缓存大小 |
Tips: 通用参数配置请参考 通用参数及功能
任务参数
| 参数名称 | 说明 |
|---|---|
writeParallel | 对端写入并发数,对迁移或者同步性能影响大 |
batchWriteSize | 消息内最大记录条数 |
deCycle | 是否开启防循环逻辑 |
deCycleFlag | 默认防循环标记 |
protocol | Tunnel 传输数据使用的交互协议,目前支持 HTTP |
uriPrefix | Tunnel 数据源 uri 前缀 |
contentCompressType | Tunnel 数据源的数据压缩类型,目前支持 DeInflater / GZIP |
dbs | 数据源结构定义 |
printDataInLog | 是否将关键数据打印到日志以方便排查问题,此选项打开可能影响性能和数据安全 |
schemaFormat | Value Schema 类型 |
printCustomCodeDebugLog | 打印自定义代码DEBUG日志(会打印处理前后数据,同步量大会增加磁盘使用和影响同步性能,请知悉),该参数动态生效,不需要重启任务 |
Tips: 通用参数配置请参考 通用参数及功能