OceanBase for Oracle 到 OceanBase
| 功能 | 说明 |
|---|---|
Schema Migration | If the target schema does not exist, BladePipe will automatically generate and execute CREATE statements based on the source metadata and the mapping rule. |
Full Data Migration | Migrate data by sequentially scanning data in tables and writing it in batches to the target database. |
Incremental Data Sync | Sync of common DML like INSERT, UPDATE, DELETE is supported. |
Data Verification and Correction | Verify all existing data. Optionally, you can correct the inconsistent data based on verification results. Scheduled DataTasks are supported. |
Subscription Modification | Add, delete, or modify the subscribed tables with support for historical data migration. For more information, see Modify Subscription. |
Position Resetting | Reset positions by timestamp. Allow re-consumption of incremental data logs in a past period. |
Table Name Mapping | Support the mapping rules, namely, keeping the name the same as that in Source, converting the text to lowercase, converting the text to uppercase, truncating the name by "_digit" suffix. |
DDL Sync |
|
Metadata Retrieval | Retrieve the target metadata with filtering conditions set from the source table. |
高级功能
| 功能 | 说明 |
|---|---|
基于 CDC 模式的增量同步 | 支持基于 OceanBase LogProxy 进行增量数据同步 |
全量前清空目标数据 | 运行全量任务前清除老数据,包括重跑任务、定时全量迁移都会触发此能力 |
重建目标表 | 运行全量任务前重建目标表,包括重跑任务、定时全量迁移都会触发此能力 |
高并发行级写入 | 适配分布式数据库特征,默认采用高并发行级写入策略 (ROW) |
增量写入冲突策略 | IGNORE: 遇到主键冲突则忽略(不做写入),REPLACE: 遇到主键冲突则整行替换 |
Custom Code | For more information, see Custom Code Processing, Debug Custom Code and Logging in Custom Code. |
Data Filtering Conditions | Support data filtering using WHERE conditions, with SQL-92 as the SQL language. For more information, see Data Filtering. |
前置条件
| 条件 | 说明 |
|---|---|
账号权限 | 具备 SYS 租户下所有表权限, 迁移同步库表 SELECT 权限 |
网络准备 | 迁移同步节点(sidecar)可连接 OceanBase server 交互端口(如 2881),LogProxy 交互端口(如有,如 2983) |
任务参数
| 参数名称 | 说明 |
|---|---|
needJsonEscape | 将 json 中特殊字符进行转义,以写入到对端 |
fullDataSqlConditionEnabled | 将过滤条件拼入 SQL 中进行源端数据扫描,此参数只针对全量迁移有效 |
eventStoreSize | 缓存解析完毕的增量事件缓存大小 |
clusterUrl | OceanBase 集群地址服务(类 name server) |
obLogProxyHost | LogProxy 服务地址,常见格式为 ip:2983,LogProxy 增量模式必填项 |
rpcPortList | OceanBase server 节点 RPC 端口,如 host 参数为 ip1;ip2, 则此参数对应为 port1;port2, 常见端口 2882 ,LogProxy 增量模式必填项 |
syncAccount | LogProxy 连接 OceanBase server 的账号(可选) |
syncPwd | LogProxy 连接 OceanBase server 的密码(可选) |
tenant | 需要订阅表所在的 tenant |
clusterName | OceanBase 集群名称 |
workingMode | LogProxy 依赖的 libobcdc 参数,默认值为 storage |
Tips: 通用参数配置请参考 通用参数及功能
前置条件
| 条件 | 说明 |
|---|---|
账号权限 | 具备 SELECT, INSERT, DELETE, UPDATE, 常见 DDL 权限 |
网络准备 | 迁移同步节点(sidecar)可连接 OceanBase 标准交互接口(如 3306) |
任务参数
| 参数名称 | 说明 |
|---|---|
keyConflictStrategy | 增量写入遇到主键冲突策略:
|
writeStrategy | 对端写入策略,包含
|
Tips: 通用参数配置请参考 通用参数及功能