BladePipe 1.9.0: New data pipelines, faster Oracle writes, and improved stability.
跳到主要内容

OceanBase for Oracle 到 OceanBase

选择对端数据库:

数据链路

基本功能

功能说明
Schema Migration

If the target schema does not exist, BladePipe will automatically generate and execute CREATE statements based on the source metadata and the mapping rule.

Full Data Migration

Migrate data by sequentially scanning data in tables and writing it in batches to the target database.

Incremental Data Sync

Sync of common DML like INSERT, UPDATE, DELETE is supported.
UPDATE and DELETE for tables without primary keys are not synced by default (manual selection required).

Data Verification and Correction

Verify all existing data. Optionally, you can correct the inconsistent data based on verification results. Scheduled DataTasks are supported.
For more information, see Create Verification and Correction DataJob.

Subscription Modification

Add, delete, or modify the subscribed tables with support for historical data migration. For more information, see Modify Subscription.

Position Resetting

Reset positions by timestamp. Allow re-consumption of incremental data logs in a past period.

Table Name Mapping

Support the mapping rules, namely, keeping the name the same as that in Source, converting the text to lowercase, converting the text to uppercase, truncating the name by "_digit" suffix.

DDL Sync
  • ALTER TABLE ADD , MODIFY , DROP COLUMN
  • TRUNCATE TABLE
  • ALTER TABLE RENAME TO
  • CREATE TABLE (Whole database sync)
  • DROP TABLE (Whole database sync)
Metadata Retrieval

Retrieve the target metadata with filtering conditions set from the source table.

高级功能

功能说明
基于 CDC 模式的增量同步

支持基于 OceanBase LogProxy 进行增量数据同步

全量前清空目标数据

运行全量任务前清除老数据,包括重跑任务、定时全量迁移都会触发此能力

重建目标表

运行全量任务前重建目标表,包括重跑任务、定时全量迁移都会触发此能力

高并发行级写入

适配分布式数据库特征,默认采用高并发行级写入策略 (ROW)

增量写入冲突策略

IGNORE: 遇到主键冲突则忽略(不做写入),REPLACE: 遇到主键冲突则整行替换

Custom Code

For more information, see Custom Code Processing, Debug Custom Code and Logging in Custom Code.

Data Filtering Conditions

Support data filtering using WHERE conditions, with SQL-92 as the SQL language. For more information, see Data Filtering.

限制和注意点

限制项说明
OceanBase 版本

当前仅支持 OceanBase for MySQL 版本

OceanBase 数据类型

不支持地理位置类型

使用示例

标题详情
主流 RDB 到 OceanBase 迁移同步

文档:RDB 到 OceanBase 迁移同步


源端数据源

前置条件

条件说明
账号权限

具备 SYS 租户下所有表权限, 迁移同步库表 SELECT 权限

网络准备

迁移同步节点(sidecar)可连接 OceanBase server 交互端口(如 2881),LogProxy 交互端口(如有,如 2983)

任务参数

参数名称说明
needJsonEscape

将 json 中特殊字符进行转义,以写入到对端

fullDataSqlConditionEnabled

将过滤条件拼入 SQL 中进行源端数据扫描,此参数只针对全量迁移有效

eventStoreSize

缓存解析完毕的增量事件缓存大小

clusterUrl

OceanBase 集群地址服务(类 name server)

obLogProxyHost

LogProxy 服务地址,常见格式为 ip:2983,LogProxy 增量模式必填项

rpcPortList

OceanBase server 节点 RPC 端口,如 host 参数为 ip1;ip2, 则此参数对应为 port1;port2, 常见端口 2882 ,LogProxy 增量模式必填项

syncAccount

LogProxy 连接 OceanBase server 的账号(可选)

syncPwd

LogProxy 连接 OceanBase server 的密码(可选)

tenant

需要订阅表所在的 tenant

clusterName

OceanBase 集群名称

workingMode

LogProxy 依赖的 libobcdc 参数,默认值为 storage

Tips: 通用参数配置请参考 通用参数及功能


目标端数据源

前置条件

条件说明
账号权限

具备 SELECT, INSERT, DELETE, UPDATE, 常见 DDL 权限

网络准备

迁移同步节点(sidecar)可连接 OceanBase 标准交互接口(如 3306)

任务参数

参数名称说明
keyConflictStrategy

增量写入遇到主键冲突策略:

  • IGNORE 冲突忽略(默认)
  • REPLACE 冲突替换(可选)

writeStrategy

对端写入策略,包含

  • ROW (单条,默认选项)
  • MULTI_SQL (多语句)
  • BATCH (批量)

Tips: 通用参数配置请参考 通用参数及功能