TiDBTiDB Docs Dash 2024

Jan 9 - Jan 12 (UTC)
Join us to improve docs and win a prize!
Sign InTry Free

Filter DMLs Using SQL Expressions

Overview

In the process of incremental data migration, you can filter certain types of binlog events using the Filter Binlog Events feature. For example, for archiving or auditing purposes, you can filter out DELETE events when migrating data to the downstream. However, Binlog Event Filter cannot judge with a greater granularity on whether to filter out a specific row of DELETE events.

To solve the above issue, DM supports filtering data during incremental migration using binlog value filter since v2.0.5. The binlog in the ROW format supported by DM has the values of all columns in binlog events. You can configure SQL expressions according to these values. If the SQL expressions evaluate a row change as TRUE, DM will not migrate the row change downstream.

For detailed operation and implementation, see Filter DML Events Using SQL Expressions.

Was this page helpful?

Download PDFRequest docs changesAsk questions on Discord
Playground
New
One-stop & interactive experience of TiDB's capabilities WITHOUT registration.
Products
TiDB
TiDB Dedicated
TiDB Serverless
Pricing
Get Demo
Get Started
© 2024 PingCAP. All Rights Reserved.
Privacy Policy.