Overview
ELT & CDC uses Oracle LogMiner for change data capture from Oracle databases. Requirements- Oracle Database 11g Release 2 or above.
- The database must be running in ARCHIVELOG mode.
- Supplemental logging must be enabled at the database level.
- Supplemental logging must be enabled for the tables you want to sync.
- A user with privileges to access LogMiner and the source tables.
Supported Features
- Initial full table sync
- Real-time change data capture (INSERT, UPDATE, DELETE)
- Committed transactions only: changes from rolled-back transactions are never replicated
- Resume from last position after restart
Create sync user
Create a sync user for ELT & CDC by executing the following SQL as a DBA user:Grant LogMiner privileges
Specify the schema containing the tables you want to sync and grant the necessary privileges for LogMiner and table access by running the following queries as a DBA user:SELECT ON V_$TRANSACTION is optional. Without it, continuous sync still works, but Integrate.io can miss changes from a transaction that stays open across multiple sync polls.
Enable supplemental logging
Enable supplemental logging to capture change data. Run the following queries as a DBA user:1
Check ARCHIVELOG ModeFirst, verify that the database is running in ARCHIVELOG mode:If not in ARCHIVELOG mode, enable it (requires database restart):
2
Enable Database-Level Supplemental Logging
3
Enable Table-Level Supplemental LoggingEnable supplemental logging for each table you want to sync. You can enable logging for all columns or just primary key columns. ALL-column logging is required for tables that use History Mode (SCD Type 2) and is recommended for every pipeline:
4
Verify Supplemental Logging