Full Sync will replicate all the available data from a table every time a pipeline runs. Incremental Sync will first replicate all the existing data from a table on the first pipeline run, for subsequent pipeline runs, the pipeline will keep a bookmark of the latest record by one of the following fields: SystemModstamp, LastModifiedDate, CreatedDate, LoginTime, and fetch data.
* BULK/REST API Sync:
- Default behavior: All available data, including deleted records, will be synced. Deletions are handled as soft deletes. A specific column will indicate if a row was deleted on the source.
- Custom Configuration: If you prefer to exclude deleted records from syncing, please contact support to adjust this setting.
- Soft-Deletes vs Hard-Deletes on Source:
- Soft Deletes: Will be replicated as Soft Deletes on destination, with the IsDeleted column being changed.
- Hard Deletes: Not supported by the REST/BULK connector. This operation will not be replicated on the destination.
* Streaming API Sync:
- Delete handling: On initial sync, deleted records will be replicated, however, in continuous sync, deletes will result in a hard delete at the destination. The entire row will be erased, ensuring the destination matches the source.
- Soft-Deletes vs Hard-Deletes on Source:
- Soft Deletes: Will be replicated as Hard Deletes on destination, with the entire row being deleted on the destination.
- Hard Deletes: Will be replicated as Hard Deletes on destination, with the entire row being deleted on the destination.