DeletionDetectionParams Interface
paramaters to control how deletions are detected. These parameters exist due to evolution in the detection of deletions. For legacy reasons, The default is channel based (that is by job subject) (e.g. fileBased = false), but, for new connectors or for connectors that support multiple files for a given channel and it is necessary to narrow the scope from the entire channel (i.e. everything under the job subject) then file based detection is strongly recommended. The second parameter scopeToPartition is ignored for channel based detection and it it is recommended to be passed as false for file based deletion detection. IMPORTANT: scopeToPartion must be passed as true for legacy connectors that created external source aspects scope to the physical partition for example. The test connector in this repository incorrectly set the external source aspects this way and it is likely other connectors followed this example.
Properties
| Name | Type | Description | |
|---|---|---|---|
| fileBased | boolean | true for file based (recommended for new connectors) | |
| scopeToPartition | boolean | false is recommended, but, true is required for legacy connectors that create |
Defined in
- Synchronizer.ts Line 192
Last Updated: 21 March, 2024