For messages and web service actions, you can use table events to track data changes. You can define, for each table, which table events are logged. The table events are logged in the Data synchronization log.To fully process the logged events, process the:
This topic explains how to process the data synchronization log.
This table gives examples of the results for several data synchronization log processing scenarios:
Number of pages | Page size | Limit records | Number of records to be processed | Result |
---|---|---|---|---|
5 | 10,000 | No | 40,000 | 4 pages of 10.000 records are processed |
5 | 10,000 | Yes | 40,000 | 4 pages of 10.000 records are processed |
5 | 10,000 | No | 80,000 | 5 pages of 16.000 records are processed |
5 | 10,000 | Yes | 80,000 | 5 pages of 10.000 records are processed |
1. | Click Connectivity studio Integration operations. |
2. | Click Process data synchronization log. |
3. | To improve the performance when processing a lot of logged events, you can use paging. For paging, the logged events are split over several pages that are run in parallel batch tasks. It can be that you can run only a limited number of batch jobs in parallel or that you want to use a limited number of batch jobs. If so, define the maximum allowed number of pages. |
  | In the Number of pages field, enter a number. |
  |
Note: If the number of records to be processed is less than the the defined 'Number of pages' x 'Page size', less than the defined number of pages are processed. |
4. | You can split the records to be processed over several pages (batch tasks). Define the number of events to be processed by one batch task (page). |
  | In the Page size field, enter a number. |
  |
Note: If the number of records to be processed exceeds the defined 'Number of pages' x 'Page size', and 'Limit records' is set to:
|
5. | You can limit the number of records that is processed at once. This is only applied when the number of records to be processed exceeds the defined 'Number of pages' x 'Page size'. If Yes, the maximum number of records that is processed is the defined 'Number of pages' x 'Page size'. So, the number of records per page does not exceed the page size. |
  | Select Yes in the Limit records field. |
6. | Usually, all records in the data synchronization log are processed. However, you can also process a number of oldest records only. For example, if you fill in '100', only the 100 oldest records are processed. This can be helpful to investigate if issues occur when processing older records. |
  | In the Oldest set of field, enter a number. |
  |
Note: If you enter a number in the 'Oldest set of' field, these fields are not considered:
|
7. | Sub-task: Set up batch processing. |
7.1 | Usually, you process the data synchronization log in batch in a recurring pattern. |
  | Expand the Run in the background section. |
7.2 | Select Yes in the Batch processing field and fill in the other fields as desired. |
7.3 | Set up the recurrence for the data synchronization log processing. |
  | Click Recurrence and fill in the fields as desired. |
7.4 | Click OK. |
8. | Click OK. |
You can also process specific data synchronization log records. To do so:
Related to | Notes |
---|---|
Monitor outbound queue |
  |
Monitor outbound queue |
  |
Process data synchronization log process |
  |
Set up data synchronization for message |
  |
Set up data synchronization for message |
  |
Monitor outbound queue |
  |
Process data synchronization log process |
  |
Run integration |
  |
Run outbound web service |
  |