In Data modeling studio, a data set defines the data to be exported. Use a data set to define the data to be exported by a data model.

On creation of a data set, at least, define:

  • The relevant table.
  • The data selection type.
  • If system fields or date/time fields are added automatically to the data set.


Standard procedure

1. Go to Data modeling studio > Data modeling studio > Data sets.
2. Click New.
3. In the Table name field, enter or select a value.
4. The default description is the description of the table. You can change the description as desired.
  In the Description field, type a value.
5. For grouping purposes, you can assign a free-definable group 'tag' to a data set.
  In the Group field, type a value.
6. Define how the data, as defined by the data set, is exported when using the default group or an export group:
- All data: All records are exported.
- Change tracking: Change tracking is added to the SQL table. Change tracking identifies which records are created, updated, or deleted. Only the created, updated, or deleted records are exported.
- Timestamp: Identifies the records that are created or updated since the latest export date/time. Only the created or updated records are exported.
  In the Data selection field, select an option.
7. You can add the table system fields to the target database. On export, the data of these system fields is also exported.
These system fields are added to the applicable table in the target database:
- RecId
- RecVersion
- CreatedDateTime
- ModifiedDateTime
- CreatedBy
- ModifiedBy
- DataAreaId
- Partition
- ExecutionId (DMS-specific)
- SyncStartDateTime (DMS-specific)
  In the Add system fields field, select the desired option: 'Yes' or 'No'.
 

Note:
If you add system fields to the target database, these fields:
- Are not shown in the fields section of the data set.
- Get a prefix in the target database as defined by the Entity system fields prefix parameter of the Data modeling studio parameters. If no value is defined in this parameter, no prefix is added.

8. You can add the table date/time fields to the target database. On export, the data of these date/time fields is also exported.
Also, to the target database, additional fields are added to store the time zone. On export, time zone calculations are applied to store the right time in the target data base time zone.
  In the Add date and time fields field, select the desired option: 'Yes' or 'No'.
 

Note: If you add date/time fields to the target database, these fields are not shown in the fields section of the data set.

Notes

If you create a data set, the data set identification is composed in this way: [Prefix][Table name][Suffix].

  • Prefix: If on the Date modeling studio parameters, the Entity prefix field is filled, this field value is added as prefix to the data set identification. If no prefix is defined, no prefix is added.
  • Table name: The name of the table that is defined for the data set.
  • Suffix: This fixed suffix is added to each data set identification: DataEntity.

Example: If the entity prefix is 'CDP' and you create a data set for the SalesTable, the data set identification is: CDPSalesTableDataEntity.

Related to Notes

Set up data sets

 

Provide feedback