Mapping Activities

Activities

Use the Activities on the right console of the Edit Mapping page to perform a number of activities on your mapping, including:

• Run Map executes the map with any changes that you have made and saved to your mapping.

• Delete Map removes the map from your instance.

You will be asked if you are sure that you want to delete this mapping before it is removed from the system, as shown in the warning image below.

• Import Changes updates the mapping to include changes in the source data elements.

As this may overwrite custom changes that you have made to the mapping, you will be asked if you are sure that you want to import changes before continuing, as shown in the warning image below.

• Source SQL provides a pop-up version of the SQL query editor, described in detail below. Only Available for database files

• File Preview provides a window for viewing a sample set of data for delimited files.

• Source Filters provides a query editor window that can be used to input simple filters as sql like where clause for parquet files. Filters can be saved and will be applied at run time.

• Target Properties allows you to add more advanced functionality to your mapping, including adding pre and/or post processing scripts that run existing SQL functions and adding advanced target table properties. See Target Properties below for more details.

• Job History shows the Mapping History of past executions in the center console, with quick links to other activities, even a link to come right back to view/edit this mapping.

Source SQL

Users can review the source SQL query that was generated by clicking the Source SQL button. The SQL query editor shows you the query and lets you execute it with the icon, showing the results beneath the SQL statement.

Source Filters

Target Properties

Target Table Scripts

Pre-Delivery Scripts is used to enter SQL statements or scripts that will run on your target before data is delivered to the target table. These must use syntax native to your target.

Post Delivery Scripts is used to enter SQL statements or scripts that will run on your target after the data is delivered to the target table. These must use syntax native to your target .

Target Table Properties

Property Type lets you add properties to your mapping. These properties are specific settings available for your target system.

Property Name lets you select the name of the property to add. Again, these are specific to your target system.

Advanced Target Table Properties: Delimited File

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Delimited File	Target	Date.In.FileName	Date	Date In File Name	Date,Date/Time,None	Appends the date(time) to the end of the file name before the file part and extension
Delimited File	Target	File.Extension	txt	File Extension		Overrides the target file extension specified in the connection.
Delimited File	Target	Rows.Per.File	10000	Max Rows Per File		Sets th e maximum number of rows per file. When set the file part will be placed before the extension in the name.
Delimited File	Target	Sort By Columns

Advanced Target Table Properties: MySQL

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
MySql	DDL	Match.Source.Nullability	FALSE	Match Source Nullabil ity		Matches the nullability of the source column when creating the target table.
MySql	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column
MySql	Load	Bypass Work Table on Full Refresh	False

Advanced Target Table Properties: Oracle

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Oracle	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source column when creating the target table.
Oracle	Load	Bypass Work Table on Full Refresh	False

Advanced Target Table Properties: PostgreSQL

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
PostgreSQL	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source colu mn when creating the target table.
PostgreSQL	Load	Bulk.Load	FALSE	Bulk Load		Used to enable fast bulk loading (using COPY FROM) to the target.
PostgreSQL	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when in serting to a non-nullable column
PostgreSQL	Load	Bypass Work Table on Full Refresh	False

Advanced Target Table Properties: Redshift

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Redshift	DDL	DistributionStyle	EVEN	Table Distribution Style	EVEN,KEY,ALL	Def ines the data distribution style for the table. Even-Distributes the data evenly across all nodes. All - creates a copy of the table on all nodes. Key - distributes data across the defined key.
Redshift	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source column when creating the target table.
Redshift	DDL	SortStyle	COMPOUND	Table Sort Style	COMPOUND,INTERLEAVED	You can define a maximum of 400 COMPOUND sort key columns or 8 INTERLEAVED sort key c olumns per table.
Redshift	Ingest	Bulk.Load	FALSE	Bulk Load		Used to enable fast bulk loading to the target. Requires an S3 bucket to be setup on the target connection.
Redshift	Ingest	RowsPerFile	0	Max Rows Per File		Specifies the number o f rows that will be written to each file. A value of 0 indicates there is no limit.
Redshift	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column
Redshift	DDL	Distribution Colum n		Distribution Column		Used when the Distribution Style is set to KEY. Allows the user to choose a column to distribute the data by.
Redshift	DDL	Sort Columns		Sort Columns		Used to allow the user to select the columns used to sort the data wh en storing in redshift.

Advanced Target Table Properties: Snowflake

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Snowflake	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nu llability of the source column when creating the target table.
Snowflake	Ingest	Format	DELIMITED	Ingest File Format	AVRO,DELIMITED	Specify the file format that is used to deliver data to Snowflake. Options are Delimited and Avro. If your data conta ins carriage returns or line feeds it is recommended to use AVRO
Snowflake	Ingest	RowsPerFile	0	Max Rows Per File		Specifies the number of rows that will be written to each file. A value of 0 indicates there is no limit.
Snowflake	Load	Null.As. Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column

Advanced Target Table Properties: SQL Server

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
SQL Server	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source column when creating the target table.
SQL Server	Load	Bulk.Load	FALSE	Bulk Load		Used to enable fast bulk loading (using BCP) to the target.
SQL Server	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column.
SQL Server	Load	Bypass Work Table on Full Refresh	False