Mapping Activities

Activities

Use the Activities on the right console of the Edit Mapping page to perform a number of activities on your mapping, including:

• Run Map executes the map with any changes that you have made and saved to your mapping.

• Delete Map removes the map from your instance.

You will be asked if you are sure that you want to delete this mapping before it is removed from the system, as shown in the warning image below.

• Import Changes updates the mapping to include changes in the source data elements.

As this may overwrite custom changes that you have made to the mapping, you will be asked if you are sure that you want to import changes before continuing, as shown in the warning image below.

• Source SQL provides a pop-up version of the SQL query editor, described in detail below.

• Target Properties allows you to add more advanced functionality to your mapping, including adding pre and/or post processing scripts that run existing SQL functions and adding advanced target table properties. See Target Properties below for more details.

• Job History shows the Mapping History of past executions in the center console, with quick links to other activities, even a link to come right back to view/edit this mapping.

Source SQL

Users can review the source SQL query that was generated by clicking the Source SQL button. The SQL query editor shows you the query and lets you execute it with the icon, showing the results beneath the SQL statement.

Target Properties

Target Table Scripts

Pre-Delivery Scripts is used to enter SQL statements or scripts that will run on your target before data is delivered to the target table. These must use syntax native to your target.

Post Delivery Scripts is used to enter SQL statements or scripts that will run on your target after the data is delivered to the target table. These must use syntax native to your target .

Target Table Properties

Property Type lets you add properties to your mapping. These properties are specific settings available for your target system.

Property Name lets you select the name of the property to add. Again, these are specific to your target system.

Advanced Target Table Properties: Delimited File

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Delimited File	Target	Date.In.FileName	Date	Date In File Name	Date,Date/Time,None	Appends the date(time) to the end of the file name before the file part and extension
Delimited File	Target	File.Extension	txt	File Extension		Overrides the target file extension specified in the connection.
Delimited File	Target	Rows.Per.File	10000	Max Rows Per File		Sets th e maximum number of rows per file. When set the file part will be placed before the extension in the name.
Delimited File	Target	Sort By Columns

Advanced Target Table Properties: Hive

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Hive	ORC	or c.bloom.filter.columns		ORC Bloom Filter Columns		Comma seperated list of column names for which bloom filter should be created
Hive	ORC	orc.compress	ZLIB	ORC Compression	ZLIB,SNAPPY,NONE	high level compression library to use
Hive	ORC	orc.co mpress.size	262144	ORC Compress Size		number of bytes in each compression chunk
Hive	ORC	orc.create.index	TRUE	ORC Create Index		whether to create row indexes
Hive	ORC	orc.row.index.stride	10000	ORC Row Index Stride		number of rows betw een index entries(must be > 1000)
Hive	ORC	orc.stripe.size	67108864	ORC Stripe Size		number of bytes in each stripe
Hive	Table	auto.purge	FALSE	Auto Purge		Indicates the table should not be moved to trash when truncated or dropped.
Hive	Table	comment		Table Comment
Hive	Table	immutable	FALSE	Immutable
Hive	Target Load	Distribute By Columns		Distribute By Columns		Columns to Distribute the data by when loading the hive table
Hive	Target Load	Sort Columns		Sor t Columns		Columns to sort the data by when loading the hive table.
Hive	Target Table	Hive Target File		Hive Target File		The file format to use for the target Hive table
Hive	Target Table	Partition Columns		Partition Columns		Columns to partition the data by when creating the target Hive table.
Hive	Target Table	Cluster Column		Cluster Column		The column to use in order to cluster the data into buckets.
Hive	Target Table	Number of buckets		Number of buckets		The number of buckets to use when clustering data in a hive table.

Advanced Target Table Properties: MySQL

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
MySql	DDL	Match.Source.Nullability	FALSE	Match Source Nullabil ity		Matches the nullability of the source column when creating the target table.
MySql	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column

Advanced Target Table Properties: O racle

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Oracle	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source column when creating the target table.

Advanced Target Table Properties: PostgreSQL

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
PostgreSQL	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source colu mn when creating the target table.
PostgreSQL	Load	Bulk.Load	FALSE	Bulk Load		Used to enable fast bulk loading (using COPY FROM) to the target.
PostgreSQL	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when in serting to a non-nullable column

Advanced Target Table Properties: Redshift

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Redshift	DDL	DistributionStyle	EVEN	Table Distribution Style	EVEN,KEY,ALL	Def ines the data distribution style for the table. Even-Distributes the data evenly across all nodes. All - creates a copy of the table on all nodes. Key - distributes data across the defined key.
Redshift	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source column when creating the target table.
Redshift	DDL	SortStyle	COMPOUND	Table Sort Style	COMPOUND,INTERLEAVED	You can define a maximum of 400 COMPOUND sort key columns or 8 INTERLEAVED sort key c olumns per table.
Redshift	Ingest	Bulk.Load	FALSE	Bulk Load		Used to enable fast bulk loading to the target. Requires an S3 bucket to be setup on the target connection.
Redshift	Ingest	RowsPerFile	0	Max Rows Per File		Specifies the number o f rows that will be written to each file. A value of 0 indicates there is no limit.
Redshift	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column
Redshift	DDL	Distribution Colum n		Distribution Column		Used when the Distribution Style is set to KEY. Allows the user to choose a column to distribute the data by.
Redshift	DDL	Sort Columns		Sort Columns		Used to allow the user to select the columns used to sort the data wh en storing in redshift.

Advanced Target Table Properties: Snowflake

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
Snowflake	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nu llability of the source column when creating the target table.
Snowflake	Ingest	Format	DELIMITED	Ingest File Format	AVRO,DELIMITED	Specify the file format that is used to deliver data to Snowflake. Options are Delimited and Avro. If your data conta ins carriage returns or line feeds it is recommended to use AVRO
Snowflake	Ingest	RowsPerFile	0	Max Rows Per File		Specifies the number of rows that will be written to each file. A value of 0 indicates there is no limit.
Snowflake	Load	Null.As. Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column

Advanced Target Table Properties: SQL Server

Data Store	Property Type	Property Name	Default Value	Property Label	Valid Values	Description
SQL Server	DDL	Match.Source.Nullability	FALSE	Match Source Nullability		Matches the nullability of the source column when creating the target table.
SQL Server	Load	Bulk.Load	FALSE	Bulk Load		Used to enable fast bulk loading (using BCP) to the target.
SQL Server	Load	Null.As.Empty	FALSE	Null as Empty		Replaces null values with empty strings when inserting to a non-nullable column.