Data Feeds are a powerful tool to sync your data from external sources into your Mapp Engage system. This article explains step by step, how to set up Data Feeds in Mapp Engage.
In order to set up Data Feeds, you need to configure your FTP connections (including path and regex) in the Credential Store.
Common Use Cases
- Add contacts to Mapp Engage
- Update contact attributes in Mapp Engage
- Remove users from Mapp Engage
- Send an email (prepared message) with parameters to contacts
- Add data to your custom Related Data tables where their email is the key attribute
- Add multiple location data to your locations database
- Add data to predefined Related Data: Transactions, Wish List and Abandoned Cart
A) Create a generic integration via Mapp Connect
Data feeds are set up the same way as a generic integration in Mapp Connect.
- Go to Data Management > Mapp Connect.
- Click Add New Integration.
- Select an integration type from the drop-down list. If you are integrating your own plugin, use the type Generic.
- Enter a name of the connection and click Create.
- The Add-On settings tab opens to the Overview tab. You can still change the name of the integration here, and add a description.
- (optional) Check the box if you want a Whiteboard to be triggered when user mapping attributes change.
- Copy the secret key and save if for future reference. You will need it to authenticate the connection between Mapp Engage and your plugin.
- Click Save.
B) Set up import job
With one job you can import a few files that fit the regex expression and are of the same data type (e.g. user, transaction, email, abandoned cart, wish list, location).
- Go to the Data Import tab and click Add New Import.
- The Import Configuration tab opens. Here you can define all the details of the import job:
- Add job name.
Enter the name here. The name has to be unique.
- Runs every.
Here you can specify a detailed schedule of your job.
Set job status.
Select Enabled or Disabled here.
Only set the job status to Enabled when all columns for incoming data are mapped.
- Add job name.
C) Define import steps
- Import from FTP/SFTP.
Select the connection from the drop-down list click Test Connection. You will receive an alert if the connection test fails.
- (optional) Unzip file. To remove this step from the import workflow, click the minus sign
Supported formats: .zip, .tar, .gz, .tar and .gz
If the zip file is protected by a password, you can enter it here. This option is only available for the .zip format. .
(optional) Change encoding and/or delimiter. To remove this step from the import workflow, click the minus sign.
Note that if you import multiple files, encoding and delimiter must be the same for all the files.
- Upload to S3. This is when the data is uploaded to Mapp's S3 server. This step cannot be configured.
- Create event. This step allows you to define what happens with the data upon import.
Click on Edit Mapping and adjust it as needed.Edit Mapping
- Go to the mapping you want to edit and click Edit.
- Edit the name in the pop-up window that appears. The description is optional.
- To configure the mapping, click Edit Field Mapping.
- Click the plus sign.
- The Edit Mapping Information window opens. Here you must define the details of the mapping.
- Add source(s) lets you specify one or more data sources. For example: email, phone number, etc.
- Source Transformation lets you define whether any data should be changed during import. Read more about data transformations here.
- Choose Mapping subtype lets you chose from four options: User, Email, SMS and Push.
Destination attribute lets you specify where the imported data will be mapped.
Mapping sources and destinations are case sensitive!
- (optional) Add monitoring users. Here you can add the email addresses of people who should be receiving error logs from the system.
- Click Save.
D) View imports & monitor import progress
You can see all the created imports on the Data Import tab.
Click on the Running label to observe the progress of the job real-time.