Data Feeds are a powerful tool to sync your data from external sources into your Mapp Engage system. This article explains step by step, how to set up Data Feeds in Mapp Engage.

Prerequisites

In order to set up Data Feeds, you need to configure your FTP connections (including path and regex) in the Credential Store.

Common Use Cases

  • Add contacts to Mapp Engage
  • Update contact attributes in Mapp Engage
  • Remove users from Mapp Engage
  • Send an email (prepared message) with parameters to contacts
  • Add data to your custom Related Data tables where their email is the key attribute
  • Add multiple location data to your locations data base
  • Add data to predefined Related Data: Transactions, Wish List and Abandoned Cart

Procedure

A) Create a generic integration via Mapp Connect

Data feeds are set up the same way as a generic integration in Mapp Connect.

 Procedure

  1. Go to Data Management > Mapp Connect.
  2. Click Add New Integration.
  3. Select type Generic from the drop-down list.
  4. Enter a name of the connection.
  5. Click Create.
  6. The Add-On settings opens to the Overview tab. You can still change the name of the integration here, and add a description.
  7. (optional) Check the box if you want a Whiteboard to be triggered when user mapping attributes change.
  8. Copy the secret key and save if for future reference.
  9. Click Save.


B) Set up import job

With one job you can import a few files that fit the regex expression and are of the same data type (e.g. user, transaction, email, abandoned cart, wish list, location).

  1. Go to the Data Import tab and click Add New Import.
  2. The Import Configuration tab opens. Here you can define all the details of the import job:
    1. Add job name.
      Enter the name here. The name has to be unique.
    2. Runs every.
      Here you can specify a detailed schedule of your job. 
    3. Set job status.
      Select Enabled or Disabled here.

      Only set the job status to Enabled when all columns for incoming data are mapped.

C) Define import steps

  1. Import from FTP/SFTP.
    Select the connection from the drop-down list click Test Connection. You will receive an alert if the connection test fails.
  2. (optional) Unzip file. To remove this step from the import workflow, click the minus sign .
    Supported formats: .zip, .tar, .gz, .tar and .gz
    If the zip file is protected by a password, you can enter it here. This option is only available for the .zip format.
  3. (optional) Change encoding and/or delimiter. To remove this step from the import workflow, click the minus sign  .

    Note that if you import multiple files, encoding and delimiter must be the same for all the files.

  4. Upload to S3. This is when the data is uploaded to Mapp's S3 server. This step cannot be configured.
  5. Create event. This step allows you to define what happens with the data upon import.
  6. Update mapping.
    Click on Edit Mapping and adjust it as needed.

     Edit Mapping

    1. Go to the mapping you want to edit and click Edit.
    2. Edit the name in the pop-up window that appears. The description is optional.
    3. To configure the mapping, click Edit Field Mapping.
    4. Click the plus sign.
    5. The Edit Mapping Information window opens. Here you must define the details of the mapping.

      1. Add source(s) lets you specify one or more data sources. For example: email, phone number, etc.
      2. Source Transformation lets you define whether any data should be changed during import. Read more about data transformations here.
      3. Choose Mapping subtype lets you chose from four options: User, Email, SMS and Push.
      4. Destination attribute lets you specify where the imported data will be mapped.

        Mapping sources and destinations are case sensitive!

  7. (optional) Add monitoring users. Here you can add the email addresses of people who should be receiving error logs from the system.
  8. Click Save.

D) View imports & monitor import progress

You can see all the created imports on the Data Import tab.

Click on the Running label to observe the progress of the job real-time.


Further Information