There are various export options for your data. One possibility is the raw data export, the functionality of which is described in detail in this documentation. Raw data export allows you to export raw data tables to an FTP server, for example, to fill your data warehouse with tracking data. The CSV format is used as the file format.

Requirements

To use the raw data export, the following prerequisites must be met:

  • The feature Raw data export must be activated for you. If this is not yet the case, contact the Mapp Support Team.
  • To configure the raw data export, you need administrator rights in Mapp Q3.

Configuration

You can have a raw data export carried out automatically at particular time intervals according to your configurations. Settings for this are made in Mapp Q3.

  1. Log into Mapp Q3.
  2. Go to Configuration > Raw Data Export. The configuration dialog for raw data exports opens.

These necessary settings are described in this chapter:

  • Raw Data Export: The basic settings for the raw data export are made here.
  • FTP Account Data: Here, you specify the connection data to the target server to which the raw data tables are to be sent.
  • Export Data: Here, you select which raw data tables the export should deliver.

Raw Data Export


  1. Under the tab Raw Data Export, make the following basic settings:

    ParameterDescription
    Enable Raw Data ExportActivate the feature using the corresponding radio button.
    CSV Field Separator

    Specify the character that separates the individual table entries from each other. Select the separator you want from the drop down list:

    • Semicolon (;)
    • Comma (,)
    • Space
    • Tab
    • Custom

    The following characters cannot be defined as separators:

    • Hyphen (-)

    • Tilde (~)

    A semicolon automatically replaces these.

    CSV Field Delimiter

    Specify the character used to delimit table entries (that is, the character before and after each table entry). Select the desired field delimiter from the drop down list:

    • None
    • Apostrophe (')
    • Quotation marks (")
    • Custom

    The following character cannot be defined as a separator:

    • Hyphen (-)

    Please use only those characters as "Custom characters" that do not appear in the table entries. Furthermore, field separators and field delimiters must differ from each other.

    Dispatch Window

    Specify when a raw data export is to take place:

    • Daily
      The data tables contain the data for the previous day. This includes data from all sessions that were started in the period. Therefore, data records from the following day may also be included if a session lasts beyond midnight
      Example
      A user starts a session at 11:45 p.m., which lasts 30 minutes, i.e., ends at 00:15 a.m.

      The export takes place as soon as the data for the previous day has been entirely written (daily closing).
    • Daily at 00:00 o'clock
      The data tables shall comprise the data set from 10:00 pm on a penultimate day to 10.00 pm on the previous day.

    • Hourly
      The tables contain the data of the closed sessions of the last hour.

      This option is not available by default. For activation, contact the Mapp Support Team.
    • Custom
      The period that the data tables are to cover can be set individually. With the button [Start export] you initiate the export ad-hoc, see Individual Export.

      This process may be carried out a maximum of 10 times per day. Further execution can take place immediately - there is no need to wait for the tables to be received for any previous export.
  2. Click Save.


FTP Account Data

Under the tab FTP Account Data the connection data to the target server are entered to which the raw data tables are to be sent.

Proceed as follows to configure the FTP access data:

  1. Under the tab FTP Account Data make the following settings:

    ParameterDescription
    Data SourceSelect the protocol with which the data is to be sent:
    • FTP
    • SFTP
    • FTPS (SSL)
    • FTPS (TLS)
    HostSpecify the IP or URL of the server on which the data is to be stored.
    Remote PathSelect the directory on the target server in which the raw data files are to be stored. The directory must always be specified as absolute.
    Login

    Specify the user to be used to login to the server.

    The selected user must have write permissions on the specified target server.
    AuthenticationSelect the authentication option using the corresponding radio button:
    • Password
    • Pivate key
    PasswordEnter the password or private key (in the case of SFTP with key pair).
    PortUsually the default ports are specified. However, you can define alternative ports.
  2. Via the button Test connection you can then check whether the server can be addressed with the entered data and whether it is possible to change to the specified directory.
  3. Click Save.

Export Data

Under the tab Export data you specify which raw data tables the export should deliver


  1. First, select via the corresponding radio button whether an export summary file should be created or not.

    The export log file is a CSV file that contains the following information:

    • exported tables
    • export time
    • number of rows in exported tables
    • file size

    This file is transferred last and only when all tables have been successfully transferred and can be used as a signal to start further processing for systems that process the raw data.


    Example log file

  2. Use the radio button to select which tables the export should contain.

  3. Click Save.