Explanation of profiles and jobs

Owned by Thomas Speekenbrink
Last updated: Dec 22, 2021 by Remco Visser
2 min read

Overview

In this article, we will describe the differences between DataBridge profiles and DataBridge jobs.

In short: A profile is a description of an import or export job. Based on a profile new jobs are created. 

Profiles

In Nebula DataBridge you can have Import and/or Export Profiles.

An import profile consists of 
  • Configure Profile: Connections to SuperOffice CRM and a (cloud) storage provider (Dropbox, Google Drive, OneDrive, Google sheets, FTP)
  • Configure Source: Indicate what the import source looks like. e.g.: with headers or not, what delimiter is used, etc.
  • Transform: Transformations (optional) with which you can apply transformations to the data and columns
  • Configure fields: Map the input fields to the output fields.
  • Destination settings: Settings to process the data, like number format. The deduplication option is very important. Add list items and settings default values for new items can also be set on this page.
  • Profile settings: Schedule your import and get notified afterwards
An export profile consists of
  • Configure Profile: Connections to SuperOffice CRM and a (cloud) storage provider (Dropbox, Google Drive, OneDrive, Google sheets, FTP)
  • Configure Source: Export data from a SuperOffice CRM selection 
  • Transform: Transformations (optional) with which you can apply transformations to the data and columns
  • Destination settings: Settings to process the data, like filename and file format
  • Profile settings: Schedule your export and get notified afterwards

Jobs

New jobs are created when an import or export is executed. It holds a summary of the import or export. 

In the job overview, you can see the number of imported or exported records and how many of them were successful, skipped or had an error. In the log, you can see the details of the import or export run.

In the profile settings, you can set the option to receive a notification after a run.

On the Profile settings page of your profile there are 3 methods available to start your import or export job:

  1. Manual, according to the profile configuration you can manually select a compatible import file in the browser to start processing in a background process; or start an export with a single button click.
  2. Scheduled, automatically start a job at the selected days and time. In case of an import, a new file will be retrieved from your selected storage location.
  3. Triggered, work will be done according to the profile configuration when a request is made to a specific secret URL. There are 2 options that you need to enable separately with the toggle button:
    1. Triggered jobs, allows you to create and run a triggered job in a background process by calling a URL. This is a long-running process and the execution is the same as with SCHEDULED jobs. Calling a triggered job is limited to once per 15 minutes on each profile, more calls to the same trigger URL will fail; this fair use policy is maintained to keep the load on DataBridge and SuperOffice CRM acceptable.
    2. Instant jobs, allows you to create and run an instant job directly in the browser by calling a URL with parameters. Because the work is done directly in the browser request, this is only suitable for limited work; for example, if you just want to export a single record to a file for further processing. Please read the information int this article carefully if you want to use this advanced functionality.