QuickBooks Online Incremental Load
Properties
| Property | Type | Description |
|---|---|---|
| OAuth | Variable | The name of the OAuth entry to be used from the Matillion OAuth Manager to connect to the source. These must be set up in advance, using Project → Manage OAuth. |
| Use Sandbox | Variable | Yes/No. Whether you are intending to connect to a sandbox rather than a live, default service. |
| Connection Options | Grid | A list of values and parameters. Parameters and their allowed values are database/driver specific. Referring to the data model will provide insight of what you could provide here.\n\nThey are usually not required as sensible defaults are assumed. |
| Tables and Columns | Grid | Grid Variable containing, for each column of each table requested:\nTable Name,\nColumn Name,\nWhether the column is Incremental (0 or 1)\nWhether the column is a Key column (0 or 1) |
| S3 Bucket Name | Variable | <span class="env sf">(AWS Only) The name of an S3 bucket for temporary storage. Ensure your access credentials have S3 access and permission to write to the bucket. See <a href="https://redshiftsupport.matillion.com/customer/portal/articles/2054760" target="_blank">this document</a> for details on setting up access. The temporary objects created in this bucket will be removed again after the load completes, they are not kept. \n<span class="env sf">This property is available when using an Existing Amazon S3 Location for Staging. |
| Distribution Style | Variable | Even: Distributes rows around the Redshift cluster evenly. \nAll: Copy rows to all nodes in the Redshift cluster. \nTable distribution is critical to good performance. See the <a href="http://docs.aws.amazon.com/redshift/latest/dg/tutorial-tuning-tables-distribution.html" target="_blank">Amazon Redshift</a> documentation for more information. |
| Load Type | Variable | Sequential - Iterations are done in sequence, waiting for each to complete before starting the next. \nThis is the default.\n \nConcurrent - Iterations are run concurrently. This requires all "Variables to Iterate" to be defined as\n<a href="https://redshiftsupport.matillion.com/customer/portal/articles/2037630?b_id=8915#header1" target="_blank">Copied variables</a>, so that each iteration gets its own copy of the variable isolated from the same\nvariable being used by other concurrent executions.\n<span class="env rs sf"> Note: The maximum concurrency is limited by the number of available threads (2x the number of virtual cpus on your cloud instance). |
| Stage Schema | Variable | The schema name where the staging data will be stored. |
| Stage Prefix | Variable | A prefix value that will be added to the start of the stage table names.\n\ne.g. If a Stage Prefix of 'stage_' is specified and the table being processed is named 'test_data' then the target table will be named 'stage_test_data'. |
| Target Schema | Variable | The schema name where the target data will be stored. |
| Target Prefix | Variable | A prefix value that will be added to the start of the target table names.\n\ne.g. If a Target Prefix of 'target_' is specified and the table being processed is named 'test_data' then the target table will be named 'target_test_data'. |
| Encryption | Variable | <span class="env sf">(AWS Only) Decide on how the files are encrypted inside the S3 Bucket.<span class="env sf">This property is available when using an Existing Amazon S3 Location for Staging. \n None: No encryption. \n SSE KMS: Encrypt the data according to a key stored on <a href="https://aws.amazon.com/kms/" target="_blank">KMS</a>. \n SSE S3: Encrypt the data according to a key stored on an <a href="http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingServerSideEncryption.html" target="_blank">S3 bucket</a> |
| KMS Key ID | Variable | The ID of the KMS encryption key you have chosen to use in the 'Encryption' property. |
| Log Metrics | Variable | TRUE or FALSE (default=TRUE).\nWhether or not to add useful information to the metrics store.\n |