How to Install a Data Productivity Cloud Pipeline

This article shows how to install a Pipeline from the Matillion Exchange into the Data Productivity Cloud.

Installing a pipeline from YAML

The Data Productivity Cloud Designer can import a zip file containing YAML files. Use the import pipeline menu and browse for the zip file in your local filesystem.

If you have downloaded one or more individual YAML files from the Matillion Exchange, you will need to put them into a zip file before importing.

Creating a zip file on Linux

Linux users can create a zip file from the command line using the zip utility like this:

zip "Run Externally Managed SQL Script.zip" "Run Externally Managed SQL Script.orch.yaml"

You must use quote symbols if the file names contain spaces.

Creating a zip file on Mac

Linux users can create a zip file from the command line using the zip utility like this: Mac users can create a zip file in a Finder window or on the desktop. Control-click the file, then choose Compress from the shortcut menu.

• If you compress a single item, the compressed file has the name of the original item with the .zip extension.
• If you compress multiple items at once, the compressed file is called Archive.zip.

Creating a zip file on Windows

Windows users can create a zip file from the File Explorer with a right-click:

Using your own git repository

Prerequisites:

• You must have registered your own git repository with your Data Productivity Cloud project. For example GitHub.
• Commit all local changes in your Data Productivity Cloud project, and push them to your git repository.

Find the Pipeline you want to install in the Downloads section, and note the path. Follow the link to download and save the file locally, as shown below. All Data Productivity Cloud Pipeline files have the suffix .yaml

Upload the .yaml file into your own git repository, into a directory structure that matches the path noted previously. Commit the changes. If necessary, merge the changes into the branch that your Data Productivity Cloud project is using.

Back in your Data Productivity Cloud project, pull remote changes to make the Pipeline appear in the Designer interface.