Matillion ETL Shared Job

Pip Install (legacy version)

This legacy Shared Job for pre LTS versions of Matillion ETL installs a chosen Python 3 library into a named location.


Please use the newer Pip3 Install Shared Job instead.


This legacy Shared Job uses pip for /bin/python3 to perform the installation.

Location Name parameter

Specify “system” or “user” to install systemwide with pip’s --user parameter. Warning: this affects all scripts, not just the current project. Using named locations is preferred.

Any other string will keep different sets of dependencies in named locations based on that string. Use the updated value of the v_python_header variable as the first line in any downstream Python script, to ensure that location is searched first.

Requirements parameter

Python dependencies to install, in the format described by pip.

Python Header parameter

This is an output parameter, which contains the import statements necessary for downstream Python scripts to use the new module.

Using named locations

Using named locations is preferred because it keeps sets of dependencies and libraries separate.

  • Create a variable in your own Orchestration Job, for example named my_py_header
  • In the Export tab of this Shared Job, export the value of v_python_header into your own variable created in (1)
  • The first line of your downstream python script should be ${my_py_header}

Pip install legacy part 1

Pip install legacy part 2

Pip install legacy part 3


Downloads

Licensed under: Matillion Free Subscription License

Download Pip-Install-legacy.melt

  • Target: Any target cloud data platform
  • Version: 1.44.8 or higher

Installation Instructions

How to Install a Matillion ETL Shared Job
Author: Matillion
Date Posted: Oct 23, 2023
Last Modified: Oct 25, 2023