Data Productivity Cloud Pipeline
Author: Matillion
Date Posted: Jun 18, 2024
Last Modified: Nov 29, 2024

Check Network Access

Check connectivity between your Data Productivity Cloud agent and a network data source. or maybe

Use this pipeline whenever you need to check if your Data Productivity Cloud agent has access to a specific SaaS or on-prem network resource, for example a source database. It works for both Public and Private IPv4 addresses.

The pipeline will fail if your Data Productivity Cloud agent does not have access to the network resource on the chosen port. The component will try to connect for a maximum of 5 seconds before timing out.

To use the pipeline, run it from another pipeline and set the two required pipeline variables:

Image ofSet host and port - example to check internet access
Set host and port - example to check internet access

Database access check

To check whether your Data Productivity Cloud agent has network access to a source database, for example one that you intend to query with a Database Query component:

  • Set the Address to the network endpoint of the database
  • Set the Port Number for that database’s network protocol

Most databases have commonly used port numbers, such as:

  • Postgres, Redshift: 5432
  • SQL Server: 1433
  • Oracle: 1521 and above
  • DB2: 48000 and above
Image ofCheck Database Access
Check Database Access

REST API access check

To check whether your Data Productivity Cloud agent has network access to a REST API that you intend to use, for example with a Custom Connector component:

  • Set the Address to the host part of the API, for example devrel.matillion.com. Don’t include any paths or query parameters.
  • Set the Port Number to whatever the API is using, for example 443 for https://
Image ofCheck REST API Access
Check REST API Access

Internet access check

To check whether your Data Productivity Cloud agent has access to the internet:

  • Set the Address to the name of a server on the internet - for example <www.google.com>
  • Set the Port Number to an open port on that server - for example 443 for https://

Use the success branch for components that require internet access. Use the failure branch to handle the case that there is no internet access.

Image ofCheck Internet Access
Check Internet Access

Downloads

Licensed under: Matillion Free Subscription License

Installation Instructions

How to Install a Data Productivity Cloud Pipeline