Data Productivity Cloud Pipeline

Extract from an XML API using a variable

Extract and load data from an XML based REST API using variables in Data Productivity Cloud pipelines.

These Data Productivity Cloud pipelines use Python requests and Snowflake’s PARSE_XML function to extract XML data from a REST API, and save it into a database table.

Image ofExtract and Load from an XML API using a variable
Extract and Load from an XML API using a variable

How to run the pipeline

Run Extract XML from your own pipeline, setting the scalar variable jv_url to the URL of the API you are calling.

The pipeline will call the API using Python, and then run the Load XML pipeline to save the returned data into a new dataabse table named stg_xml. The target table will be recreated if it already exists.

These pipelines are for low-level API access, so paging will need to be managed externally. The maximum size of the returned data is 200Kb.

Downloads

Licensed under: Matillion Free Subscription License

Download Extract-Load-XML-API-Variable.zip

  • Target: Snowflake

Installation Instructions

How to Install a Data Productivity Cloud Pipeline
Author: Matillion
Date Posted: Jun 21, 2024
Last Modified: Jun 21, 2024