Extract from an XML API using a variable
Extract and load data from an XML based REST API using variables in Data Productivity Cloud pipelines.
These Data Productivity Cloud pipelines use Python requests
and Snowflake’s PARSE_XML
function to extract XML data from a REST API, and save it into a database table.
![Image ofExtract and Load from an XML API using a variable](Extract-Load-from-an-XML-API-using-a-variable.webp)
How to run the pipeline
Run Extract XML
from your own pipeline, setting the scalar variable jv_url
to the URL of the API you are calling.
The pipeline will call the API using Python, and then run the Load XML
pipeline to save the returned data into a new dataabse table named stg_xml
. The target table will be recreated if it already exists.
These pipelines are for low-level API access, so paging will need to be managed externally. The maximum size of the returned data is 200Kb.
Downloads
Licensed under: Matillion Free Subscription License
Download Extract-Load-XML-API-Variable.zip
- Target: Snowflake
Installation Instructions
How to Install a Data Productivity Cloud PipelineAuthor: Matillion
Date Posted: Jun 21, 2024
Last Modified: Jun 21, 2024