Author: Matillion
Date Posted: Jun 21, 2024
Last Modified: Nov 29, 2024
Extract from an XML API using a variable
Extract and load data from an XML based REST API using variables in Data Productivity Cloud pipelines.
These Data Productivity Cloud pipelines use Python requests and Snowflake’s PARSE_XML function to extract XML data from a REST API, and save it into a database table.
How to run the pipeline
Run Extract XML from your own pipeline, setting the scalar variable jv_url to the URL of the API you are calling.
The pipeline will call the API using Python, and then run the Load XML pipeline to save the returned data into a new dataabse table named stg_xml. The target table will be recreated if it already exists.
These pipelines are for low-level API access, so paging will need to be managed externally. The maximum size of the returned data is 200Kb.
Downloads
Licensed under: Matillion Free Subscription License
- Download Extract-Load-XML-API-Variable_Snowflake.zip
- Target: Snowflake