Matillion ETL Shared Job

Author: Matillion
Date Posted: Oct 25, 2023
Last Modified: Nov 9, 2023

Delete S3 File

Delete one file from a bucket in AWS S3 cloud storage.

The shared job will fail if the bucket is not known, or if the instance credentials lack the necessary privilege.

The shared job will succeed if the object to be deleted did not exist anyway.

Parameters

ParameterDescription
Bucket NameThe S3 bucket name (do not include the s3:// prefix, do not include the object path)
Object NameThe S3 object name (including path)

Prerequisites

AWS permissions are inherited from the Matillion ETL instance. Ensure that the EC2 instance credentials attached to your Matillion ETL instance include the privilege to delete files from S3. For more information, refer to the “IAM in AWS” section in this article on RBAC in the Cloud.

To avoid a ModuleNotFoundError, the following Python libraries must be available to the Python 3 interpreter:

  • boto3

Downloads

Licensed under: Matillion Free Subscription License

  • Download Delete-S3-File.melt
    • Platform: AWS
    • Target: Any target cloud data platform
    • Version: 1.68.3 or higher

Installation Instructions

How to Install a Matillion ETL Shared Job