ETLGEN / USER GUIDE
Configure Azure Data Factory credentials
Give ETLGen the access it needs to create ADF pipelines, data flows, and staging assets.
What you need
Prepare an Azure subscription, a Data Factory, a service principal, and an ADLS Gen2 storage account for staging data that ADF data flows cannot read directly.
Collect the Data Factory values
From the Data Factory Properties page, copy the Subscription ID, Resource Group, Tenant ID, and factory name.
Create an application identity
Create a service principal and grant it the least Azure role that lets ETLGen create and manage the child resources your workflow needs. Create a client secret and copy it immediately; Azure shows the secret value only once.
ETLGen encrypts these values and stores them locally. Never commit a client secret to source control or place it in a shared specification.
Prepare ADLS Gen2
Use a storage account with hierarchical namespace enabled. Create a container and folder for parquet staging, then enter the Data Lake URL, container, and folder path in ETLGen. Use forward slashes for nested folders, for example parquet-stage/customer.
Save and test
Select Save Credentials. ETLGen validates the connection before storing it. If your factory already has an ADLS linked service, ETLGen can reuse it; otherwise make sure the application identity can access the staging path.