Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-18-2025 01:23 AM
Hey,
I am using DAB's to deploy the job below.
This code works but I would like to use it for other suppliers as well.
Is there a way to loop over a loop of suppliers: ['nike', 'adidas',...] and fill those variables so that
config_nike_gsheet_to_databricks is dynamically filled in like config_{supplier}_gsheet_to_databricks.
bundle:
name: gsheet-config-jobs
resources:
jobs:
config_nike_gsheet_to_databricks:
name: config_nike_gsheet_to_databricks
tasks:
- task_key: test_config_nike_gsheet_to_databricks
spark_python_task:
python_file: src/mapping-update/main.py
parameters:
- ACC
- NIKE
source: GIT
environment_key: Default
git_source:
git_url: https://github.com/Transfo-Energy/transfo-engine.git
git_provider: gitHub
git_branch: Acceptance
queue:
enabled: true
environments:
- environment_key: Default
spec:
client: "1"
dependencies:
- gspread
- oauth2client
performance_target: PERFORMANCE_OPTIMIZED
Thanks a lot for the help!
Labels:
- Labels:
-
Workflows