cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

DAB run

raghu2
New Contributor III

Hello All,

I am running this command : databricks bundle run -t dev dltPpl_job --debug

Bundle name: dltPpl. Bundle was generated using: databricks bundle init --target dev

Error message: Error: exit status 1
Failed to marshal state to json: unsupported attribute "for_each_task"

Additional error messages:

15:27:05 DEBUG Apply pid=3997 mutator=seq mutator=terraform.Load
15:27:07 ERROR Error: exit status 1
Failed to marshal state to json: unsupported attribute "for_each_task" pid=3997 mutator=seq mutator=terraform.Load
15:27:07 ERROR Error: exit status 1

Appreciate any leads on how to run a unit test from a local development command line.

3 REPLIES 3

prar_shah
New Contributor III

Hello, I am facing the same issue, my job is in .yml form, which I copied from UI after creating the for_each_task loop and selecting "Switch to code version (yaml)". Even after copying it as it is, getting the same error, here is the reference yaml:
```

- task_key: my_custom_task
depends_on:
- task_key: my_previous_task
for_each_task:
inputs: "{{tasks.my_previous_task.values.parameter1}}"
task:
task_key: my_custom_task_iteration
python_wheel_task:
package_name: custom_package
entry_point: program_main
parameters:
- --config-path
- .....
- "{{input}}"
job_cluster_key: custom_cluster
libraries:
- whl: ....
```

prar_shah
New Contributor III

Update:
Error is:
Error: cannot create job: No task defined for my_custom_task

prar_shah
New Contributor III

@Retired_mod 
I was trying 'pip install --upgrade databricks' before but after upgrading the version with 'brew upgrade databricks it worked. 
Thanks for the help!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group