cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

FranPérez
by New Contributor III
  • 17631 Views
  • 9 replies
  • 6 kudos

set PYTHONPATH when executing workflows

I set up a workflow using 2 tasks. Just for demo purposes, I'm using an interactive cluster for running the workflow. { "task_key": "prepare", "spark_python_task": { "python_file": "file...

  • 17631 Views
  • 9 replies
  • 6 kudos
Latest Reply
kenmyers-8451
Contributor II
  • 6 kudos

Just checking in again if there is a way to do this in the last few years? As Fran mentioned, `sys.path.append("/Workspace/Repos/devops/mlhub-mlops-dev/src")` is not a great "fix" for the reasons already mentioned. I've found that you can do `pip ins...

  • 6 kudos
8 More Replies
ksilva
by New Contributor II
  • 5964 Views
  • 4 replies
  • 4 kudos

Incorrect secret value when loaded as environment variable

I recently faced an issue that took good hours to identify. I'm loading an environment variable with a secretENVVAR: {{secrets/scope/key}}The secret is loaded in my application, I could verify it's there, but its value is not correct. I realised tha...

  • 5964 Views
  • 4 replies
  • 4 kudos
Latest Reply
danmlopsmaz
New Contributor III
  • 4 kudos

Hi team, is there an update or fix for this?

  • 4 kudos
3 More Replies
Labels