cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

FranPérez
by New Contributor III
  • 5866 Views
  • 7 replies
  • 4 kudos

set PYTHONPATH when executing workflows

I set up a workflow using 2 tasks. Just for demo purposes, I'm using an interactive cluster for running the workflow. { "task_key": "prepare", "spark_python_task": { "python_file": "file...

  • 5866 Views
  • 7 replies
  • 4 kudos
Latest Reply
jose_gonzalez
Moderator
  • 4 kudos

Hi @Fran Pérez​,Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.

  • 4 kudos
6 More Replies
ksilva
by New Contributor
  • 1868 Views
  • 2 replies
  • 1 kudos

Incorrect secret value when loaded as environment variable

I recently faced an issue that took good hours to identify. I'm loading an environment variable with a secretENVVAR: {{secrets/scope/key}}The secret is loaded in my application, I could verify it's there, but its value is not correct. I realised tha...

  • 1868 Views
  • 2 replies
  • 1 kudos
Latest Reply
User16752242622
Valued Contributor
  • 1 kudos

Hi @kleber silva​ There was a known issue which has been resolved now. That is when a $ character is included in a secret value, the $ and all subsequent text are truncated. Although your question is actually related to how spark parse the value as a...

  • 1 kudos
1 More Replies
Labels