Databricks Community

Twilight · 08-06-2024

I found this old post (https://community.databricks.com/t5/data-engineering/databricks-cluster-web-terminal-different-permissions-with-tmux/td-p/26461) that was never really answered.I am having the same problem. If I am in the raw terminal, I can a...

Twilight · 02-27-2023

In Spark (but not Databricks), these work:regexp_replace('1234567890abc', '^(?<one>\\w)(?<two>\\w)(?<three>\\w)', '$3$2$1') regexp_replace('1234567890abc', '^(?<one>\\w)(?<two>\\w)(?<three>\\w)', '${three}${two}${one}')In Databricks, you have to use ...

Twilight · 08-26-2022

Both of these work in Spark SQL:regexp_replace('1234567890abc', '^(?<one>\\w)(?<two>\\w)(?<three>\\w)', '$1') regexp_replace('1234567890abc', '^(?<one>\\w)(?<two>\\w)(?<three>\\w)', '${one}')However, neither work in Databricks SQL. I found that this ...

Twilight · 08-08-2024

Thanks for the reply. It's been a long time since I admin'd a linux system so I'm not quite following your response.I'm seeing the issue just by doing the following steps:start webtermls /Workspace/Users (works fine)tmuxls /Workspace/Users (fails)I'...

Twilight · 03-13-2023

On further querying and reading, I think this IS a bug. Photon specifies:"Photon is an ANSI-compliant engine designed to be compatible with modern Apache Spark APIs and just works with your existing code — SQL, Python, R, Scala and Java — no rewrite ...

Twilight · 03-13-2023

That's an extremely nonintuitive change. Given that Databricks at least appears based on Spark and Scala (Spark and Scala versions are specified in cluster config with no mention of Java/JVM versions), why would Databricks choose to change the Spark...

Twilight · 02-22-2023

I apologize - I apparently lost track of this...In Spark (but not in Databricks), both of these:regexp_replace('1234567890abc', '^(?<one>\\w)(?<two>\\w)(?<three>\\w)', '$1') regexp_replace('1234567890abc', '^(?<one>\\w)(?<two>\\w)(?<three>\\w)', '${o...

Databricks Community

User Stats

User Activity

web terminal accessing /Workspace/Users under tmux

Bug - Databricks requires extra escapes in repl string in regexp_replace (compared to Spark)

How to make backreferences in regexp_replace repl string work correctly in Databricks SQL?

Re: web terminal accessing /Workspace/Users under tmux

Re: Bug - Databricks requires extra escapes in repl string in regexp_replace (compared to Spark)

Re: Bug - Databricks requires extra escapes in repl string in regexp_replace (compared to Spark)

Re: How to make backreferences in regexp_replace repl string work correctly in Databricks SQL?