I need to execute a .py file in Databricks from a notebook (with arguments which for simplicity i exclude here). For this i am using: %sh script.py script.py: from pyspark import SparkContext
def...
...eview error details in the activity log tab and retry your operation' The workspace was launching fine when I created it without the virtual network and public and private networks. Activity log does n...
Hi all, I am getting an error when I try to 'Browse' an external location in catalog explorer through Databricks UI. This is the error I get: Error loading files. Input path url 'abfss:/...
I managed to extract the Google Analytics data via lakehouse federation and the Big Query connection but the events table values are in a weird JSON format {"v":[{"v":{"f":[{"v":"ga_session_number"}...
We use a private PyPI repo (AWS CodeArtifact) to publish custom python libraries. We make the private repo available to DBR 12.2 clusters using an init-script as prescribed here in the Databricks KB....
...verwrite").option("mergeSchema", "true").save(destination_mount_filepath) The background of this is we are loading raw data into a delta table in mounted storage. I have tried unmounting/remounting s...
The first 25 people to submit a completed survey response will receive a $25 gift card as an expression of our gratitude. Treat yourself on Databricks!
Your feedback is crucial to us and directly i...
Dear all, Greetings! I have been trying to run a workflow job which runs successfully when a task is created using a Notebook file from a folder present in the Workspace but when the same task's ty...
Hi, Background: In Azure-Datebricks: We have a personal account that created a workspace, this workspace is our main workspace. The users Microsoft Office account is already deleted but the user s...