I managed to extract the Google Analytics data via lakehouse federation and the Big Query connection but the events table values are in a weird JSON format {"v":[{"v":{"f":[{"v":"ga_session_number"}...
We use a private PyPI repo (AWS CodeArtifact) to publish custom python libraries. We make the private repo available to DBR 12.2 clusters using an init-script as prescribed here in the Databricks KB....
...verwrite").option("mergeSchema", "true").save(destination_mount_filepath) The background of this is we are loading raw data into a delta table in mounted storage. I have tried unmounting/remounting s...
The first 25 people to submit a completed survey response will receive a $25 gift card as an expression of our gratitude. Treat yourself on Databricks!
Your feedback is crucial to us and directly i...
Dear all, Greetings! I have been trying to run a workflow job which runs successfully when a task is created using a Notebook file from a folder present in the Workspace but when the same task's ty...
Hi, Background: In Azure-Datebricks: We have a personal account that created a workspace, this workspace is our main workspace. The users Microsoft Office account is already deleted but the user s...
Read from Databricks integration best practises about the native support for Service Principal authentication on JDBC/ODBC drivers. The timetable mentioned for this was "expected to land in 2023", is...
...efault: true
workspace:
host: https://myhost.cloud.databricks.com
# The 'prod' target, used for production deployment.
prod:
resources:
jobs:
my_job1:
s...
In my notebook, i am performing few join operations which are taking more than 30s in cluster 14.3 LTS where same operation is taking less than 4s in 13.3 LTS cluster. Can someone help me how can i o...