- 8646 Views
- 10 replies
- 7 kudos
Facing issue in the below mentioned code: dbutils.notebook.entry_point.getDbutils().notebook().getContext().tags().get('browserHostName').get() while executing through workflow, but it's totally working fine with workspace.
Please do let me know how to resolve this issue?
- 8646 Views
- 10 replies
- 7 kudos
- 2205 Views
- 1 replies
- 0 kudos
Noisy error in Databricks.
Hello all, I need some help figuring out the exact cause of this error. While in the middle of a complex scala transformation notebook in Azure Databricks, from time to time i get an error which looks like this, can someone help?Job aborted due to st...
- 2205 Views
- 1 replies
- 0 kudos
- 11768 Views
- 0 replies
- 1 kudos
Azure Service Bus
Hi Team,My client has Azure Service Bus and wants to do streaming using DLT. In my previous client we use Event Hub to get the data. Not sure if we can do this with Service Bus.Thanks in advance,G
- 11768 Views
- 0 replies
- 1 kudos
- 16797 Views
- 1 replies
- 2 kudos
temp tables in Databricks
Hey Team,We are in a migration phase from SQL server to Databricks.In our sql server databricks, lot of times, #temp tables created and dropped like typical Datawarehousing sql.In Databricks, we can do 2 things. I want to check which one is best appr...
- 16797 Views
- 1 replies
- 2 kudos
- 2 kudos
Just to add a bit more from experienceIf you are doing to use the temp tables too many times, then using temp views is going to slow down your cluster . It is due to lazy evaluation unless you persist that view (dataframe cache or globaltempview).Eve...
- 2 kudos
- 2784 Views
- 2 replies
- 0 kudos
Error while installing SAT tool in azure databricks
Hi, was running the security analysis initializer notebook, am I'm getting an error in cmd 8 for import_dashboard_template notebook. That is notebook no.5. First got an error for cmd 8 for this line "workspacedf = spark.sql("select * from `global_te...
- 2784 Views
- 2 replies
- 0 kudos
- 0 kudos
Hii,You can double-check the structure and contents of the json_ object to ensure it contains the expected keys and values. If you still encounter issues, verify the data types and perform necessary type conversions to ensure compatibility.
- 0 kudos
- 1184 Views
- 1 replies
- 0 kudos
Data Engineer Associate V3 exam got suspended
Hi team,My Databricks Certified Data Engineer Associate exam got suspended within 15 minutes. I had also shown my exam room to the proctor. My exam got suspended due to eye movement. I was not moving my eyes away from laptop screen. Some questions ar...
- 1184 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @rahulverma22 , Please refer to this post for guidance on how to proceed: https://community.databricks.com/t5/certifications/suspended-exam-don-t-worry-our-support-team-can-help/m-p/44469#M352
- 0 kudos
- 9113 Views
- 4 replies
- 0 kudos
How to handle multilines coming from CSV file in a quoted string
How to handle multilines coming from CSV file in a quoted string
- 9113 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi, Can you try escape parameter & quote parameter to indicate which characters need to be ignored. The escape character within the quotes will be ignored. you can specify the newline character, that it needs to be ignored. please refer to below doc...
- 0 kudos
- 20017 Views
- 3 replies
- 1 kudos
Resolved! Databricks Python Import Bug
Hello,I am reaching to the community in order to shed some light into a Bug I have been encountering recently. The two setups are as follows:SETUP-1 (WORKS):Python Notebook in Workspace FileSystem (this is Shared/folder/...)Python custom wheel librar...
- 20017 Views
- 3 replies
- 1 kudos
- 1 kudos
Solution has comed with an update, as stated in Work with Python and R modules | Databricks on AWS, In Databricks Runtime 13.0 and above, directories added to the Python sys.path are automatically distributed to all executors in the cluster. In Datab...
- 1 kudos
- 167254 Views
- 34 replies
- 6 kudos
How to read excel file using databricks
0 I have a excel file as source file and i want to read data from excel file and convert data in data frame using databricks. I have already added maven dependence for Excel file format. when i a tring below code it is giving error .(Error: java.io....
- 167254 Views
- 34 replies
- 6 kudos
- 6 kudos
To read an Excel file using Databricks, you can use the Databricks runtime, which supports multiple programming languages such as Python, Scala, and R. Here are the general steps to read an Excel file in Databricks using Python:1. **Upload the Excel ...
- 6 kudos
- 6437 Views
- 0 replies
- 1 kudos
Apply Changes Statistics
Hi Team,I just wanted to know why APPLY_CHANGES do not show how many rows it got upserted in the graph? Is this something in the works in the future?Cheers,G
- 6437 Views
- 0 replies
- 1 kudos
- 5654 Views
- 5 replies
- 4 kudos
Request for a retest voucher
Hi Team,I gave the Databricks Certified Data Engineer Associate (Version 2) on 10th June, 2023. I got 66.66% and I intend to retake it. Is it possible to get a voucher for the retest. That would be a great encouragement and help. I would really appre...
- 5654 Views
- 5 replies
- 4 kudos
- 4 kudos
Hi Databricks Team,I set for Databricks Certified Machine Learning Professional exam for 2nd time, but didn't pass again. Got 66.66% overall.I am seasoned databricks user but this particular exam is quite unorthodox one. Nevertheless I know I can be ...
- 4 kudos
- 8727 Views
- 2 replies
- 0 kudos
Time-out when using init script to install GDAL
I'm following this post to run an init script to install gdal.https://community.databricks.com/t5/get-started-discussions/gdal-on-databricks-cluster-runtime-12-2-lts/m-p/39091#M662My script is simply:--------------#!/bin/bashapt-get update && apt-get...
- 8727 Views
- 2 replies
- 0 kudos
- 2184 Views
- 1 replies
- 0 kudos
Cross Account External Table
I created an external table and set the location on other AWS Account (External Location), lets call it Account B. Databricks workspace is deployed in other account. Lets call it Account A.Here is my ScriptCREATE TABLE devtest.governance.dbtable1(col...
- 2184 Views
- 1 replies
- 0 kudos
- 0 kudos
I think you should start checking from our cross account role access.https://docs.databricks.com/en/administration-guide/account-settings-e2/audit-aws-cross-account.html#step-3-configure-cross-account-support-optional Check if this is well placed.
- 0 kudos
- 1477 Views
- 1 replies
- 0 kudos
Potential Unity Catalog Bug: Invalid configuration value detected for fs.azure.account.keyInvalid
Hello,We are migrating to Unity Catalog (UC), and for very few of our tables, we get the below error when trying to write or even display them. We are using UC enabled clusters, usually with runtime versions 12.2 LTS. The below error, when it happens...
- 1477 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello, Thanks for contacting Databricks Support. The error message indicates a problem with the configuration key fs.azure.account.key. This configuration key is used to provide the access key for the Azure Data Lake Storage account. Not sure if th...
- 0 kudos
- 1553 Views
- 1 replies
- 0 kudos
PROBLEM- Missing data in "Last Run" column in Databricks Workflows UI
Hello,I am having a pretty major problem with the Databricks Workflows UI- when I look at the list of jobs, the "Last Run" column does not have any data in it. This is kind of a big problem because now I don't have a good way of getting visibility in...
- 1553 Views
- 1 replies
- 0 kudos
- 0 kudos
- 0 kudos
| User | Count |
|---|---|
| 1619 | |
| 790 | |
| 492 | |
| 349 | |
| 287 |
