Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.
Keynote: Data Warehouse presente...
Hello Everyone,We are trying to connect DataBricks SQL warehouse using ODBC url but we are not able to do it. We can see only JDBC url in connection details which works fine.Was anyone able to connect using ODBC url? Can someone please help?
I was setting a password for a new account in the databricks management page, and when I attempted to add a password of 50 characters, the prompt said "password must be no more than 50 characters" (bold added by me for emphasis). It would only accept...
@Vidula Khanna This question isn't related to Training -- none of the prompts in that ticket page are relevant. It's related to the Databricks Account Management Page password-setting prompt.
We have a team of multiple people, and they need to do Databricks Terraform config from the CLI. We'd like to do this without having all people be account admins in Databricks.What is the best way to do that?Right now, we have Terraform set up so tha...
I think the Service Principal definitely works for workspaces created from scratch with the Service Principal. I've tested that in my test environment, and have not encountered these kinds of authentication problem.The issue I am seeing is with works...
Hi all,My databricks "recents" (recent notebooks) are only saving for a given 'session'. If I close databricks, and come back in, all of my recents are cleared both on the login screen and the one I get when I click the "recents" icon on the left me...
I have a number of datasets that are published to Power BI service. When I published these from Power BI Desktop, I was able to enable period refresh. This morning however, the periodic refresh failed with a 403 Authentication Failed error. I can't e...
Hi @Michael Anckaert Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.T...
Hi @Machireddy Nikitha Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best an...
Hi @shweta srivastava Thank you for posting your question in our community! We are happy to assist you.Elevate our community by acknowledging exceptional contributions. Your participation in marking the best answers is a testament to our collective ...
Hello Everyone,I want you to ask how can I get the SQL option on Databricks, because I am doing the Data Analyst courses and I do not have that option, just Data Engineer and Machine Learning. I am connecting through Microsoft Azure..Waiting for your...
@Luis Carcaño You can switch your persona from data science and engineering to SQL, but this is only possible if you have a premium Databricks workspace. To do so, please create a new workspace with a premium tier.
When I try setting the `pathGlobFilter` on my Autoloader job, it appears to filter out everything. The bucket/directory setup is like`s3a://my_bucket/level_1_dir/level_2_dir/<some_name>/one/two/<the_files_i_want_to_load>`So what I want is to be able ...
the thing that actually worked for me was to skip the `pathGlobFilter` and do this filtering in the `load` invocation: `stream.load(f"{MY_S3_PATH}{include_patterns}"). This portion of the docs could use some editing, imo.
Hi Nadia, I have written Databricks Associate Data Engineering certification exam and cleared with 93.33%, its already been 48 hours and I have not received any certificate yet. Please treat this as urgent.My Mail id: prudhviraj2744@gmail...
Hi @Adella Sai Prudhvi Raj Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.You...
Hello,I am having hard time loading certain model of python (scispacy model)I want to load the model on the location so i can call it on the code running in databrick python notebookwanted to load the model file (zipped)How can I load it on the clust...
Hi @Paresh Desai Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
Additional reads on the same topic:https://databricks.com/blog/2018/05/02/introducing-databricks-optimized-auto-scaling.htmlhttps://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation
Assume that I have a few clusters in Databricks and I want to make a report in Power BI that shows cluster metrics. For example:How many hours clusters were running categorized by usernameCost CPU loadIs there any way that I can send this information...
Hi @Mohammad Saber Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
Assume that I have a few tables in Databricks and I want to make a report in Power BI that shows the No. of table views for a specific user.I mean, how many times has a user queried a specific table? This is the information I want to send from Databr...
Hi @Mohammad Saber I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I sugges...
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.