cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

yatharth
by New Contributor III
  • 3095 Views
  • 2 replies
  • 2 kudos

Metric Tables not created automatically

I was trying the new lakehouse monitoring feature for one of my unity tables, and when I create a monitoring dashboard for my table, the 2 metric tables({output_schema}.{table_name}_profile_metrics and {output_schema}.{table_name}_drift_metrics) are ...

  • 3095 Views
  • 2 replies
  • 2 kudos
Latest Reply
Cas
New Contributor III
  • 2 kudos

Any success/workaround on this topic? I have the same issue

  • 2 kudos
1 More Replies
RohitB91
by New Contributor III
  • 1784 Views
  • 2 replies
  • 1 kudos

DataEngineer Associate Exam got Suspended. Raised Ticket. No Response

Hi Team,This is the second time I am tryng to post a discussion in the community. The first time it was marked SPAM. It has been a terrible experience so far with my Databricks Data Engineer Associate exam getting suspended by the proctor for reasons...

  • 1784 Views
  • 2 replies
  • 1 kudos
Latest Reply
Cert-Team
Databricks Employee
  • 1 kudos

@RohitB91 the support team is awaiting your response for a date / time you are available to resume your exam. Your registration confirmation email should contain this detail: Preparation for taking your Online proctored Exam Understand the computer r...

  • 1 kudos
1 More Replies
SaiRekhawar
by New Contributor
  • 883 Views
  • 1 replies
  • 0 kudos

search engine functionality in Databricks

Hi Team,Good morning, I am Sai Rekhawar, currently residing in Hamburg, Germany. I am reaching out regarding an issue with the search engine functionality in Databricks.I have created several catalogs and tables within the catalog, and I am the owner...

  • 883 Views
  • 1 replies
  • 0 kudos
Latest Reply
ManiTejaG
New Contributor II
  • 0 kudos

Hi @SaiRekhawar , try using the filters in under the table bar in ctrl+P as below  

  • 0 kudos
Krubug
by New Contributor
  • 899 Views
  • 0 replies
  • 0 kudos

Improve Query Performance

HelloI have a query in one of my notebooks that took around 3.5 hours on D12_V2 cluster and workers between 5 to 25 .is there a way to write the query in diffrenet way in order to improve performance and cost : select /*+ BROADCAST(b) */ MD5(CONCAT(N...

  • 899 Views
  • 0 replies
  • 0 kudos
Jeyapaul
by New Contributor II
  • 3022 Views
  • 2 replies
  • 1 kudos

User Agent Verfication

Hello Folks, We are recently working on Databricks integration in to our products and one of the Best practices suggested is to send user-agent information for any REST API or JDBC connect we make from the product to Databricks. We have made all the ...

  • 3022 Views
  • 2 replies
  • 1 kudos
Latest Reply
Bharathii
New Contributor II
  • 1 kudos

Hi @bdraitcak , Here are the steps to be followed to get the logs: Log in to your Azure portal.Go to / Search for "Log analytics workspace."Create a new Log Analytics workspace by specifying your Resource group and Instance details. [subscription + r...

  • 1 kudos
1 More Replies
Innov
by New Contributor
  • 3023 Views
  • 0 replies
  • 0 kudos

Convert pkl file

I am looking to convert pkl file to parquet format. I am reading this data from Azure Data Lake and convert and create parquet file outputs to store them in my hive metastore.  

  • 3023 Views
  • 0 replies
  • 0 kudos
Kaizen
by Valued Contributor
  • 1227 Views
  • 0 replies
  • 1 kudos

Init script error 13.3 and 14.3 LTS issues mesa

Hi - we had a few issues with some of our init scripts recently. Investigating I found that mesa packages were throwing issues when trying to install. Posting this to help the community and raise awareness to Databricks to fix itI believe the image f...

Kaizen_0-1708547649934.png Kaizen_1-1708547704572.png
  • 1227 Views
  • 0 replies
  • 1 kudos
egndz
by New Contributor II
  • 1282 Views
  • 1 replies
  • 0 kudos

Unable to login to Azure Databricks

I am trying to login to Azure Databricks as usual but it waits for 5 10 seconds then redirects me to https://westeurope-c2.azuredatabricks.net/aad/redirect The system is up and all of my colleagues can login to the system. I have tried in incognito m...

  • 1282 Views
  • 1 replies
  • 0 kudos
Latest Reply
Simranarora
Databricks Employee
  • 0 kudos

Hi @egndz , If it was a one-time issue we suspect it was an issue within Azure or Databricks services. Please follow the status page to keep track of the maintenance/outages. https://status.azuredatabricks.net/

  • 0 kudos
Anto23
by New Contributor
  • 1218 Views
  • 1 replies
  • 0 kudos

Failed Synchronization of Files Using Databricks Extension in VS Code

hi,I am trying to set up Databricks Extension in VS Code. I follow the steps as per the guide belowhttps://docs.databricks.com/en/dev-tools/vscode-ext/tutorial.html When i move to step 6 (see in the above guide) i follow the steps and i create succes...

db.png
  • 1218 Views
  • 1 replies
  • 0 kudos
Latest Reply
Simranarora
Databricks Employee
  • 0 kudos

Hi @Anto23 ,   Greetings from Databricks. Based on the above information, it seems Files in Workspace is currently disabled for your Databricks environment. This feature allows storing and accessing non-notebook files alongside your notebooks and cod...

  • 0 kudos
Pravin08
by New Contributor III
  • 1809 Views
  • 1 replies
  • 0 kudos

Oracle table load from Databricks

I am trying to load a dataframe from Databricks to target Oracle table using the write method and using JDBC api. I have the right drivers. The job and its corresponding stages are getting completed and the data is getting loaded in Oracle target tab...

Community Platform Discussions
Databricks - Oracle load
  • 1809 Views
  • 1 replies
  • 0 kudos
Latest Reply
Pravin08
New Contributor III
  • 0 kudos

Thanks for the response. Can you please elaborate on the Apache Spark JDBC Connector. I am using ojdbc8 driver as per the Databricks documentation. I am not using Delta Lake. I have the data in a dataframe and using write method to insert the data to...

  • 0 kudos
sai_sathya
by New Contributor III
  • 1995 Views
  • 0 replies
  • 0 kudos

Decimal Precision error

when i try to create an dataframe like this   lstOfRange = list() lstOfRange = [ ['CREDIT_LIMIT_RANGE',Decimal(10000000.010000),Decimal(100000000000000000000000.000000),'>10,000,000','G'] ] RangeSchema = StructType([StructField("rangeType",St...

  • 1995 Views
  • 0 replies
  • 0 kudos
thethirtyfour
by New Contributor III
  • 2678 Views
  • 1 replies
  • 0 kudos

error installing igraph library

Hi, I am trying to install the "igraph" and "networkD3" CRAN packages for use within a notebook, but am receiving the below error.Could someone please assist?Thanks! * installing *source* package ‘igraph’ ... ** package ‘igraph’ successfully unpacked...

  • 2678 Views
  • 1 replies
  • 0 kudos
Latest Reply
pcs
New Contributor II
  • 0 kudos

Based on this igraph github issue https://github.com/igraph/rigraph/issues/490#issuecomment-966890059, I followed the instructions to install glpk. After installing glpk, I was able to install igraph.

  • 0 kudos
thethirtyfour
by New Contributor III
  • 2093 Views
  • 2 replies
  • 1 kudos

Resolved! Error installing the igraph and networkD3 R libraries

Hi,I am trying to install the igraph and networkD3 CRAN packages for use within a notebook. However, I am receiving the attached installation error when attempting to do so.Could someone please assist?Thank you!

  • 2093 Views
  • 2 replies
  • 1 kudos
Latest Reply
thethirtyfour
New Contributor III
  • 1 kudos

Thank you!

  • 1 kudos
1 More Replies
markwilliam8506
by New Contributor
  • 1059 Views
  • 1 replies
  • 0 kudos

What causes affect QB Won't Open and how to fix it?

What Can Be Causing QB Won't Open Issue and How Can I Fix It? I need help immediately to fix this annoying issue! Has anybody else had such problems with QB refusing to open? My personal attempts at troubleshooting have yielded no results. I would be...

  • 1059 Views
  • 1 replies
  • 0 kudos
Latest Reply
kartanjohn29
New Contributor II
  • 0 kudos

@markwilliam8506 If your QB won't open even after multiple tries, you might be facing some common error messages. This scenario can be a result of damaged program files or a faulty installation process, among other possible reasons. The error message...

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors