- 1724 Views
- 1 replies
- 1 kudos
Resolved! Find out the cluster hung state in azure databricks
Hi, I Have to capture the info when cluster is in hung state for example any cluster is running from last 2 hrs. But it doesn't show any progress. Where can I get hung details.
- 1724 Views
- 1 replies
- 1 kudos
- 1 kudos
You can look at the sparkUI of the cluster to get what is happening on the cluster.Debugging with the Apache Spark UI - Azure Databricks | Microsoft Learn
- 1 kudos
- 892 Views
- 0 replies
- 0 kudos
Resources for Data+AI Summit Talks
Hi,where do I find the resource mentioned in the latest talks of the Data+AI Summit 2023? In the videos the speaker mention, that there are resources avaible for example in the talk "Best Practices for Setting Up Databricks SQL at Enterprise Scale" (...
- 892 Views
- 0 replies
- 0 kudos
- 3345 Views
- 3 replies
- 5 kudos
Resolved! Databricks - Server/Clusters issues
Hello, Do some other users have some issues with Databricks today (Clusters, connection, server)?I'm experiencing slowness and failure when running notebooks. My Databricks is on Azure West Europe in Premium.
- 3345 Views
- 3 replies
- 5 kudos
- 5 kudos
Hi team,Users may experience slow rendering of notebooks, clusters, and other Databricks user interfaces. Our engineering team is engaged and our status page is updated.https://status.azuredatabricks.net/Some preliminary explanation on Azure website ...
- 5 kudos
- 1049 Views
- 0 replies
- 0 kudos
DBR 11.3 LTS - Specify spark.app.id for python notebook task
Hi, I use Terraform databricks_job to submit a job with many tasks. IFAIK, each task is a separated Spark Application with a specific applicationId (https://spark.apache.org/docs/3.1.3/api/python/reference/api/pyspark.SparkContext.applicationId.html)...
- 1049 Views
- 0 replies
- 0 kudos
- 807 Views
- 0 replies
- 0 kudos
What is dataBricks and how to us it
Databricks is a unified set of tools for building, deploying, sharing, and maintaining enterprise-grade data solutions at scale. The Azure Databricks Lakehouse Platform integrates with cloud storage and security in your cloud account, and manages and...
- 807 Views
- 0 replies
- 0 kudos
- 2701 Views
- 1 replies
- 1 kudos
Resolved! Not able to login to to Partner Acedamy
Hi,I have created my account using my email address on https://community.databricks.com, and my credentials work on https://community.databricks.com.But, when I try login using the same credentials on partner-academy.databricks.com, my login fails. ...
- 2701 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @nikhiljatiwal,Thank you for reaching out!Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 1 kudos
- 1975 Views
- 0 replies
- 1 kudos
Quickbooks desktop pro +1-888-738-0708
QuickBooks Desktop Pro is a complete accounting system designed specially for small and medium-sized businesses. This solution provides accounting software application functionality, such as account payable and receivable, project accounting, expendi...
- 1975 Views
- 0 replies
- 1 kudos
- 965 Views
- 0 replies
- 1 kudos
What happens to the Workspace when deleting the user that created that workspace
Hi,Background:In Azure-Datebricks:We have a personal account that created a workspace, this workspace is our main workspace. The users Microsoft Office account is already deleted but the user still exist in Databricks.Question 1 is:What happens to th...
- 965 Views
- 0 replies
- 1 kudos
- 1284 Views
- 1 replies
- 0 kudos
Authentication through ODBC
Is the Access token the only uthentication method ?
- 1284 Views
- 1 replies
- 0 kudos
- 0 kudos
The authentication method may vary depending on the specific implementation and the data source you are connecting to. While an access token is one common authentication method, it is not the only method available. Here are a few authentication optio...
- 0 kudos
- 5280 Views
- 1 replies
- 0 kudos
kafkashaded.org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
I'm trying to read a message from a confluent kafka topic using databricks but i keep getting below error. can you let me know if I'm missing something?codeoptions = {"kafka.sasl.jaas.config": 'org.apache.kafka.common.security.plain.PlainLoginModule ...
- 5280 Views
- 1 replies
- 0 kudos
- 0 kudos
The error message you're encountering suggests an issue with fetching the earliest offsets for the Kafka topic. It seems that the KafkaOffsetReaderConsumer is unable to retrieve the initial partition offsets, causing the error to occur. To troublesho...
- 0 kudos
- 1807 Views
- 1 replies
- 2 kudos
Resolved! First time at Data + AI summit
It’s a wonderful summit! I met so many women in tech during this event, it’s a very good opportunity to exchange thought and ideas with such a divers ppl to modernize Data & AI! I actually join here from Japan, and unfortunately not so many women in ...
- 1807 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks Sakura for dropping by at the Community cove and asking these questions. Together folks like yourself can move the needle and bring in more women to Data and AI space by being inspirational. I am sure you will attract many of us to be in this ...
- 2 kudos
- 3519 Views
- 1 replies
- 1 kudos
Using F Strings in filenames to read in files from mounted containers
Below are 2 versions of codes I tried and the failure messages. Does anyone have advice how to form this properly?I tried thisfor x in range(2,num_organization_page,1): file_str = f"dbfs:/mnt/dlsi2023/raw/ds_pet_finder_organization{x}.json", print(fi...
- 3519 Views
- 1 replies
- 1 kudos
- 1 kudos
Your code works, you just have to remove the comma at the end of the second linefile_str = f"dbfs:/mnt/dlsi2023/raw/ds_pet_finder_organization{x}.json", Should be file_str = f"dbfs:/mnt/dlsi2023/raw/ds_pet_finder_organization{x}.json" This is what is...
- 1 kudos
- 920 Views
- 0 replies
- 1 kudos
Generation AI - would love to know your thoughts
Hello, Community members! I hope this message finds you well. I wanted to reach out and inquire about your experience with DAIS and how you are absorbing all the valuable information it provides. Additionally, I would love to hear what aspects of Gen...
- 920 Views
- 0 replies
- 1 kudos
- 810 Views
- 0 replies
- 0 kudos
4-7-2023 [Back End Service Not Available] - DBCE
Dear DBricks Team, Could you kindly look at the Back End Service issues? Thanks a Million.
- 810 Views
- 0 replies
- 0 kudos
- 4639 Views
- 3 replies
- 1 kudos
How to refresh materialized view (Delta Live Table) without running a pipeline every time.
Hello, My requirement is to created a materialized view (Live table) from a downstream table. The down stream table gets refreshed frequently and hence the materialized view needs to be recalculated. I don't want the pipe line to be in continuous mod...
- 4639 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Chengcheng I am fine with manual refresh also and have tried "Refresh Table <TableName>" command but it doesn't refreshes the table with new data.The Full refresh command "REFRESH TABLE <tableName> FULL; is giving below error inside notebook.REFR...
- 1 kudos
