- 1182 Views
- 1 replies
- 1 kudos
Resolved! Find out the cluster hung state in azure databricks
Hi, I Have to capture the info when cluster is in hung state for example any cluster is running from last 2 hrs. But it doesn't show any progress. Where can I get hung details.
- 1182 Views
- 1 replies
- 1 kudos
- 1 kudos
You can look at the sparkUI of the cluster to get what is happening on the cluster.Debugging with the Apache Spark UI - Azure Databricks | Microsoft Learn
- 1 kudos
- 622 Views
- 0 replies
- 0 kudos
Resources for Data+AI Summit Talks
Hi,where do I find the resource mentioned in the latest talks of the Data+AI Summit 2023? In the videos the speaker mention, that there are resources avaible for example in the talk "Best Practices for Setting Up Databricks SQL at Enterprise Scale" (...
- 622 Views
- 0 replies
- 0 kudos
- 2079 Views
- 3 replies
- 5 kudos
Resolved! Databricks - Server/Clusters issues
Hello, Do some other users have some issues with Databricks today (Clusters, connection, server)?I'm experiencing slowness and failure when running notebooks. My Databricks is on Azure West Europe in Premium.
- 2079 Views
- 3 replies
- 5 kudos
- 5 kudos
Hi team,Users may experience slow rendering of notebooks, clusters, and other Databricks user interfaces. Our engineering team is engaged and our status page is updated.https://status.azuredatabricks.net/Some preliminary explanation on Azure website ...
- 5 kudos
- 689 Views
- 0 replies
- 0 kudos
DBR 11.3 LTS - Specify spark.app.id for python notebook task
Hi, I use Terraform databricks_job to submit a job with many tasks. IFAIK, each task is a separated Spark Application with a specific applicationId (https://spark.apache.org/docs/3.1.3/api/python/reference/api/pyspark.SparkContext.applicationId.html)...
- 689 Views
- 0 replies
- 0 kudos
- 1893 Views
- 1 replies
- 1 kudos
Resolved! Not able to login to to Partner Acedamy
Hi,I have created my account using my email address on https://community.databricks.com, and my credentials work on https://community.databricks.com.But, when I try login using the same credentials on partner-academy.databricks.com, my login fails. ...
- 1893 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @nikhiljatiwal,Thank you for reaching out!Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 1 kudos
- 1318 Views
- 1 replies
- 2 kudos
Resolved! First time at Data + AI summit
It’s a wonderful summit! I met so many women in tech during this event, it’s a very good opportunity to exchange thought and ideas with such a divers ppl to modernize Data & AI! I actually join here from Japan, and unfortunately not so many women in ...
- 1318 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks Sakura for dropping by at the Community cove and asking these questions. Together folks like yourself can move the needle and bring in more women to Data and AI space by being inspirational. I am sure you will attract many of us to be in this ...
- 2 kudos
- 648 Views
- 0 replies
- 1 kudos
Generation AI - would love to know your thoughts
Hello, Community members! I hope this message finds you well. I wanted to reach out and inquire about your experience with DAIS and how you are absorbing all the valuable information it provides. Additionally, I would love to hear what aspects of Gen...
- 648 Views
- 0 replies
- 1 kudos
- 562 Views
- 0 replies
- 0 kudos
4-7-2023 [Back End Service Not Available] - DBCE
Dear DBricks Team, Could you kindly look at the Back End Service issues? Thanks a Million.
- 562 Views
- 0 replies
- 0 kudos
- 3127 Views
- 3 replies
- 1 kudos
How to refresh materialized view (Delta Live Table) without running a pipeline every time.
Hello, My requirement is to created a materialized view (Live table) from a downstream table. The down stream table gets refreshed frequently and hence the materialized view needs to be recalculated. I don't want the pipe line to be in continuous mod...
- 3127 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Chengcheng I am fine with manual refresh also and have tried "Refresh Table <TableName>" command but it doesn't refreshes the table with new data.The Full refresh command "REFRESH TABLE <tableName> FULL; is giving below error inside notebook.REFR...
- 1 kudos
- 2964 Views
- 5 replies
- 2 kudos
Resolved! Please share your favorite talks from the Databricks Data+AI Summit 2023 :)
I thought this would be a good place to share your favorite talks from the Databricks Data+AI Summit 2023 Heck feel free to share your favorite talk from a different conference or previous summit Today's talk 'Delta-rs, Apache Arrow, Polars, WASM: Is...
- 2964 Views
- 5 replies
- 2 kudos
- 568 Views
- 0 replies
- 0 kudos
Workflow permissions
I am having an issue where my permissions aren't being passed to workflows. I can use the same cluster to access files in an S3 repo but if I try to do spark-submit or a jar task on workflows I am unable to reach my buckets. I am trying to use Unity ...
- 568 Views
- 0 replies
- 0 kudos
- 627 Views
- 0 replies
- 0 kudos
Using Delta Live Tables Structured Streaming for small batches?
Hi Databricks community, I have a blob storage folder that will receive file drops, with 3 files in each distinct drop: ex. Files A1,B1,C1 is one drop, A2,B2,C2 is the next drop. The DLT pipeline I've got setup has a lot of joins and aggregations, cu...
- 627 Views
- 0 replies
- 0 kudos
- 547 Views
- 0 replies
- 0 kudos
Certification Number required to register for external certificate in organization.
Hi Databricks Team,@Anonymous I have successfully completed databricks certification and received the certificate with a URL in which i can see my certificate and badge respectively for databricks data engineering exam and Apache spark developer exa...
- 547 Views
- 0 replies
- 0 kudos
- 1091 Views
- 0 replies
- 0 kudos
Update a part of parquet partition is deleting existing data.
I have 4 months of data and I partitioned it on Year and Month column, so my parquet partition looks like Data is present inside each monthly partition folder in parquet format.Then I loaded data for July and also modified some values in August. Afte...
- 1091 Views
- 0 replies
- 0 kudos
- 3710 Views
- 6 replies
- 6 kudos
Resolved! Setting Up Databricks Workspace
Hi Team, Need some advice on setting up a single workspace or multiple workspaces.Please read below for the problem statement - There is an ADLS account says ADLS1 which has a root folder say root1This root1 folder has multiple sub foldersteam1team2...
- 3710 Views
- 6 replies
- 6 kudos
- 6 kudos
Hi @Loki Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your que...
- 6 kudos
