- 4040 Views
- 5 replies
- 2 kudos
Resolved! Databricks Asset Bundles and Dashboards
Hi Databricks Team! I saw in the documentation that Databricks Asset Bundles will support Dashboards as well in the future. Could you please share, when we can expect that feature to be available? Is it coming only for the new Lakeview dashboards or ...
- 4040 Views
- 5 replies
- 2 kudos
- 590 Views
- 1 replies
- 0 kudos
I’m join in datbricks community
nice to meet you guys!!
- 590 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Ken1111888, We're thrilled to hear that you had a great experience at DAIS 2023! Your feedback is valuable to us, and we appreciate you taking the time to share it on the community platform. We wanted to let you know that the Databricks Communit...
- 0 kudos
- 750 Views
- 1 replies
- 0 kudos
DATA+AI Summit Day 4
The Expo Booths are a treasure hunt, met many interesting companies doing wonderful things in Generative AI #Data+AISummit
- 750 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Daniel-K, We're thrilled to hear that you had a great experience at DAIS 2023! Your feedback is valuable to us, and we appreciate you taking the time to share it on the community platform. We wanted to let you know that the Databricks Community T...
- 0 kudos
- 949 Views
- 1 replies
- 2 kudos
MLOps on Azure: API vs SDK vs Databricks CLI?
Hello fellow community members,In our organization, we have developed, deployed and utilized an API-based MLOps pipeline using Azure DevOps.The CI/CD pipeline has been developed and refined for about 18 months or so, and I have to say that it is pret...
- 949 Views
- 1 replies
- 2 kudos
- 2 kudos
Hello @ManiMar, In my opinion it's up to you to choose, and you're in the right path by comparing the pros/cons of each approach. I'd like to highlight that one of the advantages of the Databricks CLI is being able to use Databricks Asset Bundles. I...
- 2 kudos
- 596 Views
- 1 replies
- 0 kudos
Got suspended which attempting Databricks certified Associate Developer for Apache Spark 3.0 Python
Hi Team, My Databricks Certified exam got suspended.I was continuously in front of the camera and an alert appeared and then my exam resumed. Then later a support person asked me to show the entire table and entire room, I have showed around the room...
- 596 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Aslam_shaikk99, I'm sorry to hear your exam was suspended. Thank you for filing a ticket with our support team. Please allow the support team 24-48 hours to resolve. In the meantime, you can review the following documentation: Room requirements B...
- 0 kudos
- 650 Views
- 1 replies
- 0 kudos
Learnings from DIAS
Flying in from Singapore to attend the DIAS 2023 to evaluate the Databricks platforms and workflows for our cloud migration. The Advanced Data engineering course provides alot of insights and details for many niche use-cases. This experience will he...
- 650 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Rafa82, We're thrilled to hear that you had a great experience at DAIS 2023! Your feedback is valuable to us, and we appreciate you taking the time to share it on the community platform. We wanted to let you know that the Databricks Community T...
- 0 kudos
- 727 Views
- 1 replies
- 0 kudos
Data + AI Summit Experience
Hey everyone,currently attending Data + AI Summit and definitely seeing value of implementing Streaming and Unity Catalog in our current pipelines. Thanks to Tom for a great Training Session on Advanced Data Engineering! restlessmodem
- 727 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @restlessmodem, We're thrilled to hear that you had a great experience at DAIS 2023! Your feedback is valuable to us, and we appreciate you taking the time to share it on the community platform. We wanted to let you know that the Databricks Comm...
- 0 kudos
- 843 Views
- 1 replies
- 0 kudos
Great experience at Summit 23!
I came across Databricks last year when I was working on a client project. Client had data in large volume (over 100m rows) and after transforming the data it eventually went up to 50 billion records. Databricks helped my team to drastically improved...
- 843 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Rafa82, We're thrilled to hear that you had a great experience at DAIS 2023! Your feedback is valuable to us, and we appreciate you taking the time to share it on the community platform. We wanted to let you know that the Databricks Community T...
- 0 kudos
- 1319 Views
- 1 replies
- 0 kudos
Insights and Learnings from Databricks Summit: A Deep Dive into Data Engineering and Delta Live Tab
1. Why am I here?I am present at the Databricks summit because I'm motivated to deepen my understanding of its groundbreaking technology. I'm passionate about learning how to leverage this advanced platform to better optimize and streamline the proc...
- 1319 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Rafa82, We're thrilled to hear that you had a great experience at DAIS 2023! Your feedback is valuable to us, and we appreciate you taking the time to share it on the community platform. We wanted to let you know that the Databricks Community Tea...
- 0 kudos
- 705 Views
- 1 replies
- 0 kudos
Data Engineering Hub
I have been using databricks from last 2 years and have got involved with arranging when I was in my masters. Databricks did not made data engineering easy for me but helped me become a data engineer. I got into this 2 all day training from Advanced ...
- 705 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @AbbasNvs, We're thrilled to hear that you had a great experience at DAIS 2023! Your feedback is valuable to us, and we appreciate you taking the time to share it on the community platform. We wanted to let you know that the Databricks Community T...
- 0 kudos
- 1431 Views
- 5 replies
- 0 kudos
DataBricks Certification Exam Got Suspended. Require support for the same.
Hello Team, I encountered Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam without giving any reaso...
- 1431 Views
- 5 replies
- 0 kudos
- 0 kudos
@Kaniz @Cert-Team @Sujitha I have sent multiple emails to the Support team to reschedule my exam with Date, but I have not received any confirmation from them.Please look into this issue and reschedule the exam as soon as possible. This certification...
- 0 kudos
- 1080 Views
- 1 replies
- 1 kudos
Resolved! capture return value from databricks job to local machine by CLI
Hi,I want to run a python code on databricks notebook and return the value to my local machine. Here is the summary:I upload files to volumes on databricks. I generate a md5 for local file. Once the upload is finished, I create a python script with t...
- 1080 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @pshuk, You could check the below CLI commands: get-run-output Get the output for a single run. This is the REST API reference, which relates to the CLI command: https://docs.databricks.com/api/workspace/jobs/getrunoutput export-run There's al...
- 1 kudos
- 1814 Views
- 2 replies
- 0 kudos
Resolved! Error Code: METASTORE_DOES_NOT_EXIST when using Databricks API
Hello, I'm attempting to use the databricks API to list the catalogs in the metastore. When I send the GET request to `/api/2.1/unity-catalog/catalogs` , I get this error I have checked multiple times and yes, we do have a metastore associated with t...
- 1814 Views
- 2 replies
- 0 kudos
- 0 kudos
Turns out I was using the wrong databricks host url when querying from postman. I was using my Azure instance instead of my AWS instance.
- 0 kudos
- 1315 Views
- 1 replies
- 0 kudos
Parallel kafka consumer in spark structured streaming
Hi,I have a spark streaming job which reads from kafka and process data and write to delta lake.Number of kafka partition: 100number of executor: 2 (4 core each)So we have 8 cores total which are reading from 100 partitions of a topic. I wanted to un...
- 1315 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @subham0611, In Spark Streaming, the number of threads is not explicitly controlled by the user. Instead, the parallelism is determined by the number of partitions in the Kafka topic. Each partition is consumed by a single Spark task. When you ...
- 0 kudos
- 943 Views
- 1 replies
- 1 kudos
how to develop Notebooks on vscode for git repos?
I am able to use vscode extension + databricks connect to develop Notebooks on my local computer and run them on my databricks cluster. However I can not figure out how to develop the Notebooks that have the file `.py` extension but identified by Dat...
- 943 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @MohsenJ, You can indeed develop and run Databricks notebooks with .py extension on your local computer using the Databricks extension for Visual Studio Code and Databricks Connect1. Here are the steps you need to follow: Enable Databricks Con...
- 1 kudos
