- 6580 Views
- 5 replies
- 1 kudos
Im looking at using Databricks internally for some Data Science projects. I am however very confused to how the pricing works and would like to obviously avoid high spending right now. Internal documentation and within Databricks All-Purpose Compute...
- 6580 Views
- 5 replies
- 1 kudos
Latest Reply
Hello,I was able to get a very precise cost of Azure Databricks Clusters and Computers jobs, using the Microsoft API and Databricks APIThen I wrote a simple tool to extract and manipulate the API results and generate detailed cost reports that can be...
4 More Replies
- 2156 Views
- 2 replies
- 0 kudos
Does auto-optimize work for existing tables only or will it work for both existing and new tables when we enable at the cluster config level?
- 2156 Views
- 2 replies
- 0 kudos
Latest Reply
If you're referring to Delta Tables, Auto-Optimize will work for both.For new tables:CREATE TABLE student (id INT, name STRING, age INT) TBLPROPERTIES (delta.autoOptimize.optimizeWrite = true, delta.autoOptimize.autoCompact = true)For existing tables...
1 More Replies
by
Priyag1
• Honored Contributor II
- 2294 Views
- 2 replies
- 11 kudos
Query parameters in dashboardsQueries can optionally leverage parameters or static values. When a visualization based on a parameterized query is added to a dashboard, the visualization can either be configured to use a:Widget parameterWidget paramet...
- 2294 Views
- 2 replies
- 11 kudos
Latest Reply
Hi, I build a dashboard with dashboard parameters, it works pretty easy!The advantage of dashboard parameters is that you do not have to set a default (it can be: all). This is convenient when you need to filter on values that change every time the q...
1 More Replies
- 18544 Views
- 11 replies
- 52 kudos
If I am new to Databricks and is aiming to get qualification some point Dec2022 or Jan 2023, should I be studying the material Data Engineering with Databricks V2 or V3?
- 18544 Views
- 11 replies
- 52 kudos
Latest Reply
I would suggest to go for V3 because the course Data Engineering with Databricks (V3) is the latest version as of now and was released on 14th October 2022. So, this version would have more topics in comparison to V2.
10 More Replies
- 1938 Views
- 3 replies
- 14 kudos
I took a certified of DE exam (version 2). Do I receive a new badge or certified when I pass newest version of DE exam?I'm going to take that and review my knowlege.
- 1938 Views
- 3 replies
- 14 kudos
Latest Reply
Hi @Gam Nguyen I think there is no new badge for this one
2 More Replies
- 11242 Views
- 5 replies
- 3 kudos
Hi there, I ran into issue with Databricks repo. When I create new repo, it doesn't pull default branch from GitLab. I have default branch 'development', but Databricks repo pulls other branch.Moreover this just now added repo already contains change...
- 11242 Views
- 5 replies
- 3 kudos
Latest Reply
I had a similar issue, where a few notebooks popped up as changed in every branch I created (even though they were not touched). So first I manually did the discard changes thing, but that was not a solution as with every new branch they were there ...
4 More Replies
- 2283 Views
- 2 replies
- 0 kudos
Hi All,I am new to databricks need some understanding for my requirement .our requirement:a: we have zip file in azure blob storage and we are bringing that file to dbfs and unzip that file and executing our transformations in multiple steps (3 steps...
- 2283 Views
- 2 replies
- 0 kudos
Latest Reply
Hi @praveen rajak Does @Debayan Mukherjee response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
1 More Replies
by
dslin
• New Contributor III
- 2627 Views
- 3 replies
- 2 kudos
Hi,I'm quite new here. I'm trying to perform a deployment of python file with dbx command. The file contains libraries to be installed. How may I deploy the file (together with its dependencies) to databricks?Here are the commands I currently run:`db...
- 2627 Views
- 3 replies
- 2 kudos
Latest Reply
Hi @Di Lin Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
2 More Replies