- 2126 Views
- 1 replies
- 1 kudos
Resolved! Beginner here. Which exam to do first?
I am new to Databricks and would like to learn and become certified. I have SQL knowledge.To get started, which exam should I do first so that I have a very good understanding of Databricks fundamentals and concepts?I was thinking of “Databricks Cert...
- 2126 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @mipayof346 The Data Engineer Associate certification exam assesses an individual’s ability to use the Databricks Lakehouse Platform to complete introductory data engineering tasks. This includes an understanding of the Lakehouse Platform and its ...
- 1 kudos
- 1093 Views
- 0 replies
- 0 kudos
Init script upload issue as file format in workspace using databricks cli
Trying to import init script from local to workspace location using databricks cli via YAML pipeline but it is getting uploaded as notebook.Need to upload it as file format using cli command as workspace init script should be in file format.Does anyo...
- 1093 Views
- 0 replies
- 0 kudos
- 2513 Views
- 1 replies
- 1 kudos
Is Datbricks-Salesforce already available?
Reference: Salesforce and Databricks Announce Strategic Partnership to Bring Lakehouse Data Sharing and Shared AI Models to Businesses - Salesforce NewsI was going through this article and wanted to know if anyone in community is planning to use this...
- 2513 Views
- 1 replies
- 1 kudos
- 2152 Views
- 0 replies
- 0 kudos
Calculation on a dataframe
Hi, I need to do following calculations on a dataframe. It should be done for each period and calculated value will be used for next period's calculation. Adding sample data and formula from excel here. Thanks in advance for your help.Need to calcula...
- 2152 Views
- 0 replies
- 0 kudos
- 1842 Views
- 1 replies
- 0 kudos
New to databricks, which certification should I start?
I’m new to Databricks and don’t have any practical experience. I can write SQL code fluently. I’d like to get Databricks certified, which exam should I start to get a good understanding of the fundamentals?Also, what are the most important basic conc...
- 1842 Views
- 1 replies
- 0 kudos
- 0 kudos
@mipayof346 it's best to start with the Lakehouse Fundamentals Accreditation (free course, free assessment). Then I recommend that you move to the Data Analyst certification path. Details on both can be found here: https://www.databricks.com/learn/ce...
- 0 kudos
- 1939 Views
- 1 replies
- 1 kudos
Resolved! Selective column loader unity catalog
I am loading a table into a data frame using df = spark.table(table_name) Is there a way to load only the required columns? The table has more than 50+ columns and I only need a handful of column.
- 1939 Views
- 1 replies
- 1 kudos
- 1 kudos
@vk217 Simply just use select function, ex.df = spark.read.table(table_name).select("col1", "col2", "col3")
- 1 kudos
- 4731 Views
- 2 replies
- 2 kudos
Terraform provider, problemi in creating dependant task!
Hola all.I have a serious problem, perhaps I missed something, but can't find the solution. I need to push a job description to Databricks using TERRAFORM. I wrote the code, but there is no way to get a task dependant from two different tasks.Conside...
- 4731 Views
- 2 replies
- 2 kudos
- 2 kudos
@6502 You need to make multiple depends_on blocks for each dependency, ex.depends_on { task_key = "ichi" } depends_on { task_key = "ni" }
- 2 kudos
- 2284 Views
- 1 replies
- 0 kudos
Reading tables from different databricks clusters
Hello,My organization uses two cluster for dev and Prod. We mount our azure blobs on to delta lake to store the delta tables. Prod has bunch of data and dev has limited data. I want to move the data from prod to dev for testing purposes. How can I do...
- 2284 Views
- 1 replies
- 0 kudos
- 0 kudos
It depends on the current setup, how your clusters are working right now and how your data is stored. One alternative could be mount the Dev storage to the Prod cluster and execute a DEEP CLONE (https://docs.databricks.com/en/sql/language-manual/delt...
- 0 kudos
- 2419 Views
- 0 replies
- 0 kudos
Can not read data from GCS
I am trying to use Databricks to read data on Google Cloud Storage (GCS) with Databricks on Google Cloud. I followed the steps from https://docs.gcp.databricks.com/storage/gcs.html.I have tried Access GCS buckets using Google Cloud service accounts o...
- 2419 Views
- 0 replies
- 0 kudos
- 2411 Views
- 0 replies
- 0 kudos
Blue/Green Deployment, Table Cloning, and Delta live table pipelines
this a rather complex question that addresses Databricks users only. Let me recap a bit of the context that produced it. In the attempt to adopt the Blue/Green deployment protocol, we found good applications of the table cloning capabilities offered ...
- 2411 Views
- 0 replies
- 0 kudos
- 1199 Views
- 0 replies
- 0 kudos
Deployment of Databricks Artifact Allowlist in Terraform
I would like to inquire about the deployment schedule for the Databricks artifact allowlist within Terraform.
- 1199 Views
- 0 replies
- 0 kudos
- 2086 Views
- 0 replies
- 0 kudos
Repos section in Admin Settings Page is not visible
Hello,We have multitple workspace of Azure Databricks and we recently noticed that in some of the Administrator workspace settings, we are not able to Repos section (https://learn.microsoft.com/en-us/azure/databricks/repos/repos-setup#--restrict-usag...
- 2086 Views
- 0 replies
- 0 kudos
- 2822 Views
- 1 replies
- 0 kudos
Connection VPC AWS in Databricks for extract data Oracle Onpremise
Hi, help meHow can I consume a VPC when it is already anchored in the "network" of Databricks to extract information from a server that really made ping and works
- 2822 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Retired_mod I have already configured in "Cloud resources"/ "Network" the Private endpoint links and the linked VPC in ibabricks. How can I connect to Oracle using the EC2 virtual machine?Thank u
- 0 kudos
- 3925 Views
- 0 replies
- 0 kudos
Can someone explain the key differences between Databricks
Hello Databricks community! I'm relatively new to Databricks and I'm trying to understand the distinctions between Databricks Community Edition and Databricks Workspace
- 3925 Views
- 0 replies
- 0 kudos
- 1290 Views
- 1 replies
- 0 kudos
Error while attempt to give Lakehouse fundamentals exam
I would like to know why I am getting this error when I tried to earn badges for lake house fundamentals. I can't access the quiz page. Can you please help on this?I am getting 403: Forbidden error.
- 1290 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @simran_27 could you please try using the link
- 0 kudos
