cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Hareesh1980
by New Contributor
  • 2110 Views
  • 0 replies
  • 0 kudos

Calculation on a dataframe

Hi, I need to do following calculations on a dataframe. It should be done for each period and calculated value will be used for next period's calculation. Adding sample data and formula from excel here. Thanks in advance for your help.Need to calcula...

  • 2110 Views
  • 0 replies
  • 0 kudos
mipayof346
by New Contributor
  • 1742 Views
  • 1 replies
  • 0 kudos

New to databricks, which certification should I start?

I’m new to Databricks and don’t have any practical experience. I can write SQL code fluently. I’d like to get Databricks certified, which exam should I start to get a good understanding of the fundamentals?Also, what are the most important basic conc...

  • 1742 Views
  • 1 replies
  • 0 kudos
Latest Reply
JodySF
Databricks Employee
  • 0 kudos

@mipayof346 it's best to start with the Lakehouse Fundamentals Accreditation (free course, free assessment). Then I recommend that you move to the Data Analyst certification path. Details on both can be found here: https://www.databricks.com/learn/ce...

  • 0 kudos
vk217
by Contributor
  • 1855 Views
  • 1 replies
  • 1 kudos

Resolved! Selective column loader unity catalog

I am loading a table into a data frame using df = spark.table(table_name) Is there a way to load only the required columns? The table has more than 50+ columns and I only need a handful of column.

  • 1855 Views
  • 1 replies
  • 1 kudos
Latest Reply
daniel_sahal
Esteemed Contributor
  • 1 kudos

@vk217 Simply just use select function, ex.df = spark.read.table(table_name).select("col1", "col2", "col3")

  • 1 kudos
6502
by New Contributor III
  • 4349 Views
  • 2 replies
  • 2 kudos

Terraform provider, problemi in creating dependant task!

Hola all.I have a serious problem, perhaps I missed something, but can't find the solution. I need to push a job description to Databricks using TERRAFORM. I wrote the code, but there is no way to get a task dependant from two different tasks.Conside...

  • 4349 Views
  • 2 replies
  • 2 kudos
Latest Reply
daniel_sahal
Esteemed Contributor
  • 2 kudos

@6502 You need to make multiple depends_on blocks for each dependency, ex.depends_on { task_key = "ichi" } depends_on { task_key = "ni" }

  • 2 kudos
1 More Replies
Sai1098
by New Contributor II
  • 2202 Views
  • 1 replies
  • 0 kudos

Reading tables from different databricks clusters

Hello,My organization uses two cluster for dev and Prod. We mount our azure blobs on to delta lake to store the delta tables. Prod has bunch of data and dev has limited data. I want to move the data from prod to dev for testing purposes. How can I do...

  • 2202 Views
  • 1 replies
  • 0 kudos
Latest Reply
btafur
Databricks Employee
  • 0 kudos

It depends on the current setup, how your clusters are working right now and how your data is stored. One alternative could be mount the Dev storage to the Prod cluster and execute a DEEP CLONE (https://docs.databricks.com/en/sql/language-manual/delt...

  • 0 kudos
shihs
by New Contributor
  • 2348 Views
  • 0 replies
  • 0 kudos

Can not read data from GCS

I am trying to use Databricks to read data on Google Cloud Storage (GCS) with Databricks on Google Cloud. I followed the steps from https://docs.gcp.databricks.com/storage/gcs.html.I have tried Access GCS buckets using Google Cloud service accounts o...

  • 2348 Views
  • 0 replies
  • 0 kudos
hafeez
by Contributor
  • 2022 Views
  • 0 replies
  • 0 kudos

Repos section in Admin Settings Page is not visible

Hello,We have multitple workspace of Azure Databricks and we recently noticed that in some of the Administrator workspace settings, we are not able to Repos section (https://learn.microsoft.com/en-us/azure/databricks/repos/repos-setup#--restrict-usag...

  • 2022 Views
  • 0 replies
  • 0 kudos
Kaviana
by New Contributor III
  • 2650 Views
  • 1 replies
  • 0 kudos

Connection VPC AWS in Databricks for extract data Oracle Onpremise

 Hi, help meHow can I consume a VPC when it is already anchored in the "network" of Databricks to extract information from a server that really made ping and works

  • 2650 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaviana
New Contributor III
  • 0 kudos

Hello @Retired_mod I have already configured in "Cloud resources"/ "Network" the Private endpoint links and the linked VPC in ibabricks. How can I connect to Oracle using the EC2 virtual machine?Thank u

  • 0 kudos
simran_27
by New Contributor
  • 1238 Views
  • 1 replies
  • 0 kudos

Error while attempt to give Lakehouse fundamentals exam

I would like to know why I am getting this error when I tried to earn badges for lake house fundamentals. I can't access the quiz page. Can you please help on this?I am getting 403: Forbidden error.

  • 1238 Views
  • 1 replies
  • 0 kudos
Latest Reply
APadmanabhan
Databricks Employee
  • 0 kudos

Hi @simran_27 could you please try using the link 

  • 0 kudos
ushnish_98
by New Contributor III
  • 2096 Views
  • 2 replies
  • 0 kudos

Resolved! Databricks Certificate

I cleared Databricks Associate level certification on 25th September. But, I am yet to receive my certificate from Databricks. I raised a ticket for the same but got no response from the suppport team.

  • 2096 Views
  • 2 replies
  • 0 kudos
Latest Reply
APadmanabhan
Databricks Employee
  • 0 kudos

Hello There, Can you share the ticket number, note that we have a high influx of cases and the team is actively working on clearing the backlogs and you should be able to receive the reply in the next 48 hours. I appreciate the patience.

  • 0 kudos
1 More Replies
rajib_bahar_ptg
by New Contributor III
  • 5286 Views
  • 5 replies
  • 5 kudos

Databricks workspace unstable

Our company's databricks workspace is unstable lately. It can't launch any compute cluster. I have never seen this issue. In addition to this issues, I have seen storage credential error on main unity catalog. Why would this happen AWS Databricks ins...

  • 5286 Views
  • 5 replies
  • 5 kudos
Latest Reply
rajib_bahar_ptg
New Contributor III
  • 5 kudos

Hello @Retired_mod and @jose_gonzalez ,I couldn't locate the support ticket we opened. How can we track that ticket down? It came from the peopletech.com domain. If it is more efficient to create another ticket, please let me know. Let us know the UR...

  • 5 kudos
4 More Replies
Sujitha
by Databricks Employee
  • 2597 Views
  • 1 replies
  • 6 kudos

Webinar: Accelerate Data and AI Projects With Databricks Notebooks

Register now: October 24, 2023 | 8:00 AM PT Use new capabilities in Databricks Notebooks to speed up innovation. This webinar will walk you through the features that are designed to take the manual effort and delays out of building and deploying dat...

Screenshot 2023-09-22 at 3.47.19 PM.png
  • 2597 Views
  • 1 replies
  • 6 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 6 kudos

This will help databricks user to speed up development.

  • 6 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels