cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Engineering & Streaming

Forum Posts

MaOthman2110
by New Contributor
  • 623 Views
  • 2 replies
  • 0 kudos

can't login back to databricks community

Hello,I'm experiencing difficulty logging into the Databricks community despite using the correct username and password. Additionally, when attempting to reset my password, I haven't received any email notifications.

  • 623 Views
  • 2 replies
  • 0 kudos
Latest Reply
Aurelius
New Contributor II
  • 0 kudos

I am facing the same issue.

  • 0 kudos
1 More Replies
Shahe
by New Contributor
  • 613 Views
  • 2 replies
  • 0 kudos

Azure Databricks Metrics to Prometheus?

What is the best method to expose Azure Databricks metrics to Prometheus specifically? And is it possible to get the underlying Spark metrics also? All I can see clearly defined in the documentation is the serving endpoint metrics:https://learn.micro...

  • 613 Views
  • 2 replies
  • 0 kudos
Latest Reply
DanielB
New Contributor II
  • 0 kudos

HelloI don't have databricks running as pod in an aks cluster.. It's working on azure as saas.. What should I do the export the metrics to prometheus?

  • 0 kudos
1 More Replies
david1144
by New Contributor III
  • 153 Views
  • 1 replies
  • 0 kudos

Streaming data with kafka

What is the Best way for implement streaming data flow dron kafka to databricks (delta tables)

  • 153 Views
  • 1 replies
  • 0 kudos
Latest Reply
GCosta
New Contributor II
  • 0 kudos

Structured streaming:https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html

  • 0 kudos
Serena
by New Contributor
  • 80 Views
  • 0 replies
  • 0 kudos

Data architecture

Check out our platform architecture italgas-from-gas-pipelines-to-data-pipelines-fueling-our-reporting-with-the-latest-innovations-7f00e20ba115?source=social.linkedin 

  • 80 Views
  • 0 replies
  • 0 kudos
Gaurav19
by New Contributor III
  • 329 Views
  • 3 replies
  • 1 kudos

Resolved! Databricks API - list job runs doesn't have 'task run id'

Hi all,I am calling get job run list API to get all task ids and refer them in dbt-artifacts view created by dbt job run. The question is I can see 'task run id' on screen but it doesn't come back in api response? Is there a way to get it? I checked ...

Gaurav19_0-1718197141799.png
  • 329 Views
  • 3 replies
  • 1 kudos
Latest Reply
Gaurav19
New Contributor III
  • 1 kudos

Never mind, I have found task_run_id present in getrun api https://docs.databricks.com/api/azure/workspace/jobs/getrunI overlooked at first instance as it is buried under nested json structuretasks[] > run_id.This clarifies and solves my problem!

  • 1 kudos
2 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels