cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

nielsehlers
by New Contributor
  • 518 Views
  • 1 replies
  • 1 kudos

Visualizations ignore Timezones

Databricks inline visualizations (bar charts / line charts) etc. ignore Timezones and always display the UTC Time on the X-Axis.

  • 518 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @nielsehlers! As a workaround, you can use the from_utc_timestamp() function to convert UTC timestamps to your desired time zone before visualising:SELECT from_utc_timestamp(column_name, 'Asia/Kolkata’) AS alias_name FROM table_name;

  • 1 kudos
user1234567899
by New Contributor II
  • 661 Views
  • 2 replies
  • 0 kudos

Lineage not visible for table created in DLT

Hello,I've been struggling for two days with missing lineage information for the silver layer table, and I'm unsure what I'm doing incorrectly.I have a DLT pipeline with DPM public preview enabled. Data is ingested from an S3 bucket into the bronze t...

  • 661 Views
  • 2 replies
  • 0 kudos
Latest Reply
obitech01
New Contributor II
  • 0 kudos

I'm having the same exact issue as the poster above.I'm using a newly created DLT pipeline as of April 1st 2025 (Unity catalog enabled, Serverless).  I get lineage for all tables and views involved in my pipeline except for the streaming table.The st...

  • 0 kudos
1 More Replies
aranjan99
by New Contributor III
  • 748 Views
  • 4 replies
  • 0 kudos

Disabled billing system schema accidentally and now I cannot enable it again

We accidentally disabled billing system table schema and now getting this error on re-enabling it:Error: billing system schema can only be enabled by Databricks.How can we resolve the same. We have not purchased any of the support contracts and hence...

  • 748 Views
  • 4 replies
  • 0 kudos
Latest Reply
aranjan99
New Contributor III
  • 0 kudos

00640919

  • 0 kudos
3 More Replies
prashantjjain33
by New Contributor II
  • 387 Views
  • 3 replies
  • 0 kudos

databricks_error_message:REQUEST_LIMIT_EXCEEDED:

A databricks job failed unexpectedly with below error. There ware only 5 jobs running at that time and no major operations. what could be the root cause and how can we avoid this in futureCluster '0331-xxxxxx-zs8i8pcn' was terminated. Reason: INIT_SC...

  • 387 Views
  • 3 replies
  • 0 kudos
Latest Reply
saurabh18cs
Honored Contributor
  • 0 kudos

are you generating any databricks tokens in this process? if yes there is a limit of 600.

  • 0 kudos
2 More Replies
kleanthis
by New Contributor III
  • 449 Views
  • 1 replies
  • 0 kudos

Resolved! dbutls.fs.cp() fails in Runtime 16.3 Beta, when using abfss://

Hello,I am not sure if this is the right place to post this, however, I reporting what seems to me, a breaking issue with 16.3 Beta Runtime, when performing dbutils.fs.cp() operations between abfss://This is not a permissions issue — let's get that o...

  • 449 Views
  • 1 replies
  • 0 kudos
Latest Reply
kleanthis
New Contributor III
  • 0 kudos

To close off my loop: The ClassCastException has been resolved in 16.3

  • 0 kudos
JangaReddy
by New Contributor
  • 337 Views
  • 1 replies
  • 0 kudos

Serverless Access

Hi Team,Can you help us, how to restrict serverless access to only specific users/groups. (through Workspace admin /account admin)?Regards,Phani

  • 337 Views
  • 1 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

you cannot at the moment.  I suppose that is something that is coming soon (many complaints about that).It is only possible to toggle serverless compute on/off.

  • 0 kudos
lezwon
by New Contributor II
  • 423 Views
  • 2 replies
  • 1 kudos

Resolved! At least 1 "file_arrival" blocks are required.

Hi folks, I'm trying to set up a databricks asset bundle for a job to load some product data into databricks. This job was created in databricks and loads the data from a location hardcoded into the notebook (for now). It is supposed to run every 3 h...

  • 423 Views
  • 2 replies
  • 1 kudos
Latest Reply
Tharani
New Contributor III
  • 1 kudos

I think since it is a scheduled job, you have to explicitly specify a cron-based schedule instead of using file_arrival in trigger section in yaml file.

  • 1 kudos
1 More Replies
antonioferegrin
by New Contributor
  • 834 Views
  • 4 replies
  • 1 kudos

FeatureEngineeringClient and Databricks Connect

Hello everyone, I want to use Databricks Connect to connect externally to my clusters and run code, and while Databricks connect works without any issue, like this: ```from databricks.sdk.core import Config config = Config(cluster_id="XXXX")spark = S...

  • 834 Views
  • 4 replies
  • 1 kudos
Latest Reply
leopoloc0
New Contributor II
  • 1 kudos

I just accomplished by modifying the DatabricksClient by adding the feature_store_uri parameter to it and passing it to each call of get_host_creds. Lets see if databricks releases this simple change soon...

  • 1 kudos
3 More Replies
Vittorio
by New Contributor II
  • 285 Views
  • 1 replies
  • 1 kudos

Month-on-month growth with pivot

I need to create pivot tables with data on revenue/costs presented monthly and I need to show the month on month growth and it seems like mission impossible with Dashboards on SQL warehouse despite being quite obviously a very typical task.Pivot tabl...

  • 285 Views
  • 1 replies
  • 1 kudos
Latest Reply
Brahmareddy
Honored Contributor III
  • 1 kudos

Hi Vittorio,How are you doing today? , As per my understanding, You're absolutely right—creating a proper pivot table with dynamic month-over-month (MoM) growth in Databricks SQL Dashboards is surprisingly tricky for such a common use case. The built...

  • 1 kudos
Dharinip
by New Contributor III
  • 664 Views
  • 4 replies
  • 3 kudos

Resolved! Incrementalization issue in Materialized views

I am trying to implement the incremental updates to the Materialized views. The source is the Could you tell how to resolve the following issue? {  "planning_information": {    "technique_information": [      {        "maintenance_type": "MAINTENANCE...

  • 664 Views
  • 4 replies
  • 3 kudos
Latest Reply
Brahmareddy
Honored Contributor III
  • 3 kudos

Thanks Dharinip. Good day.

  • 3 kudos
3 More Replies
standup1
by Contributor
  • 2863 Views
  • 3 replies
  • 1 kudos

Recover a deleted DLT pipeline

Hello,does anyone know how to recover a deleted dlt pipeline, or at least recover deleted tables that were managed by the dlt pipeline ? We have a pipeline that stopped working and throwing all kind of errors, so we decided to create a new one and de...

  • 2863 Views
  • 3 replies
  • 1 kudos
Latest Reply
Nishair05
New Contributor II
  • 1 kudos

Found out a way to recover the tables. But it seems like we need to recover the pipeline as well. Any idea on how to recover the pipeline?

  • 1 kudos
2 More Replies
Phani1
by Valued Contributor II
  • 853 Views
  • 1 replies
  • 0 kudos

Dashboard deployment

Hi Team,How to deploy a dashboard in one databricks account to another databricks account/client account without revealing the underlying notebook code.Regards,Phani

  • 853 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @Phani1! Could you confirm whether you're referring to an AI/BI Dashboard or a Notebook Dashboard?

  • 0 kudos
balu_9309
by New Contributor II
  • 637 Views
  • 3 replies
  • 0 kudos

databricks job runs connect with powerbi

Hi i have databricks jobs run how to connect power bi app or that runs save in blob or delta table

  • 637 Views
  • 3 replies
  • 0 kudos
Latest Reply
chexa_Wee
New Contributor III
  • 0 kudos

You can connect Databricks to Power BI using the "Get Data" option. To do this, you need to provide the necessary cluster details and then connect to the Delta tables in Databricks. This allows Power BI to access and analyze data stored in Databricks...

  • 0 kudos
2 More Replies
RolandCVaillant
by New Contributor II
  • 880 Views
  • 1 replies
  • 1 kudos

Databricks notebook dashboard export

After the latest Databricks update, my team can no longer download internal notebook dashboards in the dashboard view as .html files. When downloading, the entire code is always exported as an .html file. Is there a way to export just the notebook da...

  • 880 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @RolandCVaillant! For AI/BI dashboards, you can download the rendered view as a PDF after publishing the dashboard. However, there isn’t a direct way for notebook dashboards. Instead, you can export the notebook by selecting File > Export in th...

  • 1 kudos
carlos_tasayco
by New Contributor III
  • 251 Views
  • 1 replies
  • 0 kudos

Databricks app share with people out of your organization

Yes, that is it, Can we share our app with people who are not from organization?https://www.databricks.com/blog/introducing-databricks-apps

  • 251 Views
  • 1 replies
  • 0 kudos
Latest Reply
Shua42
Databricks Employee
  • 0 kudos

Currently, apps can only be accessed by users in the workspace where it is deployed.  One workaround solution, depending on the amount of external users you want to grant access to, would be the following: Create a new workspace.Add external users to...

  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels