SQL Merge not adding new columns to delta table error is: cannot resolve Target AuditUpdateDate in UPDATE clause given columns in Sourcethis config is set: spark.conf.set("spark.databricks.delta.schema.autoMerge.enabled",True)We're using DBR 12.2 LTS...
Hi I completed Databricks Lakehouse Fundamentals exam but didn't got my badge
@saqib_rasool plz submit tikcit to support team https://help.databricks.com/s/contact-us?ReqType=training
I am trying to setup a recon activity between GCP Pub-Sub and databricks, Is there any way to fetch the last 24hrs record count from Pub-Sub?I tried but not got any direct solution for it, It will be great if any one can suggest me the way t#pubsub, ...
Hi @Ajay-Pandey Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Cheers!
I am attempting to apply Mosaic's `grid_pointascellid` method on a spark dataframe with `lat`, `lon` columns.```import pyspark.sql.functions as F# Create a Spark DataFrame with a lat and lon columndf = spark.createDataFrame([("point1", 10.0, 20.0),("...
@kll This error appears because the function grid_pointascellid expects a Double type column and a Decimal column type was provided as input.To overcome this, before you apply the grid_pointascellid, I would recommend casting the columns lat and lon....
I created a workspace and a metastore(following the long tedious instructions). I assigned the workspace to the metastore. workspace -> Data, I can see the metastore link on the top left of the page. Through it I configured the permissions (giving me...
Answering my own question - all that is needed is to refresh the Data web page!
Hi all,I hope you could help me to figure out what I am missing.I'm trying to do a simple thing. To read the data from the data ingestion zone (csv files saved to Azure Storage Account) using the Delta Live Tables pipeline and share the resulting tab...
Sorry, I think I've created the post in the wrong thread. Created the same post in the Community Cove.
Hi,I attended Databricks certified associate developer for apache spark 3.0- scala on 09 July 2023(today). At 7.35pm suddenly got a notice stating that due to eye movement away from exam your exam got suspended.I had completed the exam and was at the...
Hi @nikhil018 Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
Brand new Databricks account, Workspace (Premium tier)New SQL Warehouse (Small, Pro)Brand new FiveTran trialI can't seem to use Partner Connect to connect to FiveTran in my trial. It appeared to work at first, and after attempting to sync with Stripe...
Hi @Anonymous ,So far, I haven't been able to get it to work. However, I really appreciate @Prabakar's answer and your follow-up. I'm still interpreting @Prabakar's wise advice; however, I think it mostly doesn't apply to this situation, as I'm using...
Hi, Would appreciate your help in understanding how to set up Git credentials for a Service Principal running jobs that contain notebooks in Repos (GitHub), so that it will have access to these notebooks. These credentials should not have any depende...
Hi @giladba Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your...
I am trying to connect to snowflake using data bricks but getting the below errornet.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver encountered a communication error. Message: Exception encountered for HTTP request: Connect to xxx.region.sn...
Hi @shivank25 Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
I am getting the error:Cannot create table ('`hive_metastore`.`MY_SCHEMA`.`MY_TABLE`'). The associated location ('dbfs:/user/hive/warehouse/my_schema.db/my_table') is not empty and also not a Delta table.When running drop table 'hive_metastore`.`MY_S...
Hi @gilo12 Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your ...
Hi everyone!I'm facing this issue on databricks workspace.I do have permissions to add comments on data explorer, but some members of my team don't have those permissions.Where can I configure this and give them permission?
To grant the permissions on the same page that you have shared, click the permissions tab, and select grant.then from the dropdown list select the user or group and give the respective permissions.
Dear All - I want to schedule a job in Workflow for every 30 days. So, when i try the below CRON expression it gives invalid cron expression. Anyone who already implemented this?0 0 */30 * *
@pcbzmani Could you try 0 0 0 1/30 * ? *Databricks uses Quartz cron syntax and we have to provide 1/30 for day to achieve a schedule for 30 days.
I'm working on small POC to create a data pipeline which get triggered from ADF while having some parameters from ADF but my pipeline fails showing the attaching error:Operation on target Compute Daily Product Revenue failed: Databricks execution fai...
Hi @qasimhassan Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you. Than...
community edition is available?I tried to login but it is redirecting me differnt pages.
Hi ,Please note that community and is completely fiffernt objectives but you are refering community for disscussion foroum.Unlike the Databricks Free Trial, Community Edition doesn’t require that you have your own cloud account or supply cloud compu...
