- 4725 Views
- 4 replies
- 1 kudos
SparkException: Job aborted due to stage failure when attempting to run grid_pointascellid
I am attempting to apply Mosaic's `grid_pointascellid` method on a spark dataframe with `lat`, `lon` columns.```import pyspark.sql.functions as F# Create a Spark DataFrame with a lat and lon columndf = spark.createDataFrame([("point1", 10.0, 20.0),("...
- 4725 Views
- 4 replies
- 1 kudos
- 1 kudos
@kll This error appears because the function grid_pointascellid expects a Double type column and a Decimal column type was provided as input.To overcome this, before you apply the grid_pointascellid, I would recommend casting the columns lat and lon....
- 1 kudos
- 2909 Views
- 1 replies
- 3 kudos
Resolved! No "create catalog" option in workspace with metastore linked
I created a workspace and a metastore(following the long tedious instructions). I assigned the workspace to the metastore. workspace -> Data, I can see the metastore link on the top left of the page. Through it I configured the permissions (giving me...
- 2909 Views
- 1 replies
- 3 kudos
- 3 kudos
Answering my own question - all that is needed is to refresh the Data web page!
- 3 kudos
- 2105 Views
- 1 replies
- 0 kudos
Problem sharing a streaming table created in Delta Live Table via Delta Sharing
Hi all,I hope you could help me to figure out what I am missing.I'm trying to do a simple thing. To read the data from the data ingestion zone (csv files saved to Azure Storage Account) using the Delta Live Tables pipeline and share the resulting tab...
- 2105 Views
- 1 replies
- 0 kudos
- 0 kudos
Sorry, I think I've created the post in the wrong thread. Created the same post in the Community Cove.
- 0 kudos
- 4157 Views
- 2 replies
- 0 kudos
Databricks Exam got suspended
Hi,I attended Databricks certified associate developer for apache spark 3.0- scala on 09 July 2023(today). At 7.35pm suddenly got a notice stating that due to eye movement away from exam your exam got suspended.I had completed the exam and was at the...
- 4157 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @nikhil018 Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 0 kudos
- 5559 Views
- 3 replies
- 2 kudos
Can't use Partner Connect to FiveTran
Brand new Databricks account, Workspace (Premium tier)New SQL Warehouse (Small, Pro)Brand new FiveTran trialI can't seem to use Partner Connect to connect to FiveTran in my trial. It appeared to work at first, and after attempting to sync with Stripe...
- 5559 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @Anonymous ,So far, I haven't been able to get it to work. However, I really appreciate @Prabakar's answer and your follow-up. I'm still interpreting @Prabakar's wise advice; however, I think it mostly doesn't apply to this situation, as I'm using...
- 2 kudos
- 11494 Views
- 4 replies
- 1 kudos
Service Principal to run Jobs that contain notebooks in Repos (GitHub)
Hi, Would appreciate your help in understanding how to set up Git credentials for a Service Principal running jobs that contain notebooks in Repos (GitHub), so that it will have access to these notebooks. These credentials should not have any depende...
- 11494 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @giladba Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your...
- 1 kudos
- 9772 Views
- 3 replies
- 0 kudos
Snowflake connection to databricks error
I am trying to connect to snowflake using data bricks but getting the below errornet.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver encountered a communication error. Message: Exception encountered for HTTP request: Connect to xxx.region.sn...
- 9772 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @shivank25 Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
- 0 kudos
- 4112 Views
- 2 replies
- 2 kudos
Bug - Cannot create table The associated location is not empty and also not a Delta table.
I am getting the error:Cannot create table ('`hive_metastore`.`MY_SCHEMA`.`MY_TABLE`'). The associated location ('dbfs:/user/hive/warehouse/my_schema.db/my_table') is not empty and also not a Delta table.When running drop table 'hive_metastore`.`MY_S...
- 4112 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @gilo12 Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your ...
- 2 kudos
- 12054 Views
- 3 replies
- 0 kudos
Give permissions to add comments on data explorer
Hi everyone!I'm facing this issue on databricks workspace.I do have permissions to add comments on data explorer, but some members of my team don't have those permissions.Where can I configure this and give them permission?
- 12054 Views
- 3 replies
- 0 kudos
- 0 kudos
To grant the permissions on the same page that you have shared, click the permissions tab, and select grant.then from the dropdown list select the user or group and give the respective permissions.
- 0 kudos
- 17953 Views
- 7 replies
- 4 kudos
How to schedule job in workflow for every 30 days
Dear All - I want to schedule a job in Workflow for every 30 days. So, when i try the below CRON expression it gives invalid cron expression. Anyone who already implemented this?0 0 */30 * *
- 17953 Views
- 7 replies
- 4 kudos
- 4 kudos
@pcbzmani Could you try 0 0 0 1/30 * ? *Databricks uses Quartz cron syntax and we have to provide 1/30 for day to achieve a schedule for 30 days.
- 4 kudos
- 4296 Views
- 2 replies
- 0 kudos
ADF & Databricks Pipeline Fails "Library installation failed for library due to user error"
I'm working on small POC to create a data pipeline which get triggered from ADF while having some parameters from ADF but my pipeline fails showing the attaching error:Operation on target Compute Daily Product Revenue failed: Databricks execution fai...
- 4296 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @qasimhassan Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you. Than...
- 0 kudos
- 2879 Views
- 2 replies
- 0 kudos
community edition
community edition is available?I tried to login but it is redirecting me differnt pages.
- 2879 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi ,Please note that community and is completely fiffernt objectives but you are refering community for disscussion foroum.Unlike the Databricks Free Trial, Community Edition doesn’t require that you have your own cloud account or supply cloud compu...
- 0 kudos
- 1514 Views
- 0 replies
- 0 kudos
How to access model endpoint management APIs from workflow tasks?
I have created a model serving endpoint in Databricks. I'd like to now update this endpoint programmatically from a workflow task.Following instructions on this page:https://docs.databricks.com/machine-learning/model-serving/create-manage-serving-end...
- 1514 Views
- 0 replies
- 0 kudos
- 1280 Views
- 0 replies
- 0 kudos
Where to see who accessed a table in a TAC enabled cluster and SQL warehouse
Where to see who accessed a table in a Table access control enabled cluster and SQL warehouse.In Azure Diagnostic settings all the Category groups are selected but unable to find any information in log regarding the actual SQL command ran against a t...
- 1280 Views
- 0 replies
- 0 kudos
- 4801 Views
- 4 replies
- 3 kudos
Not able to reset the password
I forgot my current password. So I was trying to change the password but the Databricks platform is not sending the password change link to my mail. I am now confused about what should be the next steps?It's a partner account which I am unable to res...
- 4801 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @Ck29 Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your qu...
- 3 kudos
