- 2865 Views
- 3 replies
- 0 kudos
Databricks Pub-Sub Data Recon
I am trying to setup a recon activity between GCP Pub-Sub and databricks, Is there any way to fetch the last 24hrs record count from Pub-Sub?I tried but not got any direct solution for it, It will be great if any one can suggest me the way t#pubsub, ...
- 2865 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Ajay-Pandey Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Cheers!
- 0 kudos
- 1412 Views
- 1 replies
- 3 kudos
Resolved! No "create catalog" option in workspace with metastore linked
I created a workspace and a metastore(following the long tedious instructions). I assigned the workspace to the metastore. workspace -> Data, I can see the metastore link on the top left of the page. Through it I configured the permissions (giving me...
- 1412 Views
- 1 replies
- 3 kudos
- 3 kudos
Answering my own question - all that is needed is to refresh the Data web page!
- 3 kudos
- 1043 Views
- 1 replies
- 0 kudos
Problem sharing a streaming table created in Delta Live Table via Delta Sharing
Hi all,I hope you could help me to figure out what I am missing.I'm trying to do a simple thing. To read the data from the data ingestion zone (csv files saved to Azure Storage Account) using the Delta Live Tables pipeline and share the resulting tab...
- 1043 Views
- 1 replies
- 0 kudos
- 0 kudos
Sorry, I think I've created the post in the wrong thread. Created the same post in the Community Cove.
- 0 kudos
- 2821 Views
- 2 replies
- 0 kudos
Databricks Exam got suspended
Hi,I attended Databricks certified associate developer for apache spark 3.0- scala on 09 July 2023(today). At 7.35pm suddenly got a notice stating that due to eye movement away from exam your exam got suspended.I had completed the exam and was at the...
- 2821 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @nikhil018 Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 0 kudos
- 2945 Views
- 3 replies
- 2 kudos
Can't use Partner Connect to FiveTran
Brand new Databricks account, Workspace (Premium tier)New SQL Warehouse (Small, Pro)Brand new FiveTran trialI can't seem to use Partner Connect to connect to FiveTran in my trial. It appeared to work at first, and after attempting to sync with Stripe...
- 2945 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @Anonymous ,So far, I haven't been able to get it to work. However, I really appreciate @Prabakar's answer and your follow-up. I'm still interpreting @Prabakar's wise advice; however, I think it mostly doesn't apply to this situation, as I'm using...
- 2 kudos
- 8872 Views
- 4 replies
- 1 kudos
Service Principal to run Jobs that contain notebooks in Repos (GitHub)
Hi, Would appreciate your help in understanding how to set up Git credentials for a Service Principal running jobs that contain notebooks in Repos (GitHub), so that it will have access to these notebooks. These credentials should not have any depende...
- 8872 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @giladba Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your...
- 1 kudos
- 6003 Views
- 3 replies
- 0 kudos
Snowflake connection to databricks error
I am trying to connect to snowflake using data bricks but getting the below errornet.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver encountered a communication error. Message: Exception encountered for HTTP request: Connect to xxx.region.sn...
- 6003 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @shivank25 Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
- 0 kudos
- 9134 Views
- 7 replies
- 4 kudos
How to schedule job in workflow for every 30 days
Dear All - I want to schedule a job in Workflow for every 30 days. So, when i try the below CRON expression it gives invalid cron expression. Anyone who already implemented this?0 0 */30 * *
- 9134 Views
- 7 replies
- 4 kudos
- 4 kudos
@pcbzmani Could you try 0 0 0 1/30 * ? *Databricks uses Quartz cron syntax and we have to provide 1/30 for day to achieve a schedule for 30 days.
- 4 kudos
- 2350 Views
- 2 replies
- 0 kudos
ADF & Databricks Pipeline Fails "Library installation failed for library due to user error"
I'm working on small POC to create a data pipeline which get triggered from ADF while having some parameters from ADF but my pipeline fails showing the attaching error:Operation on target Compute Daily Product Revenue failed: Databricks execution fai...
- 2350 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @qasimhassan Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you. Than...
- 0 kudos
- 686 Views
- 0 replies
- 0 kudos
Where to see who accessed a table in a TAC enabled cluster and SQL warehouse
Where to see who accessed a table in a Table access control enabled cluster and SQL warehouse.In Azure Diagnostic settings all the Category groups are selected but unable to find any information in log regarding the actual SQL command ran against a t...
- 686 Views
- 0 replies
- 0 kudos
- 2451 Views
- 4 replies
- 3 kudos
Not able to reset the password
I forgot my current password. So I was trying to change the password but the Databricks platform is not sending the password change link to my mail. I am now confused about what should be the next steps?It's a partner account which I am unable to res...
- 2451 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @Ck29 Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your qu...
- 3 kudos
- 4293 Views
- 6 replies
- 7 kudos
Not able to run spark context by running python file in a cell using %sh
Hi Everyone,I am trying to get spark context by running SparkSession builder command in a .py file and when i try to run it directl it works but if i got to a notebook and in a cell if i use %sh command to run python "myfilename" it gives an error th...
- 4293 Views
- 6 replies
- 7 kudos
- 3353 Views
- 3 replies
- 8 kudos
📣 Getting started with Databricks is easier than ever 🚀
We are thrilled to introduce a dedicated "Get Started with Databricks" space on Databricks Community for new users and curious data practitioners not yet on Databricks! In this space, we are bringing together the best of resources to ensure new and c...
- 3353 Views
- 3 replies
- 8 kudos
- 629 Views
- 0 replies
- 0 kudos
Send email Personalized from DATABRICKS
Hi..I would like to know if anyone knows how to send personalized emails from databricks or if there is an example that you can replicate it would be very helpful.Greetings to each one.
- 629 Views
- 0 replies
- 0 kudos
- 670 Views
- 1 replies
- 0 kudos
Databricks Repos w/o provider
Is there any way to get the functionality of databricks repos without using a provider? i.e. Databricks would be the provider. I would like to get the benefits of git operations in databricks but without linking my repository to an external source. I...
- 670 Views
- 1 replies
- 0 kudos
- 0 kudos
I'm afraid this isn't a supported feature today. Databricks Repos acts as a conduit or client between the workspace and a configured Git provider. No hosting functionality is available.
- 0 kudos
