- 2787 Views
- 3 replies
- 1 kudos
Databricks Repos are pushing all changes to GitHub
When I make any changes within a repo, when I go to commit and push to GitHub if I uncheck any changes that I don't want pushed, still get pushed to Github. Any help would be appreciated
- 2787 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Vidula Khanna Problem is now resolved thanks, didn't have to do anything different, the functionality just started working as expected.
- 1 kudos
- 6795 Views
- 5 replies
- 0 kudos
IP Access list Databricks
Hello, good morning everyone, I have a problem, I have IP access List activated in my Databricks workspace and I have connections to powerBI and Azure DevOps, in Power BI I have already added all the public IP ranges that Azure gives me, which are ab...
- 6795 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @David Cantos Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 0 kudos
- 6536 Views
- 3 replies
- 2 kudos
Parquet to csv delta file
Hi Team, I have a parquet file in s3 bucket which is a delta file I am able to read it but I am unable to write it as a csv file.getting the following error when i am trying to write:A transaction log for Databricks Delta was found at `s3://path/a...
- 6536 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @yuvesh kotiala Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 2 kudos
- 16413 Views
- 3 replies
- 1 kudos
Job is fails with java.lang.NoClassDefFoundError: Could not initialize class error
hi,It is scala code where we are connecting Redis to store (sparkcontext.toRedisKV) and i am also using scala udf . ihave excuted the same code in notebook without scala object and it works fine but everytime it fails when i am using same code in jar...
- 16413 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Satish Kumbhar Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 1 kudos
- 1802 Views
- 2 replies
- 0 kudos
ILT session
when is the next ILT session
- 1802 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Edrian Kyle Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback ...
- 0 kudos
- 1824 Views
- 2 replies
- 0 kudos
Adding partition location to external table throwing exception
I have created external table like below.# create table spark.sql(f""" CREATE EXTERNAL TABLE IF NOT EXISTS {database_schema}.{tableName} USING PARQUET OPTIONS ( 'path' '{raw_storage}/{folder_path}', 'forward_spark_azur...
- 1824 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @sri bet Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback will...
- 0 kudos
- 3556 Views
- 2 replies
- 1 kudos
Skip Task Without Spinning Up Cluster
I have a Job Workflow with multiple sequential tasks executing R or Python scripts. Currently, we can skip one of these tasks (if it has already been run) by passing a parameter and skipping via the script. This requires a full spin up of a compute r...
- 3556 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Dave Wilson Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...
- 1 kudos
- 6684 Views
- 2 replies
- 0 kudos
Why is the Import button greyed out when attempting to import a .ipynb file into Databricks?
The file import seems to work. The file name and size appear in the dialog box along with a green check mark. BUT only the cancel button is active. The import button is greyed out.Is there another step, action, or setting required to activate the i...
- 6684 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Paul Auclair Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 0 kudos
- 2965 Views
- 2 replies
- 0 kudos
Informatica Cloud mapping with Databricks connection failing with java.util.NoSuchElementException
Hi Team,When we tried to configure our source with Databricks table with Databricks connection on Informatica Cloud, we received below error.We already tried the suggestions mentioned in the below community post which seems to be similar error as our...
- 2965 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Mahesh D Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 0 kudos
- 2442 Views
- 2 replies
- 1 kudos
Is it possible to get a git access token on the databricks notebook.
I set my git access token with folloing the page.Get a Git access token & connect a remote repo to Databricks | Databricks on AWSI would like to get that git token on my databricks python notebook.Is it possible? Or, should I set same or another git ...
- 2442 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @takeshi.kida Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 1 kudos
- 8669 Views
- 2 replies
- 0 kudos
Maximum VM usage
Hi, I am trying to find what should be the maximum VM's i should reserve as capacity.I use F8 Cluster instance pool. Multiple jobs use this instance pool during the day.Most of them overlap during different times of the day.For reserving capacity, i ...
- 8669 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Sumit Salian Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback...
- 0 kudos
- 3220 Views
- 3 replies
- 0 kudos
take() operation throwing index out of range error
x=[1,2,3,4,5,6,7]rdd = sc.parallelize(x)print (rdd.take(2))Traceback (most recent call last): File "/usr/local/spark/python/pyspark/serializers.py", line 458, in dumps return cloudpickle.dumps(obj, pickle_protocol) ^^^^^^^^^^^^^^^^^^...
- 3220 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Shelly Bhardwaj Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...
- 0 kudos
- 4871 Views
- 5 replies
- 0 kudos
- 4871 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi, I am not sure if this helps: https://www.databricks.com/blog/2020/12/15/python-autocomplete-improvements-for-databricks-notebooks.htmlAlso, please tag @Debayan with your next response which will notify me. Thank you!
- 0 kudos
- 9604 Views
- 3 replies
- 0 kudos
Omitting columns in an INSERT statement does not seem to work despite meeting the requirements
We want to use the INSERT INTO command with specific columns as specified in the official documentation. The only requirements for this are️ Databricks SQL warehouse version 2022.35 or higher️ Databricks Runtime 11.2 and aboveand the behaviour shou...
- 9604 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Fusselmanwog Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 0 kudos
- 7167 Views
- 2 replies
- 4 kudos
Resolved! Can you use the Secrets API 2.0 in a Delta Live Tables configuration?
Is the Secrets API 2.0 not applied to Delta Live Tables configurations? I understand that the Secrets API 2.0 is in public preview and this use case may not be supported, yet. I tried the following and both do not work for the stated reasons.In a DLT...
- 7167 Views
- 2 replies
- 4 kudos
- 4 kudos
@Kevin Rossi : As a workaround, you can use the code you provided to load the secret in a cell in a DLT notebook and set it in the Spark configuration. This will allow you to use the secret in your DLT code.Another workaround could be to store the c...
- 4 kudos
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
