- 3400 Views
- 3 replies
- 0 kudos
How to restart Databricks Cluster at specific time?
Command available for restart but not at specific time.databricks clusters restart --cluster-id <>
- 3400 Views
- 3 replies
- 0 kudos
- 0 kudos
@Trushna Khatri​ adding some more information to prabakar. can you please let me know what is actual need of starting cluster during specific time. usually if you criteria is to use for jobs go with job cluster. here cluster start when ever your job ...
- 0 kudos
- 7136 Views
- 3 replies
- 1 kudos
Metastore - Access validation failed
Hi,When i create a metastore in aws databricks, i always have this error in the picture bellow.Eventhought i follow this link https://docs.databricks.com/data-governance/unity-catalog/get-started.html#cloud-tenant-setup-aws
- 7136 Views
- 3 replies
- 1 kudos
- 1 kudos
@Anatole Cadet​ looks your IAM role is not properly configured, can you please check
- 1 kudos
- 17088 Views
- 8 replies
- 3 kudos
Where is the cluster logs of the Databricks Jobs stored.
I'm running a scheduled job on Job clusters. I didnt mention the log location for the cluster. Where can we get the stored logs location. Yes, I can see the logs in the runs, but i need the logs location.
- 17088 Views
- 8 replies
- 3 kudos
- 3017 Views
- 3 replies
- 0 kudos
How to pass admin role via Account Console SAML SSO
The Account Console SAML SSO docs mention that the admin role must be specified in the identity provider response. However it's not clear which attribute to use for passing role info via SAML.What SAML attribute should the role be assigned to? What d...
- 3017 Views
- 3 replies
- 0 kudos
- 0 kudos
Hey there @Jameel A.​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Else please let us know if you need mo...
- 0 kudos
- 2646 Views
- 5 replies
- 0 kudos
Streaming Queries Failing Frequently in DBR 10.4 LTS for the Last Week
DBR 10.4 LTS is failing frequently due to GC overhead once in half an hour.Can anyone from Databricks Team let me know if we have some existing tickets or bugs.Note : We used the same configuration and same DBR for almost last 3 months.When checking ...
- 2646 Views
- 5 replies
- 0 kudos
- 0 kudos
hi @Vidula Khanna​ have raised a support ticket to ADB from client side. We can close this however it seems like DBR Version 11.2 and above has some fixes for the RocksDB memory leak based on communication with Databricks developer team
- 0 kudos
- 3619 Views
- 1 replies
- 1 kudos
import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema"
The error i get when importing certain delta table isThe specified schema does not match the existing schema at dbfs:/mnt/mart/tablenamehowever, when i check the metadata table in the old workspace and the exported file, they match. However, it seems...
- 3619 Views
- 1 replies
- 1 kudos
- 1 kudos
below is example error. however, in existing metadata i still see varchar 100 as the type. Specified metadata for field Percentage is different from existing schema:\n Specified: {}\n Existing: {\"HIVE_TYPE_STRING\":\"varchar(100)\"}\n\nIf your inte...
- 1 kudos
- 2176 Views
- 0 replies
- 0 kudos
unable to read Csv files from Databricks Database Tables
I amTrying to read a csv file stored in database tables of databricks, but getting error . It is runnin gfine for dbfs but same format not working for Database Tables.
- 2176 Views
- 0 replies
- 0 kudos
- 2201 Views
- 2 replies
- 0 kudos
Why it still complain REST API version is 2.0 even though set it to 2.1 ?
root@387ece6d15b2:/usr/workspace# databricks --versionVersion 0.17.3root@387ece6d15b2:/usr/workspace# databricks jobs configure --version=2.1root@387ece6d15b2:/usr/workspace# databricks jobs get --job-id 123WARN: Your CLI is configured to use Jobs AP...
- 2201 Views
- 2 replies
- 0 kudos
- 0 kudos
Command "databricks jobs configure --version=2.1" not work.workaround with adding option "--version=2.1" to each databricks jobs/runs command .It is not very convenient.
- 0 kudos
- 4124 Views
- 6 replies
- 8 kudos
Library Dependency
How to Install Libraries on DatabricksYou can install libraries in Databricks at the cluster level for libraries commonly used on a cluster, at the notebook-level using %pip, or using global init scripts when you have libraries that should be install...
- 4124 Views
- 6 replies
- 8 kudos
- 8 kudos
It can be a risky to install libraries without any sort of oversite/security structure to ensure those libraries have no vulnerabilities. I think more caution needs to be added to the wording of these documents to express that. All of the libraries w...
- 8 kudos
- 2725 Views
- 2 replies
- 1 kudos
DBU usage for Job Cluster vs interactive cluster
Hi,​ Could there be a difference in the DBU charge for 2 cluster of exact same configuration and workload but one is a job cluster and the other is an interactive cluster?​Thanks,Sweta​
- 2725 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Swetha Marakani​ Does @Prabakar Ammeappin​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 1 kudos
- 2292 Views
- 2 replies
- 2 kudos
Change IP range of Subnet for Azure environment
Is there a roadmap to make possible to change IP range without the creation of a new workspace for Azure environment?
- 2292 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Camila Queiroz​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 2 kudos
- 22818 Views
- 4 replies
- 2 kudos
Parallel Processing of Databricks Notebook
I have a scenario where I need to run same databricks notebook multiple times in parallel.What is the best approach to do this ?
- 22818 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Hariharan Sambath​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
- 2 kudos
- 1583 Views
- 2 replies
- 0 kudos
how should I start databricks ?
Hello Guys,I am new to databricks. I have try to read the documentation as much I can. Now I want to jump in. What I Want : I have store my parquet file in Databricks storage system. I want to load this file into Data Lake Table. And then want to do ...
- 1583 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Learner bricks​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 0 kudos
- 3237 Views
- 3 replies
- 4 kudos
Resolved! Retrieving the job-id's of a notebook running inside tasks
I have created a job, Inside a job I have created tasks which are independent, I have used the concept of concurrent futures to exhibit parallelism and in each task there are couple of notebooks running(which are independent) Each notebook running ha...
- 3237 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @swetha kadiyala​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...
- 4 kudos
- 2132 Views
- 2 replies
- 1 kudos
Error when creating a new workspace in GCP
Hello, We have several workspaces in GCP and want to create another one in another region. For some reason, after we enter all GKE IP ranges, we got a BAD_REQUEST error that applies that it couldn't get our oath token.We tried to login out and in aga...
- 2132 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Leon Bam​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 1 kudos
| User | Count |
|---|---|
| 1612 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
