- 9329 Views
- 3 replies
- 1 kudos
Metastore - Access validation failed
Hi,When i create a metastore in aws databricks, i always have this error in the picture bellow.Eventhought i follow this link https://docs.databricks.com/data-governance/unity-catalog/get-started.html#cloud-tenant-setup-aws
- 9329 Views
- 3 replies
- 1 kudos
- 1 kudos
@Anatole Cadet looks your IAM role is not properly configured, can you please check
- 1 kudos
- 21892 Views
- 8 replies
- 3 kudos
Where is the cluster logs of the Databricks Jobs stored.
I'm running a scheduled job on Job clusters. I didnt mention the log location for the cluster. Where can we get the stored logs location. Yes, I can see the logs in the runs, but i need the logs location.
- 21892 Views
- 8 replies
- 3 kudos
- 3830 Views
- 3 replies
- 0 kudos
How to pass admin role via Account Console SAML SSO
The Account Console SAML SSO docs mention that the admin role must be specified in the identity provider response. However it's not clear which attribute to use for passing role info via SAML.What SAML attribute should the role be assigned to? What d...
- 3830 Views
- 3 replies
- 0 kudos
- 0 kudos
Hey there @Jameel A. Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Else please let us know if you need mo...
- 0 kudos
- 3452 Views
- 5 replies
- 0 kudos
Streaming Queries Failing Frequently in DBR 10.4 LTS for the Last Week
DBR 10.4 LTS is failing frequently due to GC overhead once in half an hour.Can anyone from Databricks Team let me know if we have some existing tickets or bugs.Note : We used the same configuration and same DBR for almost last 3 months.When checking ...
- 3452 Views
- 5 replies
- 0 kudos
- 0 kudos
hi @Vidula Khanna have raised a support ticket to ADB from client side. We can close this however it seems like DBR Version 11.2 and above has some fixes for the RocksDB memory leak based on communication with Databricks developer team
- 0 kudos
- 4154 Views
- 1 replies
- 1 kudos
import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema"
The error i get when importing certain delta table isThe specified schema does not match the existing schema at dbfs:/mnt/mart/tablenamehowever, when i check the metadata table in the old workspace and the exported file, they match. However, it seems...
- 4154 Views
- 1 replies
- 1 kudos
- 1 kudos
below is example error. however, in existing metadata i still see varchar 100 as the type. Specified metadata for field Percentage is different from existing schema:\n Specified: {}\n Existing: {\"HIVE_TYPE_STRING\":\"varchar(100)\"}\n\nIf your inte...
- 1 kudos
- 2566 Views
- 0 replies
- 0 kudos
unable to read Csv files from Databricks Database Tables
I amTrying to read a csv file stored in database tables of databricks, but getting error . It is runnin gfine for dbfs but same format not working for Database Tables.
- 2566 Views
- 0 replies
- 0 kudos
- 2872 Views
- 2 replies
- 0 kudos
Why it still complain REST API version is 2.0 even though set it to 2.1 ?
root@387ece6d15b2:/usr/workspace# databricks --versionVersion 0.17.3root@387ece6d15b2:/usr/workspace# databricks jobs configure --version=2.1root@387ece6d15b2:/usr/workspace# databricks jobs get --job-id 123WARN: Your CLI is configured to use Jobs AP...
- 2872 Views
- 2 replies
- 0 kudos
- 0 kudos
Command "databricks jobs configure --version=2.1" not work.workaround with adding option "--version=2.1" to each databricks jobs/runs command .It is not very convenient.
- 0 kudos
- 5546 Views
- 6 replies
- 8 kudos
Library Dependency
How to Install Libraries on DatabricksYou can install libraries in Databricks at the cluster level for libraries commonly used on a cluster, at the notebook-level using %pip, or using global init scripts when you have libraries that should be install...
- 5546 Views
- 6 replies
- 8 kudos
- 8 kudos
It can be a risky to install libraries without any sort of oversite/security structure to ensure those libraries have no vulnerabilities. I think more caution needs to be added to the wording of these documents to express that. All of the libraries w...
- 8 kudos
- 3934 Views
- 2 replies
- 1 kudos
DBU usage for Job Cluster vs interactive cluster
Hi, Could there be a difference in the DBU charge for 2 cluster of exact same configuration and workload but one is a job cluster and the other is an interactive cluster?Thanks,Sweta
- 3934 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Swetha Marakani Does @Prabakar Ammeappin response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 1 kudos
- 2910 Views
- 2 replies
- 2 kudos
Change IP range of Subnet for Azure environment
Is there a roadmap to make possible to change IP range without the creation of a new workspace for Azure environment?
- 2910 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Camila Queiroz Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 2 kudos
- 27674 Views
- 4 replies
- 2 kudos
Parallel Processing of Databricks Notebook
I have a scenario where I need to run same databricks notebook multiple times in parallel.What is the best approach to do this ?
- 27674 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Hariharan Sambath Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
- 2 kudos
- 2047 Views
- 2 replies
- 0 kudos
how should I start databricks ?
Hello Guys,I am new to databricks. I have try to read the documentation as much I can. Now I want to jump in. What I Want : I have store my parquet file in Databricks storage system. I want to load this file into Data Lake Table. And then want to do ...
- 2047 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Learner bricks Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 0 kudos
- 4266 Views
- 3 replies
- 4 kudos
Resolved! Retrieving the job-id's of a notebook running inside tasks
I have created a job, Inside a job I have created tasks which are independent, I have used the concept of concurrent futures to exhibit parallelism and in each task there are couple of notebooks running(which are independent) Each notebook running ha...
- 4266 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @swetha kadiyala Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...
- 4 kudos
- 2782 Views
- 2 replies
- 1 kudos
Error when creating a new workspace in GCP
Hello, We have several workspaces in GCP and want to create another one in another region. For some reason, after we enter all GKE IP ranges, we got a BAD_REQUEST error that applies that it couldn't get our oath token.We tried to login out and in aga...
- 2782 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Leon Bam Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 1 kudos
- 5183 Views
- 2 replies
- 1 kudos
Is it the Lakehouse suitable as a OLTP and OLAP system at the same time? Recently I have seen some discussion in the company I work and it is basicall...
Is it the Lakehouse suitable as a OLTP and OLAP system at the same time?Recently I have seen some discussion in the company I work and it is basically if the Lakehouse is a tool to be used as both transactional and analytical system.The discussion ha...
- 5183 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Esteban Sierra-Munera Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from ...
- 1 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 553 | |
| 349 | |
| 287 |
