- 2569 Views
- 5 replies
- 0 kudos
Streaming Queries Failing Frequently in DBR 10.4 LTS for the Last Week
DBR 10.4 LTS is failing frequently due to GC overhead once in half an hour.Can anyone from Databricks Team let me know if we have some existing tickets or bugs.Note : We used the same configuration and same DBR for almost last 3 months.When checking ...
- 2569 Views
- 5 replies
- 0 kudos
- 0 kudos
hi @Vidula Khanna​ have raised a support ticket to ADB from client side. We can close this however it seems like DBR Version 11.2 and above has some fixes for the RocksDB memory leak based on communication with Databricks developer team
- 0 kudos
- 3525 Views
- 1 replies
- 1 kudos
import of tables to a new metastore failed with schema mismatch "specified schema does not match the existing schema"
The error i get when importing certain delta table isThe specified schema does not match the existing schema at dbfs:/mnt/mart/tablenamehowever, when i check the metadata table in the old workspace and the exported file, they match. However, it seems...
- 3525 Views
- 1 replies
- 1 kudos
- 1 kudos
below is example error. however, in existing metadata i still see varchar 100 as the type. Specified metadata for field Percentage is different from existing schema:\n Specified: {}\n Existing: {\"HIVE_TYPE_STRING\":\"varchar(100)\"}\n\nIf your inte...
- 1 kudos
- 2133 Views
- 0 replies
- 0 kudos
unable to read Csv files from Databricks Database Tables
I amTrying to read a csv file stored in database tables of databricks, but getting error . It is runnin gfine for dbfs but same format not working for Database Tables.
- 2133 Views
- 0 replies
- 0 kudos
- 2053 Views
- 2 replies
- 0 kudos
Why it still complain REST API version is 2.0 even though set it to 2.1 ?
root@387ece6d15b2:/usr/workspace# databricks --versionVersion 0.17.3root@387ece6d15b2:/usr/workspace# databricks jobs configure --version=2.1root@387ece6d15b2:/usr/workspace# databricks jobs get --job-id 123WARN: Your CLI is configured to use Jobs AP...
- 2053 Views
- 2 replies
- 0 kudos
- 0 kudos
Command "databricks jobs configure --version=2.1" not work.workaround with adding option "--version=2.1" to each databricks jobs/runs command .It is not very convenient.
- 0 kudos
- 3964 Views
- 6 replies
- 8 kudos
Library Dependency
How to Install Libraries on DatabricksYou can install libraries in Databricks at the cluster level for libraries commonly used on a cluster, at the notebook-level using %pip, or using global init scripts when you have libraries that should be install...
- 3964 Views
- 6 replies
- 8 kudos
- 8 kudos
It can be a risky to install libraries without any sort of oversite/security structure to ensure those libraries have no vulnerabilities. I think more caution needs to be added to the wording of these documents to express that. All of the libraries w...
- 8 kudos
- 2474 Views
- 2 replies
- 1 kudos
DBU usage for Job Cluster vs interactive cluster
Hi,​ Could there be a difference in the DBU charge for 2 cluster of exact same configuration and workload but one is a job cluster and the other is an interactive cluster?​Thanks,Sweta​
- 2474 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Swetha Marakani​ Does @Prabakar Ammeappin​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 1 kudos
- 2187 Views
- 2 replies
- 2 kudos
Change IP range of Subnet for Azure environment
Is there a roadmap to make possible to change IP range without the creation of a new workspace for Azure environment?
- 2187 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Camila Queiroz​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 2 kudos
- 22146 Views
- 4 replies
- 2 kudos
Parallel Processing of Databricks Notebook
I have a scenario where I need to run same databricks notebook multiple times in parallel.What is the best approach to do this ?
- 22146 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Hariharan Sambath​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
- 2 kudos
- 1516 Views
- 2 replies
- 0 kudos
how should I start databricks ?
Hello Guys,I am new to databricks. I have try to read the documentation as much I can. Now I want to jump in. What I Want : I have store my parquet file in Databricks storage system. I want to load this file into Data Lake Table. And then want to do ...
- 1516 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Learner bricks​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 0 kudos
- 3071 Views
- 3 replies
- 4 kudos
Resolved! Retrieving the job-id's of a notebook running inside tasks
I have created a job, Inside a job I have created tasks which are independent, I have used the concept of concurrent futures to exhibit parallelism and in each task there are couple of notebooks running(which are independent) Each notebook running ha...
- 3071 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @swetha kadiyala​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...
- 4 kudos
- 1933 Views
- 2 replies
- 1 kudos
Error when creating a new workspace in GCP
Hello, We have several workspaces in GCP and want to create another one in another region. For some reason, after we enter all GKE IP ranges, we got a BAD_REQUEST error that applies that it couldn't get our oath token.We tried to login out and in aga...
- 1933 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Leon Bam​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 1 kudos
- 3883 Views
- 2 replies
- 1 kudos
Is it the Lakehouse suitable as a OLTP and OLAP system at the same time? Recently I have seen some discussion in the company I work and it is basicall...
Is it the Lakehouse suitable as a OLTP and OLAP system at the same time?Recently I have seen some discussion in the company I work and it is basically if the Lakehouse is a tool to be used as both transactional and analytical system.The discussion ha...
- 3883 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Esteban Sierra-Munera​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from ...
- 1 kudos
- 572 Views
- 0 replies
- 0 kudos
I am a wheelchair woodworking projects worker. Working from a wheelchair presents some unique challenges such as santa sleigh to access, mobility, and...
I am a wheelchair woodworking projects worker. Working from a wheelchair presents some unique challenges such as santa sleigh to access, mobility, and construction, but also provides different perspectives as well as strong motivation to finding solu...
- 572 Views
- 0 replies
- 0 kudos
- 23186 Views
- 11 replies
- 2 kudos
Resolved! how to add an identity column to an existing table?
I have created a database called retail and inside database a table is there called sales_order. I want to create an identity column in the sales_order table, but while creating it I am getting an error.
- 23186 Views
- 11 replies
- 2 kudos
- 15875 Views
- 0 replies
- 2 kudos
Heads up! October �� Community Social! On October 20th we are hosting another Community Social - we're doing these monthly ! We want to mak...
Heads up! October Community Social!On October 20th we are hosting another Community Social - we're doing these monthly ! We want to make sure that we all have the chance to connect as a community often. Come network, talk data, and just get social! ...
- 15875 Views
- 0 replies
- 2 kudos
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 347 | |
| 286 | |
| 252 |
