- 1892 Views
- 2 replies
- 2 kudos
Resolved! User Memory problem on driver with DLT
Hi! I have a problem with user memory on driver (I have almost several mb of storage memory, 0 Execution memory and more than 7GB of JVM Memory on Heap in use). How it can be? I don't have any broadcast variables, joins or aggregations. All the pipe...
- 1892 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Yuliya Valava​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...
- 2 kudos
- 2322 Views
- 4 replies
- 0 kudos
- 2322 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @Youssef Mrini​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedbac...
- 0 kudos
- 27609 Views
- 12 replies
- 10 kudos
Resolved! Fetching top 1 L rows in Databricks SQL
how to fetch the top 1L rows from a long SQL query as the query is returning 5gb data, I want to check only the first 1L ROWS.
- 27609 Views
- 12 replies
- 10 kudos
- 1394 Views
- 1 replies
- 0 kudos
Resolved! Is it possible to migrate Databricks SQL objects?
I am trying to migrate Databricks SQL Dashboards and Queries from one workspace to another.Recently Databricks allows storing SQL objects in Workspace folders (https://docs.databricks.com/sql/user/workspace-browser/), but archiving the folder into db...
- 1394 Views
- 1 replies
- 0 kudos
- 0 kudos
@Kamting Tsoi​ Import/Export dashboards feature is in private preview. Please reach out to your AE to onboard your workspace
- 0 kudos
- 1327 Views
- 1 replies
- 0 kudos
Resolved! How to use caller's rights in Databricks Workflows?
I have created a job in Databricks Workflow that runs a notebook and have given manage run permissions to users. If any user trigger the job, I expect the job to show their username in Run As Option as it was triggered by them and they have Manage Ru...
- 1327 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Vigneshraja Palaniraj​ Rus as is a private preview feature. Please complete this sign up form which will be reviewed by PM and you'll receive the confirmation once it's enabled.
- 0 kudos
- 1687 Views
- 2 replies
- 5 kudos
"Hey everyone, it seems like there's some confusion about enhanced autoscaling in Databricks lately. If you're feeling lost or unsure abo...
"Hey everyone, it seems like there's some confusion about enhanced autoscaling in Databricks lately. If you're feeling lost or unsure about how it works, don't worry - you're not"Enhanced autoscaling is a feature in Databricks that enables dynamic sc...
- 1687 Views
- 2 replies
- 5 kudos
- 1219 Views
- 0 replies
- 3 kudos
Hey there! I've noticed that many people seem to be confused about the differences between databases, data warehouses, and data lakes. It's un...
Hey there! I've noticed that many people seem to be confused about the differences between databases, data warehouses, and data lakes. It's understandable, as these terms can be easily misunderstood or used interchangeablyHere is the summary for all ...
- 1219 Views
- 0 replies
- 3 kudos
- 16010 Views
- 4 replies
- 9 kudos
Resolved! Databricks CLI configure (using AAD-TOKEN) in the Databricks notebook `%sh` mode
Hello everyone, I am trying to setup Databricks CLI by referring to the Databricks CLI documentation. When I setup using the Personal Access Token, it works fine and I am able to access the workspace and fetch the results from the same workspace in D...
- 16010 Views
- 4 replies
- 9 kudos
- 9 kudos
Hi @Juned Mala​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 9 kudos
- 4943 Views
- 8 replies
- 7 kudos
Command to install spark package from notebook cell
Hi All, I need to install a spark-xml package from a notebook cell (hoping it will work on a DLT cluster). Maven Package: com.databricks:spark-xml_2.12:0.16.0Can anyone help me with the command to install from the notebook cell? Fairly new to all thi...
- 4943 Views
- 8 replies
- 7 kudos
- 7 kudos
Hi @Jason Johnson​ I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I suggest ...
- 7 kudos
- 5238 Views
- 5 replies
- 4 kudos
Resolved! Databricks Community version - Unable to clone a public git repository
Databricks Community version - Unable to clone a public git repository, as the 'Repository' tab that should appear below 'Workspace' tab on the portal does not appear and I am not aware of any alternate method. I have referred to some documents on th...
- 5238 Views
- 5 replies
- 4 kudos
- 4 kudos
Hi @Jay Kumar​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback wi...
- 4 kudos
- 4358 Views
- 2 replies
- 1 kudos
Resolved! Is there a way to run Databricks query on vba?
Currently, I just manually copy paste ​a code from an excel sheet and paste it on a databricks notebook and run for results, then, copy paste the results to the same workbook. I'm sure there's a faster way to do it. The only solutions i can find is u...
- 4358 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Hanna Wade​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 1 kudos
- 3875 Views
- 6 replies
- 5 kudos
How to delete strings from the /FileStore/
We have just started working with databricks in one of my university modules, and the lecturers gave us a set of commands to practice saving data in the FileStore. One of the commands was the following:dbutils .fs.cp("/ databricks - datasets / weathh...
- 3875 Views
- 6 replies
- 5 kudos
- 5 kudos
Hi @Konrad Kawka​ I'm sorry you could not find a solution to your problem in the answers provided.Our community strives to provide helpful and accurate information, but sometimes an immediate solution may only be available for some issues.I suggest ...
- 5 kudos
- 2213 Views
- 1 replies
- 0 kudos
SET configuration in SQL DLT pipeline not working
I'm not able to get the SET command to work when using sql in DLT pipeline. I am copying the code from this documentation https://docs.databricks.com/workflows/delta-live-tables/delta-live-tables-sql-ref.html#sql-spec (relevant code below). When I ru...
- 2213 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Oliver Teng​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...
- 0 kudos
- 3950 Views
- 7 replies
- 0 kudos
Resolved! Fetch new data from kinesis for every minute.
I want to fetch new data from kinesis source for every minute. I'm using "minFetchPeriod" option and specified 60s. But this doesn't seem to be working.Streaming query: spark \ .readStream \ .format("kinesis") \ .option("streamName", kinesis_stream_...
- 3950 Views
- 7 replies
- 0 kudos
- 0 kudos
Hi @Pranathi Girish​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedb...
- 0 kudos
- 5750 Views
- 1 replies
- 1 kudos
read cdm error: java.util.NoSuchElementException: None.get
Hi all, I'm trying to read cdm file and get the error in the image (I replaced the names in uppercase). Any ideas on how to solve it?Thank you!
- 5750 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @imma marra​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
- 1 kudos
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
