- 1387 Views
- 1 replies
- 0 kudos
New Databricks Large Tables
At one of the Databricks presentations in August a new type of table was introduced, I kind of remember these were large tables which did not change much. I think I heard these new table typed were in Beta. Unfortunately I lost my notes for that pres...
- 1387 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Thanks for reaching out to community.databricks.com. Are you talking about data objects in Databricks lakehouse? https://docs.databricks.com/lakehouse/data-objects.html
- 0 kudos
- 3081 Views
- 4 replies
- 1 kudos
Error with live connection SQL Datawarehouse
Error type: System call error. Cannot make named pipe /tmp/EvtnUM74TA574813952 due to error: No space left on device..))I can't find anything recent online related to Databricks or the SQL warehouses specifically. I don't seem to have enough monitori...
- 3081 Views
- 4 replies
- 1 kudos
- 1 kudos
Microstrategy connects to a small SQL Datawarehouse (SQL endpoint), which I guess is serverless by default. I don't believe the Databricks UI gives many options other than size and cost efficient or reliable setting. May be a temporary issue since it...
- 1 kudos
- 2738 Views
- 0 replies
- 2 kudos
Databricks to Azure Synapse SQL Server: error converting between Spark and Parquet column types
When writing data from Pyspark to Azure SQL Server (official databricks tutorial here) I am getting an error in the conversion between Spark and Parquet types.I believe this is caused in the temporary storage location mandatory when writing data from...
- 2738 Views
- 0 replies
- 2 kudos
- 1771 Views
- 2 replies
- 0 kudos
Past and Present sessions
Hi DatabricksCould we please regarding information about upcoming sessions and recorded videos of past sessions .This would be v helpful for users like meKind RegardsPriya
- 1771 Views
- 2 replies
- 0 kudos
- 1835 Views
- 3 replies
- 0 kudos
compatibility issue between 7.3 LTS and 10.4 LTS
We have views created with mixed case column names in 7.3 LTS and when we do select * from view everything looks OK I mean column names display in mixed case and problem started as we recently migrated to 10.4 LTS.Same views created with create or re...
- 1835 Views
- 3 replies
- 0 kudos
- 0 kudos
@Ravikumar Kumashi​ other than the DBR version, do you have any other configuration on the clusters? Also, is it possible for you to share a sample table and code so we could reproduce this?
- 0 kudos
- 5752 Views
- 4 replies
- 4 kudos
How to use a bash variable, which holds a value to the below subsequent cells in Data bricks notebook?
%shexport aa=100echo $aOUTPUT: 100in the below cell trying to use the variable a, but it's not printing the value%shecho $aOUTPUT:
- 5752 Views
- 4 replies
- 4 kudos
- 4 kudos
Hi, bash is not supported as notebook language. Instead, it is a magic cell executing shell script on the driver node.
- 4 kudos
- 1686 Views
- 1 replies
- 0 kudos
error message while connecto azure databricks through odbc connector
Hi All, I am getting below error often while trying to load data from databricks using spark odbc connections. QVX_UNEXPECTED_END_OF_DATA: SQL##f - SqlState: S1000, ErrorCode: 61, ErrorMsg: [Simba][Hardy] (61) Server returned error with no error mess...
- 1686 Views
- 1 replies
- 0 kudos
- 1583 Views
- 1 replies
- 2 kudos
www.databricks.com
How to Migrate Your Data and AI Workloads to Databricks With the AWS Migration Acceleration Programhttps://www.databricks.com/blog/2022/08/19/how-to-migrate-your-data-and-ai-workloads-to-databricks-with-the-aws-migration-acceleration-program.htmlIn t...
- 1583 Views
- 1 replies
- 2 kudos
- 2 kudos
Thank your for sharing this information @Abishek Subramanian​
- 2 kudos
- 1406 Views
- 1 replies
- 0 kudos
Cancel and re-register with same voucher
Hi,I received databricks voucher and I registered for an Associate exam. I wanted to check if I can cancel the registration and book different exam using same voucher? If I cancel, can same voucherbe used immediately for registering different exam?
- 1406 Views
- 1 replies
- 0 kudos
- 0 kudos
Adding @Kaniz Fatma​ for visibility on this question
- 0 kudos
- 1488 Views
- 1 replies
- 0 kudos
- 1488 Views
- 1 replies
- 0 kudos
- 0 kudos
Adding @Kaniz Fatma​ for visibility. Kaniz, Do you know is there is a test exam?
- 0 kudos
- 2659 Views
- 3 replies
- 2 kudos
How to fetch runs from cluster id in api
Task to achieve: We have cluster id and want to fetch all runs against it.Currently I have to get all the runs, iterate through it and filter out the runs with the required cluster id.Similarly if I want to fetch all the runs that are active?
- 2659 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @Muhammad Talha Jamil​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from y...
- 2 kudos
- 3863 Views
- 3 replies
- 1 kudos
Resolved! When is the End of Life (EOL) date for Databricks Runtime 7.3 LTS? Can we still use an unsupported version till its EOL date?
The End of Support (EOS) date sneaked up on us and we are now wondering if we can delay our upgrade post the EOS date. Could you please help us analyze the risks of operating a DBR version post EOS date?
- 3863 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Syed Zaffar​ Does @Prabakar Ammeappin​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 1 kudos
- 8021 Views
- 7 replies
- 7 kudos
Resolved! Spark eventlog for Cluster pools
Hi,I would want to setup the cluster logging (to capture eventlogs to /dbfs/cluster-logs dir) in my cluster pool configuration? is it possible?If I create cluster manually, I could able to setup the cluster logging as mentioned here: https://docs.mic...
- 8021 Views
- 7 replies
- 7 kudos
- 7 kudos
Hi @Stephanraj C​ instance pool is to reduce cluster start and auto-scaling times for a cluster. Are you using any API to create clusters? If so could you please share the API request?
- 7 kudos
- 4460 Views
- 2 replies
- 5 kudos
Error while mounting ADLS Gen 2 storage account to Az Databricks
Hello TeamI am facing troubles while mounting storage account onto my databricks. Some background on my setup:Storage Account - stgAcc1 - attached to vnet1 and it's subnetsDatabricks - databricks1 - attached to 'workers-vnet' and subnets - these were...
- 4460 Views
- 2 replies
- 5 kudos
- 5 kudos
Hi @Pranith Gaddam​ Does @Debayan Mukherjee​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 5 kudos
- 6152 Views
- 2 replies
- 1 kudos
Salesforce to Databricks
Hello Team,I am trying to run the salesforce and try to extract the data.AT that time i am facing the below issue :SOURCE_SYSTEM_NAME = 'Salesforce'TABLE_NAME = 'XY'desc = eval("sf." + TABLE_NAME + ".describe()")print(desc)for field in desc['fields']...
- 6152 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Rohit Kulkarni​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 1 kudos
| User | Count |
|---|---|
| 1637 | |
| 791 | |
| 527 | |
| 349 | |
| 287 |
