- 1461 Views
- 1 replies
- 1 kudos
Feature Request: GUI: Additional Collapse options
When you're using a very large notebook sometimes it gets frustrating scrolling through all the code blocks. It would be nice to have a few additional options to make this easier. 1) Add a collapse all code cells button to the top.2) Add a collapse a...
- 1461 Views
- 1 replies
- 1 kudos
- 1 kudos
this feature please
- 1 kudos
- 839 Views
- 1 replies
- 0 kudos
Resolved! Does a queued databricks job incur cost?
Does a queued databricks job incur cost?
- 839 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @qwerty3 ,No, it does not. When a job is queued (waiting for an available cluster or resources), there is no compute usage, so no charges are incurred for Databricks units (DBUs) or cloud infrastructure (VMs). The queued state is essentially a wai...
- 0 kudos
- 2473 Views
- 11 replies
- 1 kudos
Resolved! databricks Asset Bundle
i have come accross a documentation on asset bundles long back whcih states that when you typedatabricks bundle initit gives us option to choose a project type. But i see the below error when i do that i see the below erroris there a way, i can take ...
- 2473 Views
- 11 replies
- 1 kudos
- 1267 Views
- 1 replies
- 2 kudos
column mask on <tinyint>Y columns gives error
My table breaks when I try to mask a column with a name like `<tinyint>Y` -- Create a table with a masked column> CREATE FUNCTION mask_int_col(col_val INTEGER) RETURN CASE WHEN is_member('HumanResourceDept') THEN col_val ELSE CAST(NULL as INTEGER) EN...
- 1267 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @DW ,I have replicated your scenario and encountered the same error when applying a column mask to a column named 1Y in Databricks SQL.In short, it makes sense simply to follow Databricks documentation and use the SQL naming conventions, so that c...
- 2 kudos
- 677 Views
- 1 replies
- 0 kudos
Databricks Pyspark filter several columns with similar criteria
I am querying a table from the Databricks Catalog which I have to filter several columns with the same criteria. below is what I have created so far. I have 10 columns that I have filter with a set of criteria from (dx_list1) and another 10 that I ...
- 677 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @abueno ,As I understand the logic you want to implement is:1. For every pair of columns:First Column (DX_i): Must be in dx_list1Second Column (DX_{i+1}): Must be in dx_list22. The condition for each pair is:col('DX_i').isin(dx_list1) OR col('DX_{...
- 0 kudos
- 1980 Views
- 3 replies
- 1 kudos
How to retrieve Spark Session inside java jar library installed on Cluster
I have a java app in form of jar package. This jar is installed on a Databricks cluster. This jar package reads and writes to few tables in databricks. In order to achieve that, I need SparkSession available in the code. Given that spark session is a...
- 1980 Views
- 3 replies
- 1 kudos
- 576 Views
- 0 replies
- 0 kudos
Course registration issue
Hi All,I'm trying to register for "Spark Developer course" which is free course but I don't see this course under the course catalogue and if I try to directly access using a link I get 403 forbidden error. Can anyone help me figure out the issue.
- 576 Views
- 0 replies
- 0 kudos
- 2066 Views
- 7 replies
- 0 kudos
Unable to install the Databricks in AWS
I have followed the instructions given in the following link https://docs.databricks.com/en/admin/workspace/quick-start.html#use-aws-quickstart-to-create-a-databricks-workspace%22There was an error in CFT while deploying the workspace. Please help[ER...
- 2066 Views
- 7 replies
- 0 kudos
- 0 kudos
Hi @rseshadri ,I'm more familiar with Azure, but this error is most commonly caused by entering the wrong credentials in the Cloudformation template.Try to launch the Quickstart again from the Databricks Account Console and double check that you ente...
- 0 kudos
- 628 Views
- 2 replies
- 1 kudos
How to delete object permissions using REST API
We have REST API methods to set,update,Get object permissions documented here https://docs.databricks.com/api/workspace/permissionsIs there a way to revoke the permissions which are granted through REST API
- 628 Views
- 2 replies
- 1 kudos
- 1 kudos
Thank you for your response!We have a situation where we assigned CAN_BIND permissions to a group for a service principal using the following:$ vim grant-service-principal.json{"access_control_list": [{"user_name": "{username}","permission_level": "C...
- 1 kudos
- 9224 Views
- 3 replies
- 1 kudos
How list all USERs FROM a especific GROUP USING SQL?
I want to list, using sql editor, all users name from a specific group.Reading documentation, I only learned how to show the groups or the users, using simples filters, like:SHOW GROUPS LIKE '*XPTO*';SHOW GROUPS WITH USER `test@gmail.com`SHOW USERS L...
- 9224 Views
- 3 replies
- 1 kudos
- 1 kudos
I don't think it's possible yet. Unfortunately, I look in all system tables and command and didn't found this kind of things.But with a Python notebook, like what did the AI, you can reconstruct it:first you list all the users withSHOW USERSthen you ...
- 1 kudos
- 2374 Views
- 3 replies
- 0 kudos
How to Read Data from Databricks Worker Nodes in Unity Catalog Volume
I am currently working on a similarity search use case where we need to extract text from PDF files and create a vector index. We have stored our PDF files in a Unity Catalog Volume, and I can successfully read these files from the driver node.Here's...
- 2374 Views
- 3 replies
- 0 kudos
- 4511 Views
- 2 replies
- 0 kudos
ArcGIS Connection
Hi,I am trying to connect to an ArcGIS instance using Data bricks. Is this possible? After connecting, I am trying to read the data into a Data fame.Please help me with this request. If its not possible to connect , please provide an alternative.Than...
- 4511 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello, please. Feel free to reach out if you need support deploying ArcGIS within Databricks. Nowadays, there are multiple ways for users to leverage the power of Databricks while using Esri's advanced tools and the app creators once the analysis is ...
- 0 kudos
- 1150 Views
- 2 replies
- 0 kudos
Resolved! Databricks Certified Associate Developer for Apache Spark 3 Got Suspended. Require Immediate support
Hello @Cert-Team @Certificate Team,Request Id# 00544837I encountered a pathetic experience while attempting my Databricks Certified Associate Developer for Apache Spark 3 certification exam. I had answered more than 44 questions I applied for Data...
- 1150 Views
- 2 replies
- 0 kudos
- 1071 Views
- 3 replies
- 0 kudos
Unable to install databricks free trial on AWS
I was trying to install databricks on AWS using these instructions "https://docs.databricks.com/en/admin/workspace/quick-start.html#use-aws-quickstart-to-create-a-databricks-workspace". But when CloudFormation Template stack executed "createCredentia...
- 1071 Views
- 3 replies
- 0 kudos
- 0 kudos
I am facing the same error when installing the Databricks in AWS, Please find attached the error below and help [ERROR] 2024-10-08T12:11:56.458Z ad8dd24a-67ec-4941-8096-3f8d883994b2 Exception: Expecting value: line 1 column 1 (char 0)Traceback (most ...
- 0 kudos
- 1985 Views
- 2 replies
- 1 kudos
Private Python Package in Serverless Job
I am trying to create a Databricks Job using Serverless Compute. I am using wheel file to run the Python Job.The wheel file has setup.py file using which all dependencies are installed. One of the package dependency is a private package hosted on Git...
- 1985 Views
- 2 replies
- 1 kudos
