cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Cloud_Architect
by New Contributor III
  • 132 Views
  • 1 replies
  • 0 kudos

Need help calculating the cost benefits of switching from interactive to job cluster

I need help calculating the cost benefits of switching from interactive to job cluster. Can you help me get some formulas on how to calculate the cost differences in Databricks?

  • 132 Views
  • 1 replies
  • 0 kudos
Latest Reply
jacovangelder
Contributor III
  • 0 kudos

Assuming you're on Azure (otherwise use the AWS/GCP equivalent), did you try the Azure cost calculator? https://azure.microsoft.com/en-us/pricing/details/databricks/Question to ask yourself to get more specific: Do you have an idea how much DBU's you...

  • 0 kudos
Arch_dbxlearner
by New Contributor III
  • 1565 Views
  • 4 replies
  • 0 kudos

How to get data from Splunk on daily basis?

I am finding the ways to get the data to Databricks from Splunk (similar to other data sources like S3, Kafka, etc.,). I have received a suggestion to use the Databricks add-on to get/put the data from/to Splunk. To pull the data from Databricks to S...

Community Discussions
Databricks add-on
Splunk
  • 1565 Views
  • 4 replies
  • 0 kudos
Latest Reply
shan_chandra
Esteemed Contributor
  • 0 kudos

@Arch_dbxlearner  - could you please follow the post for more details.  https://community.databricks.com/t5/data-engineering/does-databricks-integrate-with-splunk-what-are-some-ways-to-send/td-p/22048  

  • 0 kudos
3 More Replies
MadCowTM
by New Contributor II
  • 780 Views
  • 1 replies
  • 2 kudos

Resolved! get_json_object and json path filtering

I have following string [{"key":"abc","value":{"string_value":"abc123"}},{"key":"def","value":{"int_value":123}},{"key":"ghi","value":{"string_value":"ghi456"}}] and from that string i need to extract key.value.string_value for key with the value equ...

  • 780 Views
  • 1 replies
  • 2 kudos
Latest Reply
brickster_2018
Esteemed Contributor
  • 2 kudos

Can you try with the below code snippet WITH exploded_json AS ( SELECT explode(from_json( '[{"key":"abc","value":{"string_value":"abc123"}},{"key":"def","value":{"int_value":123}},{"key":"ghi","value":{"string_value":"ghi456"}}]', 'array<s...

  • 2 kudos
unity_Catalog
by New Contributor
  • 327 Views
  • 0 replies
  • 0 kudos

UCX installation error

I am getting the below error while Installing UCX. But Installation is done in the workspace.I have admin privileges on the workspace. The below error suggests to check token or URL of workspace.They are provided correctly.Then why below error is sho...

  • 327 Views
  • 0 replies
  • 0 kudos
Rapha
by New Contributor II
  • 566 Views
  • 4 replies
  • 0 kudos

Error when cloning repository

Hi all,cloning a devops repo worked like a charm every time, but now I get a weird error, that I do not understandWhat container is meant here and why would I need one?Thanks and regards,Raphael

Rapha_0-1717503863381.png
  • 566 Views
  • 4 replies
  • 0 kudos
Latest Reply
Rapha
New Contributor II
  • 0 kudos

@Yeshwanth I am sorry, I thought I replied to you on friday. I cannot upload a .har file. I get the error message:The file type (.har) is not supported. Valid file types are: jpg, gif, png, pdf.

  • 0 kudos
3 More Replies
jamesdavids
by New Contributor
  • 327 Views
  • 1 replies
  • 0 kudos

Spark Excel Library Insufficient Privileges

HiWe have a shared access mode cluster in which we have installed a maven library for reading excel files into a Spark DataFrame. When using an account with admin rights everything works fine, however when we run it as a standar user we always get `o...

jamesdavids_0-1717747232287.png
  • 327 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

Hello James, this issue seems to be related to shared cluster limitations, as per docs: Libraries used as JDBC drivers or custom Spark data sources on Unity Catalog-enabled shared compute require ANY FILE permissions.Moving to a single user cluster m...

  • 0 kudos
JameDavi_51481
by New Contributor III
  • 218 Views
  • 1 replies
  • 0 kudos

How to escape column comments when adding them programmatically

I would like to add comments to all of our columns, programmatically. The only way I can find to do this is through SQL DDL - e.g. `alter table sometable alter column somecolumn comment 'some comment string`. However, I want to read this comment stri...

  • 218 Views
  • 1 replies
  • 0 kudos
Latest Reply
brockb
Valued Contributor
  • 0 kudos

Hi @JameDavi_51481 ,I do not believe this is supported currently, please see this line in the Parameter Marker documentation: > You must not reference a parameter marker in a DDL statement...Ref: https://docs.databricks.com/en/sql/language-manual/sql...

  • 0 kudos
amit-agarwal4
by New Contributor II
  • 507 Views
  • 2 replies
  • 0 kudos

how to clone a table using Column and row level mask

I am working on use case to clone a table which has column and row level masking implemented.Can i clone the table, based on documentation it is not possible. what are the other alternatives i have ?

  • 507 Views
  • 2 replies
  • 0 kudos
Latest Reply
raphaelblg
Honored Contributor
  • 0 kudos

@amit-agarwal4 At the current moment, I'm not aware of any other way than disabling the RLS.     

  • 0 kudos
1 More Replies
tejas8196
by New Contributor II
  • 490 Views
  • 2 replies
  • 0 kudos

DAB not updating zone_id when redeployed

Hey folks,Facing an issue with zone_id not getting overridden when redeploying the DAB template to Databricks workspace.The Databricks job is already deployed and has "ap-south-1a" zone_id. I wanted to make it "auto" so, I have made the changes to th...

Screenshot 2024-06-05 at 12.40.57 AM.png
Community Discussions
data engineering
  • 490 Views
  • 2 replies
  • 0 kudos
Latest Reply
davicd2658
New Contributor II
  • 0 kudos

Hello,Thanks for the info I will try to figure it out for more.

  • 0 kudos
1 More Replies
Prasad_Koneru
by New Contributor III
  • 519 Views
  • 1 replies
  • 0 kudos

Databricks grant update calatog catlog_name --json @privileges.json not updating privileges

Hi Team, I am trying to update the catalog permission privileges using databricks cli command Grant by appending json file but which is not updating the prIviliges, please help on grant update command usage.Command using :  databricks grants update c...

  • 519 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ravivarma
New Contributor III
  • 0 kudos

Hello @Prasad_Koneru   If the command is not updating the privileges as expected, there could be a few reasons for this.  Firstly, ensure that the JSON file is correctly formatted and contains the correct privilege assignments. The privileges.json fi...

  • 0 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!