cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

idanyow
by New Contributor III
  • 2436 Views
  • 10 replies
  • 2 kudos

01_demo_setup error

HelloI was following "Demo: Creating and Working with a Delta Table"while I have a community edition user.The first command in the Notebook is: %run ./setup/01_demo_setup But I got the following error:Notebook not found: Users/<my-email-was-here..>/s...

  • 2436 Views
  • 10 replies
  • 2 kudos
Latest Reply
Isi
Honored Contributor III
  • 2 kudos

Hey!Sad news guys... if you go to Course Logistics Review you can read:"We are pleased to offer a version of this course that also contains hands-on practice via a Databricks Academy Labs subscription. With a Databricks Academy Labs subscription, you...

  • 2 kudos
9 More Replies
Rakeshch007
by New Contributor
  • 1341 Views
  • 1 replies
  • 0 kudos

Databricks app giving 'upstream request timeout '

Hello all,We are developing an app which is based on flask, which is used to download logs from databricks dbfs location. For this useful case we are using databricks inbuilt App feature to deploy our app.While we pass a smaller file it is getting do...

  • 1341 Views
  • 1 replies
  • 0 kudos
Latest Reply
Isi
Honored Contributor III
  • 0 kudos

Hey!It looks like the issue you’re facing might be related to the proxy timeout when downloading large files from DBFS. Since modifying the proxy settings might not be an option, there are a couple of alternative approaches you could consider to miti...

  • 0 kudos
haritashva31
by New Contributor
  • 7153 Views
  • 3 replies
  • 0 kudos

50%-off Databricks certification voucher

Hello Databricks Community Team, I am reaching out to inquire about the Databricks certification voucher promotion for completing the Databricks Learning Festival (Virtual) courses.I completed one of the Databricks Learning Festival courses July 2024...

  • 7153 Views
  • 3 replies
  • 0 kudos
Latest Reply
MARC9312
New Contributor II
  • 0 kudos

I have already finished the course, how do I get the discount?

  • 0 kudos
2 More Replies
naveen0142
by New Contributor
  • 1624 Views
  • 1 replies
  • 0 kudos

How to Create Azure Key Vault and Assign Key Vault Administrator Role Using Terraform

Hi all,I’m currently working with Terraform to set up Azure resources, including OpenAI services, and I’d like to extend my configuration to create an Azure Key Vault. Specifically, I want to:Create an Azure Key Vault to store secrets/keys.Assign the...

  • 1624 Views
  • 1 replies
  • 0 kudos
Latest Reply
parthSundarka
Databricks Employee
  • 0 kudos

Hi @naveen0142 , 1. Create the Key Vault resource "azurerm_key_vault" "example" { name = var.key_vault_name location = azurerm_resource_group.example.location resource_group_name = azurerm_resource_group.example....

  • 0 kudos
Iguinrj11
by New Contributor II
  • 597 Views
  • 0 replies
  • 0 kudos

Atualização Incremental e/ou Modelos Compostos (Databricks x Power BI)

Gostaria de deixar meu modelo mais performático no Power BI, mas tenho encontrado algumas dificuldades ao conectá-lo em uma fonte no DataBricks. Queria saber se é possível fazer atualização incremenal e/ou trabalhar com modelos compostos (Direct Quer...

  • 597 Views
  • 0 replies
  • 0 kudos
Sudheer2
by New Contributor III
  • 2083 Views
  • 1 replies
  • 0 kudos

User Unable to Access Key Vault Secrets Despite Role Assignment in Terraform

Hi All,I'm encountering an issue where a user is unable to access secrets in an Azure Key Vault, even though the user has been assigned the necessary roles using Terraform. Specifically, the user gets the following error when trying to access the sec...

  • 2083 Views
  • 1 replies
  • 0 kudos
Latest Reply
mm41
New Contributor II
  • 0 kudos

Are they accessing the Key Vault directly and not through Databricks? If so, based on your Terraform code, they should be able to directly read Secrets in the Azure Key Vault.  You've configured the Key Vault with RBAC Authorization and assigned Key ...

  • 0 kudos
bvraravind
by New Contributor II
  • 877 Views
  • 1 replies
  • 0 kudos

Prevent users from running shell commands

Hi, is there any way to prevent users from running shell commands in Databricks notebooks? for example, "%%bash" I read that REVOKE EXECUTE ON SHELL command can be used. but i am unable to make it to work. Thanks in advance for any help.

  • 877 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hi @bvraravind, You can use this spark setting  "spark_conf.spark.databricks.repl.allowedLanguages": { "type": "fixed", "value": "python,sql" Over a cluster policy to prevent access to shell commands. https://docs.databricks.com/en/archive/compute/c...

  • 0 kudos
Sudheer2
by New Contributor III
  • 2145 Views
  • 2 replies
  • 0 kudos

Terraform: Add Key Vault Administrator Role Assignment and Save Outputs to JSON Dynamically in Azure

Hi everyone,I am using Terraform to provision an OpenAI service and its modules along with a Key Vault in Azure. While the OpenAI service setup works as expected, I am facing two challenges:Role Assignment for Key VaultI need to assign the Key Vault ...

  • 2145 Views
  • 2 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

For question two, you can use the local_file resource in Terraform: output "openai_api_type" {value = module.openai.api_type} output "openai_api_base" {value = module.openai.api_base} output "openai_api_version" {value = module.openai.api_version} ou...

  • 0 kudos
1 More Replies
thrinadhReddy
by New Contributor II
  • 4661 Views
  • 4 replies
  • 1 kudos

Cluster policy type

Hi guys,I am creating a cluster policy through json. "runtime_engine": {"type": "fixed""value": "PHOTON"}When I run the above code... PHOTON option is getting enabled but graying out... What would I specify in type field so that the photon option sho...

  • 4661 Views
  • 4 replies
  • 1 kudos
Latest Reply
Khalil_Robinson
New Contributor II
  • 1 kudos

Hey, If you change the type to "allowlist" and provide "PHOTON" and "STANDARD" as options that should fix your issue.here is an example: "runtime_engine": {"type": "allowlist""value": ["PHOTON", "STANDARD"]"defaultValue": "PHOTON"}

  • 1 kudos
3 More Replies
Wojciech_BUK
by Valued Contributor III
  • 2369 Views
  • 1 replies
  • 1 kudos

All my replies has been deleted and new one is being moderated (deleted) - why?

I noticed that when I Reply to post and trying to help solve community problem - my post are being either moderated (deleted) or just not being saved. Old post/replies has been deleted.Is there any reason for that?I kind of lost my will to participat...

  • 2369 Views
  • 1 replies
  • 1 kudos
Latest Reply
hari-prasad
Valued Contributor II
  • 1 kudos

Currently, I'm also facing same issue, my comments are automatically deleted and also not receiving email for same, which is happening to specific post.

  • 1 kudos
sanjay
by Valued Contributor II
  • 3588 Views
  • 2 replies
  • 2 kudos

Error accessing file from dbfs inside mlflow serve endpoint

Hi,I have mlflow model served using serverless GPU which takes audio file name as input and then file will be passed as parameter to huggiung face model inside predict method. But I am getting following errorHFValidationError(\nhuggingface_hub.utils....

  • 3588 Views
  • 2 replies
  • 2 kudos
Latest Reply
txti
New Contributor III
  • 2 kudos

I have the same issue.I have a large file that I cannot access from an MLFlow service.Things I have tried (none of these work):Read-only from DBFS`dbfs:/myfolder/myfile.chroma` does not work`/dbfs/myfolder/myfile.chroma` does not workRead-only from U...

  • 2 kudos
1 More Replies
AlexG
by New Contributor III
  • 5820 Views
  • 5 replies
  • 1 kudos

Query results in csv file include 'null' string for blank cell

After running a sql script, when downloading the results to a csv file, the file includes a null string for blank cells (see screenshot). Is ther a setting I can change to simply get empty cells instead? 

AlexG_1-1702927614092.png
  • 5820 Views
  • 5 replies
  • 1 kudos
Latest Reply
NandiniN
Databricks Employee
  • 1 kudos

I understand, however this is more on CSV file format.  Save your data in Delta format instead of CSV or text-based formats. Delta tables handle empty strings and NULL values more effectively, ensuring that empty strings are preserved during data ins...

  • 1 kudos
4 More Replies
ChristianRRL
by Honored Contributor
  • 6875 Views
  • 6 replies
  • 1 kudos

Materialized Views Without DLT?

I'm curious, is DLT *required* to use Materialized Views in Databricks? Is it not possible to create and refresh a Materialized view via a standard Databricks Workflow?

  • 6875 Views
  • 6 replies
  • 1 kudos
Latest Reply
hari-prasad
Valued Contributor II
  • 1 kudos

Hi @ChristianRRL ,When creating a materialized view in Databricks, the data is stored in DBFS, cloud storage, or Unity Catalog volume. You can still create a materialized view by overwriting the same table each time, instead of using Append, Update, ...

  • 1 kudos
5 More Replies
ChristianRRL
by Honored Contributor
  • 4810 Views
  • 4 replies
  • 1 kudos

Purpose of DLT Table table_properties > quality:medallion

Hi there, silly question here but can anyone help me understand what practical purpose does labelling the table_properties with "quality":"<specific_medallion>"? For example: @Dlt.table( comment="Bronze live streaming table for Test data", name="...

  • 4810 Views
  • 4 replies
  • 1 kudos
Latest Reply
nochimo
New Contributor II
  • 1 kudos

I'm with the same doubt @ChristianRRL, did you figured out something related to it?My doubt is to check if it's possible to apply any kind of access control based on this property.

  • 1 kudos
3 More Replies
Labels