- 1008 Views
- 2 replies
- 1 kudos
Resolved! DBX Community Pending Answers
Hi there, in the past I've posted questions in this community and I would consistently get responses back in a very reasonable time frame. Typically I think most of my posts have an initial response back within 1-2 days, or just a few days (I don't t...
- 1008 Views
- 2 replies
- 1 kudos
- 1 kudos
Thank you for clarifying. I know some questions may be a bit more technical, but I hope I get some feedback/suggestions, particularly to my UMF Best Practice question!
- 1 kudos
- 506 Views
- 1 replies
- 1 kudos
Resolved! Is there a way to iterate over a combination of parameters using a "for each" task?
Hi,I have a notebook with two input widgets set up ("current_month" and "current_year") that the notebook grabs values from and uses for processing. I want to be able to provide a list of input values in the "for each" task where each value is actual...
- 506 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi there @sys08001 , yup it is possible you can pass the input values for the for_each task in json format Somewhat like this[ { "tableName": "product_2", "id": "1", "names": "John Doe", "created_at": "2025-02-22T10:00:00.000Z" },...
- 1 kudos
- 1293 Views
- 2 replies
- 0 kudos
Azure Databricks - Databricks AI Assistant missing on Azure Student Subscription?
I am going through a course learning Azure Databricks and I had created a new Azure Databricks Workspace. I am the owner of the subscription and created everything so I assume I should have full admin rights.The following is my set up-Azure Student S...
- 1293 Views
- 2 replies
- 0 kudos
- 0 kudos
@rodneyc8063 According to Azure’s documentation, it states:Tip:Admins: If you’re unable to enable Databricks Assistant, you might need to disable the "Enforce data processing within workspace Geography for Designated Services" setting. See “For an ac...
- 0 kudos
- 8445 Views
- 12 replies
- 2 kudos
Is it possible to view Databricks cluster metrics using REST API
I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.I am trying it in postman using databricks token and with my Service Principal bear...
- 8445 Views
- 12 replies
- 2 kudos
- 248 Views
- 1 replies
- 0 kudos
Resolved! Access to Demo: Databricks Workspace Walkthrough
Hi,How can I have access to Databricks Workspace Walkthrough hands-on (guidance) in free courses to practice?Thanks
- 248 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @MariaSaa! The free Databricks courses don’t include access to hands-on labs. Practical lab environments are currently available only through paid training options or with an Academy Labs subscription.
- 0 kudos
- 443 Views
- 3 replies
- 0 kudos
Allow an external user to query SQL table in Databricks
I have a delta table sitting in a schema inside a catalog. How do I allow an external user to query the SQL table via an API? I scrolled through documentation and a lot of resources but it's all so confusing. The AI assistant is way too naive. Can so...
- 443 Views
- 3 replies
- 0 kudos
- 0 kudos
We will need a bit more information. Are you asking: A) how an external user who is skilled at code can invoke a sql query via api. or B) how a non-technical external user can run a query via a simple ui?If it's option A: then you can create a person...
- 0 kudos
- 1077 Views
- 1 replies
- 0 kudos
Install bundle built artifact as notebook-scoped library
We are having a hard time finding an intuitive way of using the artifacts we build and deploy with databricks bundle deploy notebook-scoped.Desired result:Having internal artifacts be available notebook-scoped for jobs by configorHaving an easier way...
- 1077 Views
- 1 replies
- 0 kudos
- 0 kudos
We were not able to find a clean solution for this, so what we ended up doing is referencing the common lib like this in every notebook it is needed.%pip install ../../../artifacts/.internal/common-0.1-py3-none-any.whl
- 0 kudos
- 492 Views
- 2 replies
- 0 kudos
Autoloader delete action on AWS S3
Hi folks, I have been using autoloader to ingest files from S3 bucket.I tried to add trigger on the workflows to schedule the job to run every 10 minutes. However, recently I'm facing an error that makes the jobs keep failing after a few success run....
- 492 Views
- 2 replies
- 0 kudos
- 0 kudos
There might be few possibilities : can you check this items ? 1. Is there any s3 bucket policy configured like within timeframe file deletion or file validity configured ? 2. check the autload configuration once again to validate the option of cleanu...
- 0 kudos
- 397 Views
- 0 replies
- 0 kudos
Time Series Book by a Senior Solutions Architect
I recently worked with one of the Senior Solutions Architects, Yoni Ramaswami (https://www.linkedin.com/in/yoni-r/) with Databricks on a new book" Time Series Analysis with Spark" Key FeaturesQuickly get started with your first models and explore the...
- 397 Views
- 0 replies
- 0 kudos
- 739 Views
- 1 replies
- 0 kudos
Unable pass array of tables names from for each and send it task param
sending below array list from for each task["mv_t005u","mv_t005t","mv_t880"] In the task , iam reading value as key :mv_namevalue :{{input}} but in note book i am getting below errorNote book code:%sqlREFRESH MATERIALIZED VIEW nonprod_emea.silver_loc...
- 739 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @sivaram_mandepu,In the first screenshot, the input must be a valid JSON array, so instead of using {{mvname: "mv_......"}}, update it to [ { "mvname": "mv_......." } ].In the third screenshot, the SQL error likely comes from a newline or extra sp...
- 0 kudos
- 558 Views
- 2 replies
- 0 kudos
No views visible via foreign catalog
Hello,I have created a connection to a SQL Server. I have created a foreign catalog using this connection.When I show the catalog in the catalog explorer I can see the schemas and I can also see the tables and views in one schema. In another schema,...
- 558 Views
- 2 replies
- 0 kudos
- 0 kudos
@dipudot, yes the permission are OK. I can see them in SQL Serber Management using the same account.I have read somewhere that the some characters might not be supported. The views have all the pattern <tenant>$<table_name>.I will retest with a small...
- 0 kudos
- 1230 Views
- 3 replies
- 0 kudos
Resolved! Init Scripts Error When Deploying a Delta Live Table Pipeline with Databricks Asset Bundles
Hello everyone,Let me give you some context. I am trying to deploy a Delta Live Table pipeline using Databricks Asset Bundles, which requires a private library hosted in Azure DevOps.As far as I understand, this can be resolved in three ways:Installi...
- 1230 Views
- 3 replies
- 0 kudos
- 0 kudos
I detected the error; it was due to the path defined in the bundle where the init script was located.I'm closing the post.
- 0 kudos
- 3848 Views
- 2 replies
- 0 kudos
FAILED_READ_FILE.NO_HINT error
We read data from csv in the volume into the table using COPY INTO. The first 200 files were added without problems, but now we are no longer able to add any new data to the table and the error is FAILED_READ_FILE.NO_HINT. The CSV format is always th...
- 3848 Views
- 2 replies
- 0 kudos
- 0 kudos
I came across the same issue and the file causing problems needed the csv option "multiline" set back to the default "false" to read the file:df = spark.read.option("multiline", "false").csv("CSV_PATH") If this approach eliminates the error above, I ...
- 0 kudos
- 487 Views
- 2 replies
- 1 kudos
webterm unminimize command missing?
A lot of commands in webterm basically tell you a bunch of stuff has been not installed or minimized and you should run `unminimize` for a full interactive experience.This used to work great. However, I just tried it and the unminimize command is no...
- 487 Views
- 2 replies
- 1 kudos
- 1 kudos
1. no such command exists2. probably not - we tend to dump old clusters and create new ones (for new sets of data) fairly frequently and (I think) use the latest stable DBR when creating3. I did find a workaround. unminimize has been added to apt so...
- 1 kudos
- 861 Views
- 2 replies
- 0 kudos
Resolved! Change Data Feed And Column Masks
Hi there,Wondering if anyone can help me. I have had a job set up to stream from one change data feed enabled delta table to another delta table and has been executing successfully. I then added column masks to the source table from which I am stream...
- 861 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello Mate,Hope doing great,you can configure a service principle in that case, add proper roles as per needs and use as run owner. Re_run the stream so that your PII will not be able to display to other teams/persons until having the member. Simple ...
- 0 kudos
