- 10199 Views
- 2 replies
- 1 kudos
UCX Installation
We aim to streamline the UCX installation process by utilizing Databricks CLI and automating the manual input of required details at each question level .Could you please guide us how can we achieve to automate the parameter's while installation? wha...
- 10199 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi Team, We don't see option at UCX command level passing parameters as json /config file, could you please help me in this case how we can automate the installation.
- 1 kudos
- 956 Views
- 1 replies
- 0 kudos
Error Handling for Web Data Retrieval and Storage in Databricks UNITY Clusters
The following code works well in a normal Databricks cluster, where it passes a null JSON and retrieves content from the web link. However, in a Unity cluster, it produces the following error: 'FileNotFoundError: [Errno 2] No such file or directory: ...
- 956 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @nidhin , Good Day! The reason behind the below error while trying to access the external dbfs mount file using "with open" is that you are using a shared access mode cluster. 'FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/mnt/ra...
- 0 kudos
- 2007 Views
- 1 replies
- 0 kudos
Databricks GPU utilization not to full extent
Hi Everyone, I have been running below code. However Im getting CUDA out of memory error even though I have 4 GPUs in cluster which should ideally have 64 GB GPU , but the code is failing with 16 GB. I assume that the code is not utilizing all 4 GPU ...
- 2007 Views
- 1 replies
- 0 kudos
- 0 kudos
Your code is loading the full model into a single GPU so having multiple GPUs does not prevent out of memory errors. By default, transformer models only have DDP (distributed data parallel) so each GPU has a copy of your model for speeding up trainin...
- 0 kudos
- 3641 Views
- 0 replies
- 0 kudos
UCX Installation without CLI
Hi Team, Can we install UCX Toolkit into databricks workspace without installing it via Databricks CLI? If its possible then How ?https://github.com/databrickslabs/ucx
- 3641 Views
- 0 replies
- 0 kudos
- 4442 Views
- 1 replies
- 0 kudos
Resolved! Unittesting databricks.sdk.runtime
How to mock a code that uses dbutils from"from databricks.sdk.runtime import dbutils"it shows databricks-sdk has no attribute runtime
- 4442 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @samarth_solanki , I Hope you are doing well! Based on the information you have shared, it seems like you're trying to import dbutils from databricks.sdk.runtime, but you're encountering an error that says "databricks-sdk has no attribute runtime...
- 0 kudos
- 13811 Views
- 6 replies
- 9 kudos
Notebook scrolling as I select
When I select text in a notebook cell the whole notebook scrolls up as a select. This happens when I use the mouse wheel and with shift+arrow key. It varies by cell - happens in some cells, but not other cells within the same notebook. When I refresh...
- 13811 Views
- 6 replies
- 9 kudos
- 9 kudos
I'm relieved to know that I'm not the only one experiencing this issue.Please, address this as soon as possible. It's significantly impacting my productivity.
- 9 kudos
- 1770 Views
- 1 replies
- 3 kudos
Resolved! How do i fix QB Error code 6000 301?
When I try to access my company files, I keep getting the error 6000 301 in QB. Please assist me in fixing this mistake.
- 1770 Views
- 1 replies
- 3 kudos
- 3 kudos
Are you facing QB error 6000 301 while trying to log in to your company file in QB Desktop and don’t know what should be done next? If yes, then you should not panic at all because through this post I am going to tell you everything you need to know ...
- 3 kudos
- 2659 Views
- 2 replies
- 0 kudos
Resolved! Create Storage Credential 500 Response
I'm trying to create storage credentials for an Azure Databricks Connector at the workspace level with a service principal that has the CREATE_STORAGE_CREDENTIAL but is NOT an account admin. For this test, the SP has the owner role on the connector.I...
- 2659 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @ledbutter , hope you are doing well today! I have gone through the details and this issue might be related to https://github.com/databricks/cli/issues/1080 Please refer to this for more details: https://github.com/databricks/cli/issues/1108 Plea...
- 0 kudos
- 1380 Views
- 2 replies
- 0 kudos
Cells' outputs getting appended at each run - Databricks Notebook
Hello Community,I have the following issue. When I am running cells from a notebook, I have the print outputs from the previous cells that are appended to the current print output (meaning running cell 1 gives output 1, running cell 2 gives output 1 ...
- 1380 Views
- 2 replies
- 0 kudos
- 2149 Views
- 0 replies
- 1 kudos
cost finding and optimization
Hi Team,Could you please suggest the best way to track the cost of Databricks objects/components? Could you please share any best practices for optimizing costs and conducting detailed cost analysis?Regards,Phanindra
- 2149 Views
- 0 replies
- 1 kudos
- 4006 Views
- 2 replies
- 2 kudos
Resolved! Rss feeds for databricks releases
Hi,are there any rss feeds for the databricks platform, sql & runtime releases? We have a big tech stack so it is sometimes hard to keep up with the ever changing technologies. We are using rss feeds to keep up with all of that.Cant find anything for...
- 4006 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @florianb , You can keep these documents handy for the Platform releases and SQL Runtime releases: Platform Releases: https://docs.databricks.com/en/release-notes/product/index.html SQL Releases: https://docs.databricks.com/en/sql/release-notes/in...
- 2 kudos
- 1942 Views
- 1 replies
- 0 kudos
Capture changes at the object level in Databricks
Could you please suggest how to capture changes at the object level in Databricks, such as notebooks changes, table DDL changes, view DDL , functions DDL, and workflows etc. changes? We would like to build a dashboard for changes.
- 1942 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Phani1 , Good Day! Could you kindly clarify on your question about the capture change? What type of change do you want to capture? If you want to see what modifications the user made to the Notebooks, tables, and workflow, you can check the audi...
- 0 kudos
- 1603 Views
- 1 replies
- 0 kudos
Getting internal server error while creating a new query definition
Hi, I am trying to create a query definition using API '/api/2.0/preview/sql/queries' in postman but getting internal server error. Below is the snap for the snap. Let me know If I am doing anything wrong here.
- 1603 Views
- 1 replies
- 0 kudos
- 0 kudos
I'm interested to know how this error was resolved. I'm getting an "Internal Server Error" returned when trying to create queries with version 1.36.1 of the Databricks Terraform Provider. The error provides no other information.
- 0 kudos
- 7348 Views
- 2 replies
- 0 kudos
Parallel jobs with individual contexts
I was wondering if someone could help us with implementation here. Our current program will spin up 5 jobs through the Databricks API using the same Databricks cluster but each one needs their own spark context (specifically each one will connect to ...
- 7348 Views
- 2 replies
- 0 kudos
- 0 kudos
you can set up buckets with different credentials, endpoints, and so on.https://docs.databricks.com/en/connect/storage/amazon-s3.html#per-bucket-configuration
- 0 kudos
- 1927 Views
- 1 replies
- 0 kudos
Log notebook activities
Hi friends;I'm working on a project where we are 4 programmers. We are working in a single environment, using only the "Workspaces" folder. Each has its own user, which is managed by Azure AD.We had a peak in consumption on the 5th Feb. So I can see ...
- 1927 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod , thanks for your quick answer.There is no other way to monitor notebook runs. I ask this because adding tags to the cluster and workspace does not solve my problem, considering that everyone uses the same cluster and the same workspa...
- 0 kudos
