- 2384 Views
- 1 replies
- 0 kudos
Databricks GPU utilization not to full extent
Hi Everyone, I have been running below code. However Im getting CUDA out of memory error even though I have 4 GPUs in cluster which should ideally have 64 GB GPU , but the code is failing with 16 GB. I assume that the code is not utilizing all 4 GPU ...
- 2384 Views
- 1 replies
- 0 kudos
- 0 kudos
Your code is loading the full model into a single GPU so having multiple GPUs does not prevent out of memory errors. By default, transformer models only have DDP (distributed data parallel) so each GPU has a copy of your model for speeding up trainin...
- 0 kudos
- 3829 Views
- 0 replies
- 0 kudos
UCX Installation without CLI
Hi Team, Can we install UCX Toolkit into databricks workspace without installing it via Databricks CLI? If its possible then How ?https://github.com/databrickslabs/ucx
- 3829 Views
- 0 replies
- 0 kudos
- 4925 Views
- 1 replies
- 0 kudos
Resolved! Unittesting databricks.sdk.runtime
How to mock a code that uses dbutils from"from databricks.sdk.runtime import dbutils"it shows databricks-sdk has no attribute runtime
- 4925 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @samarth_solanki , I Hope you are doing well! Based on the information you have shared, it seems like you're trying to import dbutils from databricks.sdk.runtime, but you're encountering an error that says "databricks-sdk has no attribute runtime...
- 0 kudos
- 14949 Views
- 6 replies
- 9 kudos
Notebook scrolling as I select
When I select text in a notebook cell the whole notebook scrolls up as a select. This happens when I use the mouse wheel and with shift+arrow key. It varies by cell - happens in some cells, but not other cells within the same notebook. When I refresh...
- 14949 Views
- 6 replies
- 9 kudos
- 9 kudos
I'm relieved to know that I'm not the only one experiencing this issue.Please, address this as soon as possible. It's significantly impacting my productivity.
- 9 kudos
- 2139 Views
- 1 replies
- 3 kudos
Resolved! How do i fix QB Error code 6000 301?
When I try to access my company files, I keep getting the error 6000 301 in QB. Please assist me in fixing this mistake.
- 2139 Views
- 1 replies
- 3 kudos
- 3 kudos
Are you facing QB error 6000 301 while trying to log in to your company file in QB Desktop and don’t know what should be done next? If yes, then you should not panic at all because through this post I am going to tell you everything you need to know ...
- 3 kudos
- 3215 Views
- 2 replies
- 0 kudos
Resolved! Create Storage Credential 500 Response
I'm trying to create storage credentials for an Azure Databricks Connector at the workspace level with a service principal that has the CREATE_STORAGE_CREDENTIAL but is NOT an account admin. For this test, the SP has the owner role on the connector.I...
- 3215 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @ledbutter , hope you are doing well today! I have gone through the details and this issue might be related to https://github.com/databricks/cli/issues/1080 Please refer to this for more details: https://github.com/databricks/cli/issues/1108 Plea...
- 0 kudos
- 1660 Views
- 2 replies
- 0 kudos
Cells' outputs getting appended at each run - Databricks Notebook
Hello Community,I have the following issue. When I am running cells from a notebook, I have the print outputs from the previous cells that are appended to the current print output (meaning running cell 1 gives output 1, running cell 2 gives output 1 ...
- 1660 Views
- 2 replies
- 0 kudos
- 2323 Views
- 0 replies
- 1 kudos
cost finding and optimization
Hi Team,Could you please suggest the best way to track the cost of Databricks objects/components? Could you please share any best practices for optimizing costs and conducting detailed cost analysis?Regards,Phanindra
- 2323 Views
- 0 replies
- 1 kudos
- 2264 Views
- 1 replies
- 0 kudos
Capture changes at the object level in Databricks
Could you please suggest how to capture changes at the object level in Databricks, such as notebooks changes, table DDL changes, view DDL , functions DDL, and workflows etc. changes? We would like to build a dashboard for changes.
- 2264 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Phani1 , Good Day! Could you kindly clarify on your question about the capture change? What type of change do you want to capture? If you want to see what modifications the user made to the Notebooks, tables, and workflow, you can check the audi...
- 0 kudos
- 1860 Views
- 1 replies
- 0 kudos
Getting internal server error while creating a new query definition
Hi, I am trying to create a query definition using API '/api/2.0/preview/sql/queries' in postman but getting internal server error. Below is the snap for the snap. Let me know If I am doing anything wrong here.
- 1860 Views
- 1 replies
- 0 kudos
- 0 kudos
I'm interested to know how this error was resolved. I'm getting an "Internal Server Error" returned when trying to create queries with version 1.36.1 of the Databricks Terraform Provider. The error provides no other information.
- 0 kudos
- 7714 Views
- 2 replies
- 0 kudos
Parallel jobs with individual contexts
I was wondering if someone could help us with implementation here. Our current program will spin up 5 jobs through the Databricks API using the same Databricks cluster but each one needs their own spark context (specifically each one will connect to ...
- 7714 Views
- 2 replies
- 0 kudos
- 0 kudos
you can set up buckets with different credentials, endpoints, and so on.https://docs.databricks.com/en/connect/storage/amazon-s3.html#per-bucket-configuration
- 0 kudos
- 2185 Views
- 1 replies
- 0 kudos
Log notebook activities
Hi friends;I'm working on a project where we are 4 programmers. We are working in a single environment, using only the "Workspaces" folder. Each has its own user, which is managed by Azure AD.We had a peak in consumption on the 5th Feb. So I can see ...
- 2185 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod , thanks for your quick answer.There is no other way to monitor notebook runs. I ask this because adding tags to the cluster and workspace does not solve my problem, considering that everyone uses the same cluster and the same workspa...
- 0 kudos
- 8105 Views
- 0 replies
- 0 kudos
Data Engineer – Databricks - Remote
Data Engineer – Databricks - RemoteApply Here: Job Application for Data Engineer – Databricks at Jenzabar (greenhouse.io)Jenzabar Website: Higher Education Software Solutions - JenzabarFor over four decades, the higher education experts at Jenzabar h...
- 8105 Views
- 0 replies
- 0 kudos
- 7462 Views
- 0 replies
- 0 kudos
Can the community version of databrick run model training examples?
Hi, Newcomer here. I am experimenting with the community version of databrick.I wanted to run the notebook example provided here https://community.cloud.databricks.com/?o=6085264701896358#notebook/2691200955149229It failed because it cannot import th...
- 7462 Views
- 0 replies
- 0 kudos
- 11245 Views
- 0 replies
- 1 kudos
Calling all innovators and visionaries! The 2024 Data Team Awards are open for nominations
Each year, we celebrate the amazing customers that rely on Databricks to innovate and transform their organizations — and the world — with the power of data and AI. The nomination form is now open to submit nominations. Nominations will close on Marc...
- 11245 Views
- 0 replies
- 1 kudos
