cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 
Help
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Nagasundaram
by • New Contributor II
  • 8762 Views
  • 2 replies
  • 0 kudos

Connect to Databricks using Java SDK through proxy

I'm trying to connect to databricks from java using the java sdk and get cluster/sqlWarehouse state. I'm able to connect and get cluster state from my local. But, once I deploy it to the server, my company's network is not allowing the connection. We...

Get Started Discussions
Reply
  • 8762 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Allia
Databricks Employee
  • 0 kudos

Hi  @Nagasundaram    You can make use of the below init script inorder to use a proxy server with Databricks cluster. The content of the init script can be added at  "Workspace/shared/setproxy.sh"  ================================================== v...

  • 0 kudos
1 More Replies
Surajv
by • New Contributor III
  • 1285 Views
  • 1 replies
  • 0 kudos

Can I use databricks principals on databricks connect 12.2?

Hi community,Is it possible to use Databricks service principals for authentication on Databricks connect 12.2 to connect my notebook or code to Databricks compute, rather than using personal access token? I checked the docs and got to know that upgr...

Get Started Discussions
Reply
  • 1285 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Surajv
New Contributor III
  • 0 kudos

Hi @Retired_modThanks for your response. I was able to generate the token of the service principal following this doc, later saved it in the <Databricks Token> variable prompted when running databricks-connect configure command in terminal. And was a...

  • 0 kudos
samarth_solanki
by • New Contributor II
  • 10417 Views
  • 1 replies
  • 0 kudos

How to add instance profile permission to all user via databricks-sdk workspace client

How to add instance profile permission to all user via databricks-sdk workspace client. Just like terraform where we can give "users" for all users , how can we don same using databricks-sdk workspace-client. I cannot find permission for instance pro...

Get Started Discussions
Reply
  • 10417 Views
  • 1 replies
  • 0 kudos
View Replies
Madalian
by • New Contributor III
  • 826 Views
  • 0 replies
  • 0 kudos

How managed tables are useful in Madalian Archtecture

I am having basic question, As managed tables doesnt store their data into ADLS Gen2. But in our architcture we created 3 containers in ADLS Gen2 (Bronze, Silver and Gold) . If I chose managed tables then neither metadata  nor data doesnt store into ...

Get Started Discussions
Reply
  • 826 Views
  • 0 replies
  • 0 kudos
Phani1
by • Valued Contributor II
  • 9403 Views
  • 2 replies
  • 1 kudos

UCX Installation

We aim to streamline the UCX installation process by utilizing Databricks CLI and automating the manual input of required details at each question level .Could you please guide us how can we achieve to automate the parameter's while installation? wha...

Get Started Discussions
ucx
Reply
  • 9403 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
Phani1
Valued Contributor II
  • 1 kudos

Hi Team, We don't see option at UCX command level  passing parameters as json /config file, could you please help me in this case how we can automate the installation.    

  • 1 kudos
1 More Replies
nidhin
by • New Contributor
  • 810 Views
  • 1 replies
  • 0 kudos

Error Handling for Web Data Retrieval and Storage in Databricks UNITY Clusters

The following code works well in a normal Databricks cluster, where it passes a null JSON and retrieves content from the web link. However, in a Unity cluster, it produces the following error: 'FileNotFoundError: [Errno 2] No such file or directory: ...

Get Started Discussions
Reply
  • 810 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Ayushi_Suthar
Databricks Employee
  • 0 kudos

Hi @nidhin , Good Day!  The reason behind the below error while trying to access the external dbfs mount file using "with open" is that you are using a shared access mode cluster. 'FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/mnt/ra...

  • 0 kudos
shanmukhasai96
by • New Contributor
  • 1732 Views
  • 1 replies
  • 0 kudos

Databricks GPU utilization not to full extent

Hi Everyone, I have been running below code. However Im getting CUDA out of memory error even though I have 4 GPUs in cluster which should ideally have 64 GB GPU , but the code is failing with 16 GB. I assume that the code is not utilizing all 4 GPU ...

Get Started Discussions
Reply
  • 1732 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Jisong
New Contributor II
  • 0 kudos

Your code is loading the full model into a single GPU so having multiple GPUs does not prevent out of memory errors. By default, transformer models only have DDP (distributed data parallel) so each GPU has a copy of your model for speeding up trainin...

  • 0 kudos
Phani1
by • Valued Contributor II
  • 3481 Views
  • 0 replies
  • 0 kudos

UCX Installation without CLI

 Hi Team, Can we install UCX Toolkit into databricks workspace without installing it via Databricks CLI? If its possible then How ?https://github.com/databrickslabs/ucx

Get Started Discussions
ucx
Reply
  • 3481 Views
  • 0 replies
  • 0 kudos
samarth_solanki
by • New Contributor II
  • 3935 Views
  • 1 replies
  • 0 kudos

Resolved! Unittesting databricks.sdk.runtime

How to mock a code that uses dbutils from"from databricks.sdk.runtime import dbutils"it shows databricks-sdk has no attribute runtime

Get Started Discussions
Reply
  • 3935 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Ayushi_Suthar
Databricks Employee
  • 0 kudos

Hi @samarth_solanki , I Hope you are doing well!  Based on the information you have shared, it seems like you're trying to import dbutils from databricks.sdk.runtime, but you're encountering an error that says "databricks-sdk has no attribute runtime...

  • 0 kudos
halcho
by • New Contributor III
  • 12924 Views
  • 6 replies
  • 9 kudos

Notebook scrolling as I select

When I select text in a notebook cell the whole notebook scrolls up as a select. This happens when I use the mouse wheel and with shift+arrow key. It varies by cell - happens in some cells, but not other cells within the same notebook. When I refresh...

Get Started Discussions
Reply
  • 12924 Views
  • 6 replies
  • 9 kudos
View Replies
Latest Reply
Israel_H
New Contributor III
  • 9 kudos

I'm relieved to know that I'm not the only one experiencing this issue.Please, address this as soon as possible. It's significantly impacting my productivity.

  • 9 kudos
5 More Replies
QBexperts
by • New Contributor II
  • 1490 Views
  • 1 replies
  • 3 kudos

Resolved! How do i fix QB Error code 6000 301?

When I try to access my company files, I keep getting the error 6000 301 in QB. Please assist me in fixing this mistake.

Get Started Discussions
Reply
  • 1490 Views
  • 1 replies
  • 3 kudos
View Replies
Latest Reply
mikejeson254
New Contributor III
  • 3 kudos

Are you facing QB error 6000 301 while trying to log in to your company file in QB Desktop and don’t know what should be done next? If yes, then you should not panic at all because through this post I am going to tell you everything you need to know ...

  • 3 kudos
ledbutter
by • New Contributor II
  • 2249 Views
  • 2 replies
  • 0 kudos

Resolved! Create Storage Credential 500 Response

I'm trying to create storage credentials for an Azure Databricks Connector at the workspace level with a service principal that has the CREATE_STORAGE_CREDENTIAL but is NOT an account admin. For this test, the SP has the owner role on the connector.I...

Get Started Discussions
Reply
  • 2249 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Ayushi_Suthar
Databricks Employee
  • 0 kudos

Hi @ledbutter , hope you are doing well today!  I have gone through the details and this issue might be related to https://github.com/databricks/cli/issues/1080 Please refer to this for more details: https://github.com/databricks/cli/issues/1108 Plea...

  • 0 kudos
1 More Replies
TheoLoiseau
by • New Contributor II
  • 1170 Views
  • 2 replies
  • 0 kudos

Cells' outputs getting appended at each run - Databricks Notebook

Hello Community,I have the following issue. When I am running cells from a notebook, I have the print outputs from the previous cells that are appended to the current print output (meaning running cell 1 gives output 1, running cell 2 gives output 1 ...

Get Started Discussions
Reply
  • 1170 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
TheoLoiseau
New Contributor II
  • 0 kudos

This seems to be linked by installing pycaret

  • 0 kudos
1 More Replies
Phani1
by • Valued Contributor II
  • 2029 Views
  • 0 replies
  • 1 kudos

cost finding and optimization

 Hi Team,Could you please suggest the best way to track the cost of Databricks objects/components? Could you please share any best practices for optimizing costs and conducting detailed cost analysis?Regards,Phanindra

Get Started Discussions
cost
Reply
  • 2029 Views
  • 0 replies
  • 1 kudos
florianb
by • New Contributor III
  • 3512 Views
  • 2 replies
  • 2 kudos

Resolved! Rss feeds for databricks releases

Hi,are there any rss feeds for the databricks platform, sql & runtime releases? We have a big tech stack so it is sometimes hard to keep up with the ever changing technologies. We are using rss feeds to keep up with all of that.Cant find anything for...

Get Started Discussions
Reply
  • 3512 Views
  • 2 replies
  • 2 kudos
View Replies
Latest Reply
Ayushi_Suthar
Databricks Employee
  • 2 kudos

Hi @florianb , You can keep these documents handy for the Platform releases and SQL Runtime releases: Platform Releases: https://docs.databricks.com/en/release-notes/product/index.html SQL Releases: https://docs.databricks.com/en/sql/release-notes/in...

  • 2 kudos
1 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels
Top