cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

thethirtyfour
by New Contributor III
  • 2484 Views
  • 1 replies
  • 0 kudos

error installing igraph library

Hi, I am trying to install the "igraph" and "networkD3" CRAN packages for use within a notebook, but am receiving the below error.Could someone please assist?Thanks! * installing *source* package ‘igraph’ ... ** package ‘igraph’ successfully unpacked...

  • 2484 Views
  • 1 replies
  • 0 kudos
Latest Reply
pcs
New Contributor II
  • 0 kudos

Based on this igraph github issue https://github.com/igraph/rigraph/issues/490#issuecomment-966890059, I followed the instructions to install glpk. After installing glpk, I was able to install igraph.

  • 0 kudos
thethirtyfour
by New Contributor III
  • 1749 Views
  • 2 replies
  • 1 kudos

Resolved! Error installing the igraph and networkD3 R libraries

Hi,I am trying to install the igraph and networkD3 CRAN packages for use within a notebook. However, I am receiving the attached installation error when attempting to do so.Could someone please assist?Thank you!

  • 1749 Views
  • 2 replies
  • 1 kudos
Latest Reply
thethirtyfour
New Contributor III
  • 1 kudos

Thank you!

  • 1 kudos
1 More Replies
markwilliam8506
by New Contributor
  • 862 Views
  • 1 replies
  • 0 kudos

What causes affect QB Won't Open and how to fix it?

What Can Be Causing QB Won't Open Issue and How Can I Fix It? I need help immediately to fix this annoying issue! Has anybody else had such problems with QB refusing to open? My personal attempts at troubleshooting have yielded no results. I would be...

  • 862 Views
  • 1 replies
  • 0 kudos
Latest Reply
kartanjohn29
New Contributor II
  • 0 kudos

@markwilliam8506 If your QB won't open even after multiple tries, you might be facing some common error messages. This scenario can be a result of damaged program files or a faulty installation process, among other possible reasons. The error message...

  • 0 kudos
kfab
by New Contributor II
  • 4044 Views
  • 1 replies
  • 0 kudos

Serving GPU Endpoint, can't find CUDA

Hi everyone !I'm encountering an issue while trying to serve my model on a GPU endpoint.My model is using deespeed that needs I got the following error : "An error occurred while loading the model. CUDA_HOME does not exist, unable to compile CUDA op(...

  • 4044 Views
  • 1 replies
  • 0 kudos
Latest Reply
" src="" />
This widget could not be displayed.
This widget could not be displayed.
This widget could not be displayed.
  • 0 kudos

This widget could not be displayed.
Hi everyone !I'm encountering an issue while trying to serve my model on a GPU endpoint.My model is using deespeed that needs I got the following error : "An error occurred while loading the model. CUDA_HOME does not exist, unable to compile CUDA op(...

This widget could not be displayed.
  • 0 kudos
This widget could not be displayed.
sanjay
by Valued Contributor II
  • 1511 Views
  • 0 replies
  • 0 kudos

Deploy mlflow model to Sagemaker

Hi,I am trying to deploy mlflow model in Sagemaker. My mlflow model is registered in Databrick.Followed below url to deploy and it need ECR for deployment. For ECR, either I can create custom image and push to ECR or its mentioned in below url to get...

  • 1511 Views
  • 0 replies
  • 0 kudos
Sanky
by New Contributor
  • 1238 Views
  • 0 replies
  • 0 kudos

SQL query on information_schema.tables via service principal

Hi,I have a simple python notebook with below code ----query = "select table_catalog, table_schema, table_name from system.information_schema.tables where table_type!='VIEW' and table_catalog='TEST' and table_schema='TEST'"test = spark.sql(query)disp...

Community Platform Discussions
information_schema
Service Principal
troubleshooting
  • 1238 Views
  • 0 replies
  • 0 kudos
arkiboys
by Contributor
  • 1652 Views
  • 1 replies
  • 1 kudos

reading databricks tables

Hello,Currently I have created databricks tables in the hive_metastore.databasesTo read these tables using a select * query inside the databricks notebook, I have to make sure the databrcks cluster is started.Question is to do with reading the databr...

  • 1652 Views
  • 1 replies
  • 1 kudos
Latest Reply
arkiboys
Contributor
  • 1 kudos

thank you

  • 1 kudos
sue01
by New Contributor II
  • 1663 Views
  • 2 replies
  • 0 kudos

Error with using Vector assembler in Unity Catalog

Hello,I am getting the below error while trying to convert my features using vector assembler in unity catalog cluster I tried setting up the config like mentioned in a different post, but it did not work still. Could use some help here.Thank you..

sue01_0-1708093249414.png
Community Platform Discussions
unitycatalog mlflowerror
  • 1663 Views
  • 2 replies
  • 0 kudos
Latest Reply
sue01
New Contributor II
  • 0 kudos

Yes, so what is the solution for shared access mode? How do I solve this error?

  • 0 kudos
1 More Replies
lwoodward
by New Contributor II
  • 1487 Views
  • 1 replies
  • 0 kudos

Resolved! ETL Advice for Large Transactional Database

I have a SQL server transactional database on an EC2 instance, and an AWS Glue job that pulls full tables in parquet files into an S3 bucket. There is a very large table that has 44 million rows, and records are added, updated and deleted from this t...

  • 1487 Views
  • 1 replies
  • 0 kudos
Latest Reply
ScottSmithDB
Databricks Employee
  • 0 kudos

If you have a CDC stream capability, you can use the APPLY CHANGES INTO API to perform SCD1, or SCD2 in a Delta Lake table in Databricks.  You can find more information here.  This is the best way to go if CDC is a possibility.If you do not have a CD...

  • 0 kudos
Nagasundaram
by New Contributor II
  • 7721 Views
  • 2 replies
  • 0 kudos

Connect to Databricks using Java SDK through proxy

I'm trying to connect to databricks from java using the java sdk and get cluster/sqlWarehouse state. I'm able to connect and get cluster state from my local. But, once I deploy it to the server, my company's network is not allowing the connection. We...

  • 7721 Views
  • 2 replies
  • 0 kudos
Latest Reply
AlliaKhosla
Databricks Employee
  • 0 kudos

Hi  @Nagasundaram    You can make use of the below init script inorder to use a proxy server with Databricks cluster. The content of the init script can be added at  "Workspace/shared/setproxy.sh"  ================================================== v...

  • 0 kudos
1 More Replies
samarth_solanki
by New Contributor II
  • 1060 Views
  • 1 replies
  • 0 kudos

How to add instance profile permission to all user via databricks-sdk workspace client

How to add instance profile permission to all user via databricks-sdk workspace client. Just like terraform where we can give "users" for all users , how can we don same using databricks-sdk workspace-client. I cannot find permission for instance pro...

  • 1060 Views
  • 1 replies
  • 0 kudos
Latest Reply
" src="" />
This widget could not be displayed.
This widget could not be displayed.
This widget could not be displayed.
  • 0 kudos

This widget could not be displayed.
How to add instance profile permission to all user via databricks-sdk workspace client. Just like terraform where we can give "users" for all users , how can we don same using databricks-sdk workspace-client. I cannot find permission for instance pro...

This widget could not be displayed.
  • 0 kudos
This widget could not be displayed.
shanmukhasai96
by New Contributor
  • 1199 Views
  • 1 replies
  • 0 kudos

Databricks GPU utilization not to full extent

Hi Everyone, I have been running below code. However Im getting CUDA out of memory error even though I have 4 GPUs in cluster which should ideally have 64 GB GPU , but the code is failing with 16 GB. I assume that the code is not utilizing all 4 GPU ...

  • 1199 Views
  • 1 replies
  • 0 kudos
Latest Reply
Jisong
New Contributor II
  • 0 kudos

Your code is loading the full model into a single GPU so having multiple GPUs does not prevent out of memory errors. By default, transformer models only have DDP (distributed data parallel) so each GPU has a copy of your model for speeding up trainin...

  • 0 kudos
samarth_solanki
by New Contributor II
  • 2440 Views
  • 1 replies
  • 0 kudos

Resolved! Unittesting databricks.sdk.runtime

How to mock a code that uses dbutils from"from databricks.sdk.runtime import dbutils"it shows databricks-sdk has no attribute runtime

  • 2440 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ayushi_Suthar
Databricks Employee
  • 0 kudos

Hi @samarth_solanki , I Hope you are doing well!  Based on the information you have shared, it seems like you're trying to import dbutils from databricks.sdk.runtime, but you're encountering an error that says "databricks-sdk has no attribute runtime...

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors