- 2234 Views
- 1 replies
- 0 kudos
What causes affect QB Won't Open and how to fix it?
What Can Be Causing QB Won't Open Issue and How Can I Fix It? I need help immediately to fix this annoying issue! Has anybody else had such problems with QB refusing to open? My personal attempts at troubleshooting have yielded no results. I would be...
- 2234 Views
- 1 replies
- 0 kudos
- 0 kudos
@markwilliam8506 If your QB won't open even after multiple tries, you might be facing some common error messages. This scenario can be a result of damaged program files or a faulty installation process, among other possible reasons. The error message...
- 0 kudos
- 7682 Views
- 1 replies
- 0 kudos
Serving GPU Endpoint, can't find CUDA
Hi everyone !I'm encountering an issue while trying to serve my model on a GPU endpoint.My model is using deespeed that needs I got the following error : "An error occurred while loading the model. CUDA_HOME does not exist, unable to compile CUDA op(...
- 7682 Views
- 1 replies
- 0 kudos
- 16819 Views
- 3 replies
- 2 kudos
Resolved! Idle Databricks trial costs me $1/day on AWS
I created a 14-day trial account on Databricks.com and linked it to my AWS. I'm aware that DBUs are free for 14 days, but any AWS charges are my own. I created one workspace, and the CloudFormation was successful. I haven't used it for two days and t...
- 16819 Views
- 3 replies
- 2 kudos
- 2285 Views
- 1 replies
- 0 kudos
Feature Store with Spark Pipeline
Hi,I am using a spark pipeline having stages VectoreAssembler, StandardScalor, StringIndexers, VectorAssembler, GbtClassifier. And then logging this pipeline using feature store log_model function as follows:fe = FeatureStoreClient() // I have tried ...
- 2285 Views
- 1 replies
- 0 kudos
- 4184 Views
- 5 replies
- 2 kudos
Problem updating a one time run Job
I'm creating a series of runs using the /api/2.1/jobs/runs/submit, I wanted to add some tags for more control on the cost and usage, but I notice it's not an option. My first idea was using /api/2.1/jobs/update but it returns that it doesn't have any...
- 4184 Views
- 5 replies
- 2 kudos
- 2 kudos
It could be, but I can still list the job permissions, so it's creating some kind of job... Is there a way of adding from the begining/updating tags into that job?
- 2 kudos
- 2701 Views
- 0 replies
- 0 kudos
Deploy mlflow model to Sagemaker
Hi,I am trying to deploy mlflow model in Sagemaker. My mlflow model is registered in Databrick.Followed below url to deploy and it need ECR for deployment. For ECR, either I can create custom image and push to ECR or its mentioned in below url to get...
- 2701 Views
- 0 replies
- 0 kudos
- 3904 Views
- 0 replies
- 0 kudos
SQL query on information_schema.tables via service principal
Hi,I have a simple python notebook with below code ----query = "select table_catalog, table_schema, table_name from system.information_schema.tables where table_type!='VIEW' and table_catalog='TEST' and table_schema='TEST'"test = spark.sql(query)disp...
- 3904 Views
- 0 replies
- 0 kudos
- 2001 Views
- 0 replies
- 0 kudos
Notebook Editor Theme Not Being Retained after Repo Screen
tldr: Notebook selected "Editor theme (New)" is not being retained after viewing "push code code to repo" screen.I believe I have the answer to this issue.What's occurring and why:1. User selects: View --> Editor theme --> <<theme>> (ie: Monokai)2. U...
- 2001 Views
- 0 replies
- 0 kudos
- 3064 Views
- 1 replies
- 1 kudos
reading databricks tables
Hello,Currently I have created databricks tables in the hive_metastore.databasesTo read these tables using a select * query inside the databricks notebook, I have to make sure the databrcks cluster is started.Question is to do with reading the databr...
- 3064 Views
- 1 replies
- 1 kudos
- 1 kudos
thank you
- 1 kudos
- 3557 Views
- 1 replies
- 0 kudos
Resolved! ETL Advice for Large Transactional Database
I have a SQL server transactional database on an EC2 instance, and an AWS Glue job that pulls full tables in parquet files into an S3 bucket. There is a very large table that has 44 million rows, and records are added, updated and deleted from this t...
- 3557 Views
- 1 replies
- 0 kudos
- 0 kudos
If you have a CDC stream capability, you can use the APPLY CHANGES INTO API to perform SCD1, or SCD2 in a Delta Lake table in Databricks. You can find more information here. This is the best way to go if CDC is a possibility.If you do not have a CD...
- 0 kudos
- 10685 Views
- 2 replies
- 0 kudos
Connect to Databricks using Java SDK through proxy
I'm trying to connect to databricks from java using the java sdk and get cluster/sqlWarehouse state. I'm able to connect and get cluster state from my local. But, once I deploy it to the server, my company's network is not allowing the connection. We...
- 10685 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Nagasundaram You can make use of the below init script inorder to use a proxy server with Databricks cluster. The content of the init script can be added at "Workspace/shared/setproxy.sh" ================================================== v...
- 0 kudos
- 1794 Views
- 1 replies
- 0 kudos
Can I use databricks principals on databricks connect 12.2?
Hi community,Is it possible to use Databricks service principals for authentication on Databricks connect 12.2 to connect my notebook or code to Databricks compute, rather than using personal access token? I checked the docs and got to know that upgr...
- 1794 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_modThanks for your response. I was able to generate the token of the service principal following this doc, later saved it in the <Databricks Token> variable prompted when running databricks-connect configure command in terminal. And was a...
- 0 kudos
- 11226 Views
- 1 replies
- 0 kudos
How to add instance profile permission to all user via databricks-sdk workspace client
How to add instance profile permission to all user via databricks-sdk workspace client. Just like terraform where we can give "users" for all users , how can we don same using databricks-sdk workspace-client. I cannot find permission for instance pro...
- 11226 Views
- 1 replies
- 0 kudos
- 1296 Views
- 0 replies
- 0 kudos
How managed tables are useful in Madalian Archtecture
I am having basic question, As managed tables doesnt store their data into ADLS Gen2. But in our architcture we created 3 containers in ADLS Gen2 (Bronze, Silver and Gold) . If I chose managed tables then neither metadata nor data doesnt store into ...
- 1296 Views
- 0 replies
- 0 kudos
- 12656 Views
- 2 replies
- 1 kudos
UCX Installation
We aim to streamline the UCX installation process by utilizing Databricks CLI and automating the manual input of required details at each question level .Could you please guide us how can we achieve to automate the parameter's while installation? wha...
- 12656 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi Team, We don't see option at UCX command level passing parameters as json /config file, could you please help me in this case how we can automate the installation.
- 1 kudos
