- 2427 Views
- 1 replies
- 0 kudos
Failed Synchronization of Files Using Databricks Extension in VS Code
hi,I am trying to set up Databricks Extension in VS Code. I follow the steps as per the guide belowhttps://docs.databricks.com/en/dev-tools/vscode-ext/tutorial.html When i move to step 6 (see in the above guide) i follow the steps and i create succes...
- 2427 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Anto23 , Greetings from Databricks. Based on the above information, it seems Files in Workspace is currently disabled for your Databricks environment. This feature allows storing and accessing non-notebook files alongside your notebooks and cod...
- 0 kudos
- 1905 Views
- 0 replies
- 0 kudos
Huge data migration from HDFS to Databricks
Hi Team,Could you please help me what is the best way/best practices to copy around 3 TB of data(parquet) from HDFS to Databricks delta format and create external tables on top of it?Regards,Phanindra
- 1905 Views
- 0 replies
- 0 kudos
- 2832 Views
- 1 replies
- 0 kudos
Oracle table load from Databricks
I am trying to load a dataframe from Databricks to target Oracle table using the write method and using JDBC api. I have the right drivers. The job and its corresponding stages are getting completed and the data is getting loaded in Oracle target tab...
- 2832 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks for the response. Can you please elaborate on the Apache Spark JDBC Connector. I am using ojdbc8 driver as per the Databricks documentation. I am not using Delta Lake. I have the data in a dataframe and using write method to insert the data to...
- 0 kudos
- 2858 Views
- 0 replies
- 0 kudos
Decimal Precision error
when i try to create an dataframe like this lstOfRange = list() lstOfRange = [ ['CREDIT_LIMIT_RANGE',Decimal(10000000.010000),Decimal(100000000000000000000000.000000),'>10,000,000','G'] ] RangeSchema = StructType([StructField("rangeType",St...
- 2858 Views
- 0 replies
- 0 kudos
- 3609 Views
- 1 replies
- 0 kudos
error installing igraph library
Hi, I am trying to install the "igraph" and "networkD3" CRAN packages for use within a notebook, but am receiving the below error.Could someone please assist?Thanks! * installing *source* package ‘igraph’ ... ** package ‘igraph’ successfully unpacked...
- 3609 Views
- 1 replies
- 0 kudos
- 0 kudos
Based on this igraph github issue https://github.com/igraph/rigraph/issues/490#issuecomment-966890059, I followed the instructions to install glpk. After installing glpk, I was able to install igraph.
- 0 kudos
- 2732 Views
- 1 replies
- 0 kudos
how do committed-use discounts work?
How do committed-use discounts work for Databricks? Do I purchase a chunk of DBUs for a flat fee and then draw down on them until exhausted? Or am I purchasing a % discount to all DBUs I use until the time period ends?In either case, is this reflec...
- 2732 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks @Retired_mod that helps! What is the commitment term? one month? one year?
- 0 kudos
- 3840 Views
- 2 replies
- 1 kudos
Resolved! Error installing the igraph and networkD3 R libraries
Hi,I am trying to install the igraph and networkD3 CRAN packages for use within a notebook. However, I am receiving the attached installation error when attempting to do so.Could someone please assist?Thank you!
- 3840 Views
- 2 replies
- 1 kudos
- 23555 Views
- 2 replies
- 0 kudos
POC
Hi, I wonder if you could help me on the below please.We tried Databricks Data Intelligence platform for one of our clients and found that its very expensive when compared to AWS EMR. I understand its not apple-apple comparision as one being platform...
- 23555 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod Thanks for getting back with so valuable information.SystemFile sizeDurationSystemDurationCommentsComments1EMR225 GB22 minsDatabricks63 minsEMR is cheaper than Databricks by 5 timesThis involves various S3 writes with m5d4xlargeEMR225...
- 0 kudos
- 4890 Views
- 0 replies
- 0 kudos
Jira Connector
Is there any native connector in development fir JIRA
- 4890 Views
- 0 replies
- 0 kudos
- 2018 Views
- 1 replies
- 0 kudos
What causes affect QB Won't Open and how to fix it?
What Can Be Causing QB Won't Open Issue and How Can I Fix It? I need help immediately to fix this annoying issue! Has anybody else had such problems with QB refusing to open? My personal attempts at troubleshooting have yielded no results. I would be...
- 2018 Views
- 1 replies
- 0 kudos
- 0 kudos
@markwilliam8506 If your QB won't open even after multiple tries, you might be facing some common error messages. This scenario can be a result of damaged program files or a faulty installation process, among other possible reasons. The error message...
- 0 kudos
- 7380 Views
- 1 replies
- 0 kudos
Serving GPU Endpoint, can't find CUDA
Hi everyone !I'm encountering an issue while trying to serve my model on a GPU endpoint.My model is using deespeed that needs I got the following error : "An error occurred while loading the model. CUDA_HOME does not exist, unable to compile CUDA op(...
- 7380 Views
- 1 replies
- 0 kudos
- 16284 Views
- 3 replies
- 2 kudos
Resolved! Idle Databricks trial costs me $1/day on AWS
I created a 14-day trial account on Databricks.com and linked it to my AWS. I'm aware that DBUs are free for 14 days, but any AWS charges are my own. I created one workspace, and the CloudFormation was successful. I haven't used it for two days and t...
- 16284 Views
- 3 replies
- 2 kudos
- 2120 Views
- 1 replies
- 0 kudos
Feature Store with Spark Pipeline
Hi,I am using a spark pipeline having stages VectoreAssembler, StandardScalor, StringIndexers, VectorAssembler, GbtClassifier. And then logging this pipeline using feature store log_model function as follows:fe = FeatureStoreClient() // I have tried ...
- 2120 Views
- 1 replies
- 0 kudos
- 3741 Views
- 5 replies
- 2 kudos
Problem updating a one time run Job
I'm creating a series of runs using the /api/2.1/jobs/runs/submit, I wanted to add some tags for more control on the cost and usage, but I notice it's not an option. My first idea was using /api/2.1/jobs/update but it returns that it doesn't have any...
- 3741 Views
- 5 replies
- 2 kudos
- 2 kudos
It could be, but I can still list the job permissions, so it's creating some kind of job... Is there a way of adding from the begining/updating tags into that job?
- 2 kudos
- 2564 Views
- 0 replies
- 0 kudos
Deploy mlflow model to Sagemaker
Hi,I am trying to deploy mlflow model in Sagemaker. My mlflow model is registered in Databrick.Followed below url to deploy and it need ECR for deployment. For ECR, either I can create custom image and push to ECR or its mentioned in below url to get...
- 2564 Views
- 0 replies
- 0 kudos
