- 4361 Views
- 4 replies
- 2 kudos
Resolved! Action Required: Init Scripts on DBFS will stop working
Hello,I am seeing this message on all databricks environments.Action Required: Init Scripts on DBFS will stop working on March 31, 2024You must migrate init scripts of DBFS or opt-in to a september 1, 2024 extension by March 31Not sure what this is f...
- 4361 Views
- 4 replies
- 2 kudos
- 2 kudos
How are yall managing your init script versions? I have mine in a repo i connected into databricks workspace and im using it within there. With multiple users they can push it to the repo and we can merge it in.
- 2 kudos
- 920 Views
- 1 replies
- 0 kudos
Enhance Documentation for databricks-connect for python
Hello, I'm setting up a python environment to work with databricks in vscode using Windows.I followed the instructions in Install Databricks Connect for Python, and found some issues/conflicts/errors:- There is a useless tip in the Set up the client ...
- 920 Views
- 1 replies
- 0 kudos
- 0 kudos
Additionally, there are no comments on how to avoid uploading virtual environment to the catalog when using databricks extension for vscode
- 0 kudos
- 2338 Views
- 3 replies
- 3 kudos
Resolved! Metric Tables not created automatically
I was trying the new lakehouse monitoring feature for one of my unity tables, and when I create a monitoring dashboard for my table, the 2 metric tables({output_schema}.{table_name}_profile_metrics and {output_schema}.{table_name}_drift_metrics) are ...
- 2338 Views
- 3 replies
- 3 kudos
- 1422 Views
- 2 replies
- 1 kudos
DataEngineer Associate Exam got Suspended. Raised Ticket. No Response
Hi Team,This is the second time I am tryng to post a discussion in the community. The first time it was marked SPAM. It has been a terrible experience so far with my Databricks Data Engineer Associate exam getting suspended by the proctor for reasons...
- 1422 Views
- 2 replies
- 1 kudos
- 1 kudos
@RohitB91 the support team is awaiting your response for a date / time you are available to resume your exam. Your registration confirmation email should contain this detail: Preparation for taking your Online proctored Exam Understand the computer r...
- 1 kudos
- 2537 Views
- 1 replies
- 0 kudos
Convert pkl file
I am looking to convert pkl file to parquet format. I am reading this data from Azure Data Lake and convert and create parquet file outputs to store them in my hive metastore.
- 2537 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Innov, To convert a Pickle (pkl) file to Parquet format and store it in your Azure data lake, you can follow these steps: Azure Data Factory: If you’re using Azure Data Factory, it supports the Parquet format for various connectors, including...
- 0 kudos
- 662 Views
- 1 replies
- 0 kudos
search engine functionality in Databricks
Hi Team,Good morning, I am Sai Rekhawar, currently residing in Hamburg, Germany. I am reaching out regarding an issue with the search engine functionality in Databricks.I have created several catalogs and tables within the catalog, and I am the owner...
- 662 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @SaiRekhawar , try using the filters in under the table bar in ctrl+P as below
- 0 kudos
- 2458 Views
- 3 replies
- 1 kudos
User Agent Verfication
Hello Folks, We are recently working on Databricks integration in to our products and one of the Best practices suggested is to send user-agent information for any REST API or JDBC connect we make from the product to Databricks. We have made all the ...
- 2458 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @bdraitcak , Here are the steps to be followed to get the logs: Log in to your Azure portal.Go to / Search for "Log analytics workspace."Create a new Log Analytics workspace by specifying your Resource group and Instance details. [subscription + r...
- 1 kudos
- 907 Views
- 1 replies
- 0 kudos
Unable to login to Azure Databricks
I am trying to login to Azure Databricks as usual but it waits for 5 10 seconds then redirects me to https://westeurope-c2.azuredatabricks.net/aad/redirect The system is up and all of my colleagues can login to the system. I have tried in incognito m...
- 907 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @egndz , If it was a one-time issue we suspect it was an issue within Azure or Databricks services. Please follow the status page to keep track of the maintenance/outages. https://status.azuredatabricks.net/
- 0 kudos
- 852 Views
- 1 replies
- 0 kudos
Failed Synchronization of Files Using Databricks Extension in VS Code
hi,I am trying to set up Databricks Extension in VS Code. I follow the steps as per the guide belowhttps://docs.databricks.com/en/dev-tools/vscode-ext/tutorial.html When i move to step 6 (see in the above guide) i follow the steps and i create succes...
- 852 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Anto23 , Greetings from Databricks. Based on the above information, it seems Files in Workspace is currently disabled for your Databricks environment. This feature allows storing and accessing non-notebook files alongside your notebooks and cod...
- 0 kudos
- 1589 Views
- 1 replies
- 0 kudos
Decimal Precision error
when i try to create an dataframe like this lstOfRange = list() lstOfRange = [ ['CREDIT_LIMIT_RANGE',Decimal(10000000.010000),Decimal(100000000000000000000000.000000),'>10,000,000','G'] ] RangeSchema = StructType([StructField("rangeType",St...
- 1589 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @sai_sathya, The issue you’re encountering with the value in the rangeTo column of your DataFrame is related to the precision of floating-point numbers. Let’s break down what’s happening: Floating-Point Precision: Computers represent floating...
- 0 kudos
- 1409 Views
- 2 replies
- 0 kudos
Oracle table load from Databricks
I am trying to load a dataframe from Databricks to target Oracle table using the write method and using JDBC api. I have the right drivers. The job and its corresponding stages are getting completed and the data is getting loaded in Oracle target tab...
- 1409 Views
- 2 replies
- 0 kudos
- 0 kudos
Thanks for the response. Can you please elaborate on the Apache Spark JDBC Connector. I am using ojdbc8 driver as per the Databricks documentation. I am not using Delta Lake. I have the data in a dataframe and using write method to insert the data to...
- 0 kudos
- 2372 Views
- 2 replies
- 0 kudos
error installing igraph library
Hi, I am trying to install the "igraph" and "networkD3" CRAN packages for use within a notebook, but am receiving the below error.Could someone please assist?Thanks! * installing *source* package ‘igraph’ ... ** package ‘igraph’ successfully unpacked...
- 2372 Views
- 2 replies
- 0 kudos
- 0 kudos
Based on this igraph github issue https://github.com/igraph/rigraph/issues/490#issuecomment-966890059, I followed the instructions to install glpk. After installing glpk, I was able to install igraph.
- 0 kudos
- 1627 Views
- 2 replies
- 1 kudos
Resolved! Error installing the igraph and networkD3 R libraries
Hi,I am trying to install the igraph and networkD3 CRAN packages for use within a notebook. However, I am receiving the attached installation error when attempting to do so.Could someone please assist?Thank you!
- 1627 Views
- 2 replies
- 1 kudos
- 743 Views
- 1 replies
- 0 kudos
What causes affect QB Won't Open and how to fix it?
What Can Be Causing QB Won't Open Issue and How Can I Fix It? I need help immediately to fix this annoying issue! Has anybody else had such problems with QB refusing to open? My personal attempts at troubleshooting have yielded no results. I would be...
- 743 Views
- 1 replies
- 0 kudos
- 0 kudos
@markwilliam8506 If your QB won't open even after multiple tries, you might be facing some common error messages. This scenario can be a result of damaged program files or a faulty installation process, among other possible reasons. The error message...
- 0 kudos
- 3618 Views
- 2 replies
- 0 kudos
Serving GPU Endpoint, can't find CUDA
Hi everyone !I'm encountering an issue while trying to serve my model on a GPU endpoint.My model is using deespeed that needs I got the following error : "An error occurred while loading the model. CUDA_HOME does not exist, unable to compile CUDA op(...
- 3618 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @kfab, It seems you’re encountering an issue related to CUDA while serving your model on a GPU endpoint. Let’s troubleshoot this step by step. CUDA_HOME Not Found: The error message you received, “CUDA_HOME does not exist, unable to compile C...
- 0 kudos
