Hello, I am having issues to store VectorUDT columns into the databricks feature store. I saw that the feature store is not able to handle this kind of data type, but can store arrays. So, I tried to convert my VectorsUDT into arrays as a workaround....
Hi @Bertrand Thia​ ​, We haven't heard from you on my last response, and I was checking back to see if you have a resolution yet. If you have any solution, please share it with the community as it can be helpful to others. Otherwise, we will respond ...
Hi dear community,My company is in a migration project from MapR to databricks, and we have the following piece of code that used to work fine in this platform but once in databricks it stopped working. I noticed that this is failing is just with th...
Hi @Eimis Pacheco​ , We haven't heard from you since my last response, and I was checking back to see if my suggestions helped you. Or else, If you have any solution, please share it with the community as it can be helpful to others. Also, please don...
Everything you want to know about Celebrities, Movies, Web-Series & SongsSearch and get details like Bio, Birthday, Networth, Releasing date, Writer, Director, etc. Get the entertainment update on: Let Us Register
Learn Arabic Lessons in London. Face-to-face and online Arabic classes in London. Arabic courses for Beginners, Elementary, Intermediate and Advanced levels.
I am currently unable to spin up any clusters in our databricks AWS environment.When I attempt to start up an on-demand cluster, it remains in "pending" for 20+ minutes (on relatively small clusters which usually take 2-3 min to start up).Similarly, ...
Has anyone done this and share details? I have a sample sql which ran on large SQL endpoint in 8min and synapse 1000DWU setting in 1hr. On small SQL endpoint it took 34min. What's the equivalent SQL Endpoint compute for Synapse@1000DWU? I know th...
Wondering if I can change the SKU of an already created a workspace. My team wants to use some of the premium only features. Do I have to create a whole new workspace with the different SKU?
I am using MLflow in databricks and have been able to train and track model runs in the Experiments section very easily. However, once I have trained a model, I want to load the model in a new Databricks notebook, predict on new data and log the metr...
How do I change the vCPU type for SQL Endpoint on Azure Databricks? Currently it picks as default DSv4 CPUs which reaches its quota limit although I have unused quota in other vCPU types. I faced similar issue while using Delta live tables but I was ...
Hi @Tarique Anwar​ , I don't think changing the vCPU type, for now, is possible. However, I can check with the product team on this.https://docs.microsoft.com/en-us/azure/databricks//sql/admin/sql-endpoints#required-azure-vcpu-quota
While using cx_oracle python library, it returns the below error:error message: Cannot locate a 64-bit Oracle Client library: "libclntsh.so: cannot open shared object file: No such file or directoryThe cx_oracle library is dependent on native librari...
Hi @Manoj Ashvin​ can you use the below init script and try ? dbutils.fs.put("dbfs:/databricks/oracleTest/oracle_ctl_new.sh","""
#!/bin/bash
sudo apt-get install libaio1
wget --quiet -O /tmp/instantclient-basiclite-linuxx64.zip https://download.ora...
When I read https://docs.microsoft.com/en-us/azure/databricks/sql/admin/sql-endpoints#cluster-size, it says : Each driver and worker has eight 128 GB Standard LRS managed disks attached. Attached disks are charged hourly.My question is, why do e...
Hi,I am dealing with updating master data. I'll do the UPCERT operations on the delta lake table. But after my UPCERT is complete I like to update the master data on the RDBMS table also. Is there any support from Databricks to perform this operation...
Hi, My problem is that my target delta table is an RDBMS tables. MERGE SQL works on the tables which are in Databricks. Is it possible to mention in the MERGET SQL, that my target table is an RDBMS table? I didn't see that kind of syntax. Please let ...
