When I create a warehouse, there are connection details which I was able to successfully use, but there are also connection details when I navigate in the console to Compute->configuration->Advanced options-> JDBC/ODBC What is the difference between ...
Hi there,I need some help with this example. We're trying to create a linearRegression model that can parallelize for thousands of symbols per date. When we run this we get a picklingError Any suggestions would be much appreciated!KError:PicklingErro...
Hello! I have the following problem. I want to save the delta table and that table contains timestamp columns, but when I try to write that table with spark the timestamp columns become timestamp with the time zone. This is a problem in my case becau...
Hi @Hubert Dudek ,When you have time, I describe my problem. Can you please check?
am running a k-means algorithm. My feature are DoubleType and have no nulls, but I get : raise TypeError("Params must be either a param map or a list/tuple of param maps but got %s." % type(params). Anyone have any idea how to solve this?File /datab...
I found the answer just by trying several things, although I do not understand exactly what the problem was. All I had to do was to cache the input data before fitting the model:assemble=VectorAssembler(inputCols=columns_input, outputCol='features')...
Hello Everyone,I am thrilled to announce that we have our 6th winner for the raffle contest - @Yogita Chavan . Please join me in congratulating her on this remarkable achievement!Your dedication and hard work have paid off, and we are delighted to ...
@Suteja Kanuri i haven't received swag until now as per our last mail i provided size after that I didn't receive any mail for tracking details
Hello all,I am suddenly getting an HTTP 502 and DRIVER_LIBRARY_INSTALLATION_FAILURE error during the Python library installation when the cluster gets initialized. I have around 10 Python packages out of which 2-3, packages always failed to install a...
Hi @Bhargav Shir Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
How to improve visualization and dasboard concepts?
Hi @Priyadarshini G Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
from the docs I read : Create a storage container where the metastore’s managed table data will be stored.This storage container must be in a Premium performance Azure Data Lake Storage Gen2 account in the same region as the workspaces you want to us...
Hi @Carlos Restrepo We haven't heard from you since the last response from @Kaniz Fatma , and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to o...
Hi team,I'm a student is there any student discounts for students on certification if yes please let me know.Thanks
Hi @Pranav Yadav Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
suggestions).This one looks perfect kaggle kernels output rsrishav/starter-youtube-trending-video-dataset -p /path/to/dest but I'm not using CLI, I'm using a databricks notebook.I tried using this code but it doesn't work. data_path = 'rsrishav/youtu...
Hi @jch Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
We have a Databricks account on AWS and storage is on Azure Cloud (ADLS), because of cross-platform do we face any security and performance-related issues also is this feasible and supported? could you please provide your suggestions on this?
Hi @Janga Reddy Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
Hi! When I use `databricks jobs list --version=2.0` I get all jobs deployed using 2.0 and 2.1 API, however, when I use `databricks jobs list --version=2.1` I only get jobs deployed using 2.1 API. This is a behaviour that we've only experienced recent...
Hi @Guillermo Sanchez Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
I am planning to introduce a custom logging to the databricks workload. To achieve this I am using a python logging module. I am storing logs in driver memory "file:/tmp/" directory before I move those logs to blob storage. In my personal databricks ...
Hi @MARKSACHIN K Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
Cloudformation runs into error during 'assign Metastore' step.Following is the error from Cloudwatch:HTTP content: b'{ "error_code": "PERMISSION_DENIED", "message": "Cannot assign metastore to STANDARD tier workspace xyz" }What is the solution for th...
Hi @Abhilash Mhaisne Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
I need to process some transformation on incoming data as a batch and want to know if there is way to use foreachbatch option in deltalivetable. I am using autoloader to load json files and then I need to apply foreachbatch and store results into ano...
Not sure if this will apply to you or not...I was looking at the foreachbatch tool to reduce the workload of getting distinct data from a history table of 20million + records because the df.dropDuplicates() function was intermittently running out of ...
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
