- 8575 Views
- 3 replies
- 0 kudos
Linear Regression HELP! Pickle + Broadcast Variable Error
Hi there,I need some help with this example. We're trying to create a linearRegression model that can parallelize for thousands of symbols per date. When we run this we get a picklingError Any suggestions would be much appreciated!KError:PicklingErro...
- 8575 Views
- 3 replies
- 0 kudos
- 14480 Views
- 3 replies
- 9 kudos
Resolved! Delta save timestamp as timestamp with time zone
Hello! I have the following problem. I want to save the delta table and that table contains timestamp columns, but when I try to write that table with spark the timestamp columns become timestamp with the time zone. This is a problem in my case becau...
- 14480 Views
- 3 replies
- 9 kudos
- 9 kudos
Hi @Hubert Dudek ,When you have time, I describe my problem. Can you please check?
- 9 kudos
- 3768 Views
- 2 replies
- 0 kudos
Running a K-means (.fit) gives error:Params must be either a param map or a list/tuple of param maps but got %s." % type(params)
am running a k-means algorithm. My feature are DoubleType and have no nulls, but I get : raise TypeError("Params must be either a param map or a list/tuple of param maps but got %s." % type(params). Anyone have any idea how to solve this?File /datab...
- 3768 Views
- 2 replies
- 0 kudos
- 0 kudos
I found the answer just by trying several things, although I do not understand exactly what the problem was. All I had to do was to cache the input data before fitting the model:assemble=VectorAssembler(inputCols=columns_input, outputCol='features')...
- 0 kudos
- 3325 Views
- 4 replies
- 2 kudos
Hello Everyone, I am thrilled to announce that we have our 6th winner for the raffle contest - @Yogita Chavan . Please join me in congratulating he...
Hello Everyone,I am thrilled to announce that we have our 6th winner for the raffle contest - @Yogita Chavan . Please join me in congratulating her on this remarkable achievement!Your dedication and hard work have paid off, and we are delighted to ...
- 3325 Views
- 4 replies
- 2 kudos
- 2 kudos
@Suteja Kanuri i haven't received swag until now as per our last mail i provided size after that I didn't receive any mail for tracking details
- 2 kudos
- 9522 Views
- 1 replies
- 2 kudos
Getting HTTP 502 bad gateway error!
Hello all,I am suddenly getting an HTTP 502 and DRIVER_LIBRARY_INSTALLATION_FAILURE error during the Python library installation when the cluster gets initialized. I have around 10 Python packages out of which 2-3, packages always failed to install a...
- 9522 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Bhargav Shir Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 2 kudos
- 1526 Views
- 2 replies
- 10 kudos
How to improve visualization and dasboard concepts?
How to improve visualization and dasboard concepts?
- 1526 Views
- 2 replies
- 10 kudos
- 10 kudos
Hi @Priyadarshini G Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 10 kudos
- 4225 Views
- 1 replies
- 1 kudos
Does Unity Catalog on Azure require premium blob storage tier?
from the docs I read : Create a storage container where the metastore’s managed table data will be stored.This storage container must be in a Premium performance Azure Data Lake Storage Gen2 account in the same region as the workspaces you want to us...
- 4225 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Carlos Restrepo We haven't heard from you since the last response from @Kaniz Fatma , and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to o...
- 1 kudos
- 3662 Views
- 1 replies
- 1 kudos
Regarding Discount on certifications for students
Hi team,I'm a student is there any student discounts for students on certification if yes please let me know.Thanks
- 3662 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Pranav Yadav Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 1 kudos
- 2459 Views
- 1 replies
- 0 kudos
Can Kaggle Kernels be used in Databricks notebooks?
suggestions).This one looks perfect kaggle kernels output rsrishav/starter-youtube-trending-video-dataset -p /path/to/dest but I'm not using CLI, I'm using a databricks notebook.I tried using this code but it doesn't work. data_path = 'rsrishav/youtu...
- 2459 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @jch Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 1279 Views
- 1 replies
- 0 kudos
Databricks Cross cloud (Databricks on AWS and Storage is on Azure)
We have a Databricks account on AWS and storage is on Azure Cloud (ADLS), because of cross-platform do we face any security and performance-related issues also is this feasible and supported? could you please provide your suggestions on this?
- 1279 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Janga Reddy Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 1076 Views
- 1 replies
- 0 kudos
[bug] databricks jobs list not desplaying 2.0 created jobs
Hi! When I use `databricks jobs list --version=2.0` I get all jobs deployed using 2.0 and 2.1 API, however, when I use `databricks jobs list --version=2.1` I only get jobs deployed using 2.1 API. This is a behaviour that we've only experienced recent...
- 1076 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Guillermo Sanchez Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 3234 Views
- 1 replies
- 0 kudos
Python custom Logging on Databricks
I am planning to introduce a custom logging to the databricks workload. To achieve this I am using a python logging module. I am storing logs in driver memory "file:/tmp/" directory before I move those logs to blob storage. In my personal databricks ...
- 3234 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @MARKSACHIN K Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 2066 Views
- 1 replies
- 1 kudos
Error while creating workspace with 'Quickstart' on AWS
Cloudformation runs into error during 'assign Metastore' step.Following is the error from Cloudwatch:HTTP content: b'{ "error_code": "PERMISSION_DENIED", "message": "Cannot assign metastore to STANDARD tier workspace xyz" }What is the solution for th...
- 2066 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Abhilash Mhaisne Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 1 kudos
- 5790 Views
- 3 replies
- 3 kudos
How to use foreachbatch in deltalivetable or DLT?
I need to process some transformation on incoming data as a batch and want to know if there is way to use foreachbatch option in deltalivetable. I am using autoloader to load json files and then I need to apply foreachbatch and store results into ano...
- 5790 Views
- 3 replies
- 3 kudos
- 3 kudos
Not sure if this will apply to you or not...I was looking at the foreachbatch tool to reduce the workload of getting distinct data from a history table of 20million + records because the df.dropDuplicates() function was intermittently running out of ...
- 3 kudos
- 10511 Views
- 3 replies
- 3 kudos
New SQL Dashboard feature never loads
I've created the sample Taxi dashboard, but the charts never load?
- 10511 Views
- 3 replies
- 3 kudos
- 3 kudos
Do you have the full error stack trace? does this happens frequently? whats the size of your cluster?
- 3 kudos
| User | Count |
|---|---|
| 1619 | |
| 790 | |
| 485 | |
| 349 | |
| 287 |
