cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

june_tan
by Databricks Employee
  • 8526 Views
  • 2 replies
  • 2 kudos

Databricks Asia-Pacific LLM Cup 2023 - So you think you can hack?

You are invited to participate in Databricks Asia-Pacific LLM Cup 2023, an exciting virtual hackathon which kicks off in the month of October. Businesses across Asia-Pacific and Japan will have the opportunity to build, iterate and polish your LLM id...

rsz_2023-07-apj-virtual-hackathon-thumbnail-300x300-2x (1).png
  • 8526 Views
  • 2 replies
  • 2 kudos
Latest Reply
Mostelf
New Contributor II
  • 2 kudos

Hi! This sounds like a great opportunity for anyone interested in machine learning and wanting to develop their skills through real projects. B If you are looking for additional resources to promote your ideas or want to increase the effectiveness of...

  • 2 kudos
1 More Replies
radix
by New Contributor II
  • 2399 Views
  • 4 replies
  • 2 kudos

Editor lags

Does anyone else experiencing lags on the Databricks notebook editor?The typing is sometimes very slow causes the cell to hang for a moment. (Using python)

  • 2399 Views
  • 4 replies
  • 2 kudos
Latest Reply
a-sky
New Contributor II
  • 2 kudos

The notebook editor has been sluggish for me regardless of splitting up between cells and the language in use. Very frustrating.

  • 2 kudos
3 More Replies
tamer
by New Contributor II
  • 457 Views
  • 2 replies
  • 0 kudos

CICD Unity Catalog

Hello How do you handle deploying Databricks Unity Catalog resources (schemas, tables, views, permissions) across environments? What are the strategies for building (compiling), validating and deploying these resources and ensure they’re error-free a...

  • 457 Views
  • 2 replies
  • 0 kudos
Latest Reply
tamer
New Contributor II
  • 0 kudos

Thanks, yes DAB can be used, but I'm still wondering how to validate the syntax, dependencies, permissions, etc. before deploying the DAB. Example: when you deploy an SQL Database DACBAC file, first you need to build the project and generate a DACBAC...

  • 0 kudos
1 More Replies
ErikJ
by New Contributor III
  • 503 Views
  • 3 replies
  • 2 kudos

Resolved! Specify cluster when using dbutils.notebook API

Hello! Anyone know if there is a way of specifying cluster when using dbutils.notebook.run() ? As i understand it, this command will create a job compute on the run? but what if I want to use my general purpose cluster? I have been thinking of %run b...

  • 503 Views
  • 3 replies
  • 2 kudos
Latest Reply
filipniziol
Contributor
  • 2 kudos

Hi @ErikJ ,Check the docs:Also you may run the help method:.The parameters of the method are:1. path2. timeoutSeconds3. arguments

  • 2 kudos
2 More Replies
tyle_r
by New Contributor II
  • 454 Views
  • 2 replies
  • 0 kudos

Lake house monitoring prodile_metrics and drift_metrics are empty

I am wondering why when i create a lakehouse monitor using either the API or UI, that my profile_metrics and data_drift tables are empty. This error came after i changed my date from type date to timestamp. Any information would be greatly appreciate...

  • 454 Views
  • 2 replies
  • 0 kudos
Latest Reply
tyle_r
New Contributor II
  • 0 kudos

The issue comes where you don't include data with a timestamp that's within the last 30 days, as the analysis done on the table is only done within the last 30 days worth of data.

  • 0 kudos
1 More Replies
User1234
by New Contributor II
  • 3529 Views
  • 4 replies
  • 2 kudos

Cluster compute metrics

I want to fetch compute metrics(hardware, gpu and spark) and use them in certain dashboard on Databricks, however i'm not able to fetch them. i have tried GET API request and system tables. The system tables only have CPU utilization and memory utili...

Community Platform Discussions
cluster
compute
metrics
  • 3529 Views
  • 4 replies
  • 2 kudos
Latest Reply
mousie_groove
New Contributor II
  • 2 kudos

Can you tell what 3rd party tools you are referring to?

  • 2 kudos
3 More Replies
marcuskw
by Contributor II
  • 3700 Views
  • 9 replies
  • 2 kudos

Create a Workflow Schedule with varying Parameters

We aim to reduce the amount of notebooks we create to a minimum and instead make these fairly flexible. Therefore we have a Factory setup that takes in a parameter to varies the logic.However when it comes to Workflows we are forced to create multipl...

  • 3700 Views
  • 9 replies
  • 2 kudos
Latest Reply
SamAdams
New Contributor III
  • 2 kudos

We're also running into this issue on my team where having multiple cron schedules would be handy. We have some pipelines that we want run on multiple schedules, say to refresh data "Run every Sunday at midnight" and "Run on the first day of the mont...

  • 2 kudos
8 More Replies
le_clemo
by New Contributor
  • 298 Views
  • 0 replies
  • 0 kudos

Unable to login to community addition account

Hello, I created a community edition account yesterday. Earlier today, I was still able to sign in and everything worked as expected. Now, whenever I try to sign in, I get the following error: "We were not able to find a Community Edition workspace w...

  • 298 Views
  • 0 replies
  • 0 kudos
MLock
by New Contributor II
  • 268 Views
  • 0 replies
  • 1 kudos

Accessing data in Databricks/Unity Catalog from a SharePoint list

Our organization is moving all of it's corporate master data to Databricks.  Our business operations units need access to this data in various tools in the form of look-ups or drop-down lists in tools like Excel and SharePoint lists.  It's simple eno...

  • 268 Views
  • 0 replies
  • 1 kudos
MohsenJ
by Contributor
  • 4120 Views
  • 7 replies
  • 1 kudos

log signature and input data for Spark LinearRegression

I am looking for a way to log my `pyspark.ml.regression.LinearRegression` model with input and signature ata. The usual example that I found around are using sklearn and they can simply do  # Log the model with signature and input example signature =...

Community Platform Discussions
mlflow
model_registray
  • 4120 Views
  • 7 replies
  • 1 kudos
Latest Reply
ac10
New Contributor II
  • 1 kudos

@MohsenJ @javierbg @Abi105  I have found a solution to this issue as I was trying to deploy Spark ML Models to Unity Catalog. Please view my blog and let me know if it helps solve your issues! https://medium.com/p/7d04e8539540

  • 1 kudos
6 More Replies
diego_poggioli
by Contributor
  • 743 Views
  • 1 replies
  • 0 kudos

FAILED_READ_FILE.NO_HINT error

We read data from csv in the volume into the table using COPY INTO. The first 200 files were added without problems, but now we are no longer able to add any new data to the table and the error is FAILED_READ_FILE.NO_HINT. The CSV format is always th...

  • 743 Views
  • 1 replies
  • 0 kudos
Latest Reply
diego_poggioli
Contributor
  • 0 kudos

Py4JJavaError: An error occurred while calling o392.sql. : org.apache.spark.SparkException: [FAILED_READ_FILE.NO_HINT] Error while reading file dbfs:/Volumes/...txt. SQLSTATE: KD001 at org.apache.spark.sql.errors.QueryExecutionErrors$.cannotReadFiles...

  • 0 kudos
Rebecca
by New Contributor II
  • 683 Views
  • 1 replies
  • 1 kudos

Summit23

I have really enjoyed the summit so far! I am a biostatistics graduate student at Harvard and am learning so much here. 

  • 683 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anushree_Tatode
Databricks Employee
  • 1 kudos

Hi,If you had a great time at the Summit, be sure to visit our community events portal for upcoming events and join your regional user group for meetups.Thanks,Anushree

  • 1 kudos
natali
by New Contributor
  • 842 Views
  • 1 replies
  • 0 kudos

Summit 2024

It has been an exciting event that brought together industry leaders, researchers, and practitioners to explore the latest advancements in artificial intelligence and data science. With cutting-edge presentations, hands-on workshops, and networking o...

  • 842 Views
  • 1 replies
  • 0 kudos
Latest Reply
Anushree_Tatode
Databricks Employee
  • 0 kudos

Hi,If you had a great time at the Summit, be sure to visit our community events portal for upcoming events and join your regional user group for meetups.Thanks,Anushree

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors