cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Engineering & Streaming

Forum Posts

Start a conversation
christys
by • Community Manager
  • 832 Views
  • 1 replies
  • 7 kudos

Databricks SQL Serverless Now Available on AWS First announcement at Data + AI Summit 2022 is on the availability of serverless compute for Databricks...

Databricks SQL Serverless Now Available on AWSFirst announcement at Data + AI Summit 2022 is on the availability of serverless compute for Databricks SQL (DBSQL) in Public Preview on AWS! DB SQL Serverless makes it easy to get started with data wareh...

Data Engineering
Reply
  • 832 Views
  • 1 replies
  • 7 kudos
View Replies
Latest Reply
js54123875
New Contributor III
  • 7 kudos

Awesome! We definitely want to join this preview. This is the missing piece for us in making data accessible from the data lake to end users, because it will help with the compute costs. I can't wait to learn more. #Summit22​ 

  • 7 kudos
Gchenzs
by • New Contributor II
  • 356 Views
  • 0 replies
  • 2 kudos

1198646F-C951-4C40-AC6B-EE741EEF4F4C

As a SI partner of Databricks, we are excited to attend the summit and co-present with our client Amgen. Come see us in action at 3PM, check the app for the location!#ss22

Data Engineering
Reply
  • 356 Views
  • 0 replies
  • 2 kudos
sbo
by • New Contributor III
  • 760 Views
  • 1 replies
  • 0 kudos

Resolved! What does Zorder do?

Data Engineering
Reply
  • 760 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Advana
New Contributor III
  • 0 kudos

Speeds up data retrieval when filling in provided fields by collocating data

  • 0 kudos
BradC26
by • New Contributor III
  • 961 Views
  • 2 replies
  • 0 kudos

Resolved! Can I change the experiment location for a model?

We are looking to move some of the artifacts to S3 from dbfs.

Data Engineering
Reply
  • 961 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
sbo
New Contributor III
  • 0 kudos

Yes you can do it via the mlflow python API. However know that when you do that and move the experiment location to S3 the Databricks UI interface doesnt allow interaction with the artifacts etc. the mlflow python API is rich with the abilities to in...

  • 0 kudos
1 More Replies
ccavazos
by • New Contributor III
  • 581 Views
  • 1 replies
  • 6 kudos

Really excited about Delta Sharing Cleanrooms!

Really excited about Delta Sharing Cleanrooms!

Data Engineering
Reply
  • 581 Views
  • 1 replies
  • 6 kudos
View Replies
Latest Reply
Withay
New Contributor II
  • 6 kudos

As am I! Between the clean rooms and the platform-agnostic data marketplace, collaborating on a variety of datasets will become much easier than before!

  • 6 kudos
Mayank
by • New Contributor III
  • 10024 Views
  • 8 replies
  • 4 kudos

Resolved! Unable to load Parquet file using Autoloader. Can someone help?

I am trying to load parquet files using Autoloader. Below is the code def autoload_to_table (data_source, source_format, table_name, checkpoint_path): query = (spark.readStream .format('cloudFiles') .option('cl...

Data Engineering
Reply
  • 10024 Views
  • 8 replies
  • 4 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 4 kudos

Hi again @Mayank Srivastava​ Thank you so much for getting back to us and marking the answer as best.We really appreciate your time.Wish you a great Databricks journey ahead!

  • 4 kudos
7 More Replies
ekhool
by • New Contributor
  • 402 Views
  • 0 replies
  • 0 kudos

 E-khool is an Online Learning Management System software for Industries with low cost and no extra charges. One stop solution for live classes, trai...

E-khool is an Online Learning Management System software for Industries with low cost and no extra charges. One stop solution for live classes, trainings, videos & materials, unlimited exams, corporate training & professional development, online int...

Data Engineering
Reply
  • 402 Views
  • 0 replies
  • 0 kudos
Phani1
by • Valued Contributor II
  • 1114 Views
  • 3 replies
  • 1 kudos

DeltaSharing

Hi, Databricks team,I created the share and provided access to the recipient, and the recipient is consuming or accessing the share. My question is who is going to bear the cost and how can we track the computation charges for it?As per the attached ...

Data Engineering
Reply
  • 1114 Views
  • 3 replies
  • 1 kudos
View Replies
Latest Reply
Phani1
Valued Contributor II
  • 1 kudos

Hi @Kaniz Fatma​ , Thanks for your response on Delta sharing information, Could you please provide details about who is going to bear the cost[either provider/Consumer] and how can we track the computation charges for it?

  • 1 kudos
2 More Replies
EveryDayData
by • Contributor
  • 12266 Views
  • 32 replies
  • 7 kudos

Resolved! Data AI Summit Training

Hi Team,I am asking a little off topic question here. I have been attending paid session for Data AI summit in last 2-3 years. Is it possible to get videos for sessions which we have not attended due to session conflicts at the same time. I mean to s...

Data Engineering
Reply
  • 12266 Views
  • 32 replies
  • 7 kudos
View Replies
Latest Reply
RajeshRK
Contributor
  • 7 kudos

@Juliet Wu​ Hi Juliet,Thank you so much for sharing the recording. Regards,Rajesh.

  • 7 kudos
31 More Replies
Pete_M
by • New Contributor II
  • 2564 Views
  • 2 replies
  • 2 kudos

Resolved! Is it possible to alter the text in a Databricks Job Alert Email?

I have configured a Databricks job to send email alters to me whenever my job fails. However, I would very much like to alter the text in the Alert Email to something a little more bespoke. Is there any way to alter the text in email or even just t...

Data Engineering
Reply
  • 2564 Views
  • 2 replies
  • 2 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hey there @Peter Mayers​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from yo...

  • 2 kudos
1 More Replies
alpha
by • New Contributor III
  • 6857 Views
  • 3 replies
  • 5 kudos

Resolved! Connecting to DataLake Gen2 from Azure Databricks with Private Endpoint

Hi,I have datalake gen2 with vnet and private endpoint. I do have databricks workspace in same vnet. I am trying to access the datalake from databricks but I keep getting error when I allow access only for selected network in datalake. I get error w...

Data Engineering
Reply
  • 6857 Views
  • 3 replies
  • 5 kudos
View Replies
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 5 kudos

You can always check the tutorial regarding ADLS and private link under this link https://community.databricks.com/s/feed/0D53f00001eQGOHCA4

  • 5 kudos
2 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels