cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Essjay
by New Contributor II
  • 4434 Views
  • 1 replies
  • 3 kudos

Resolved! Standard SKU to Premium SKU?

What's the effort involved with converting a databricks standard workspace to a premium? Is it 1 click of a button? Or are there other considerations you need to think about?

  • 4434 Views
  • 1 replies
  • 3 kudos
Latest Reply
srusso
New Contributor III
  • 3 kudos

It’s pretty easy! You can use the Azure API or the CLI. To upgrade, use the Azure Databricks workspace creation API to recreate the workspace with exactly the same parameters as the Standard workspace, specifying the sku property as Premium. To use t...

  • 3 kudos
msa_2j212
by New Contributor II
  • 4312 Views
  • 2 replies
  • 1 kudos

Downloading and storing a PDF file to FileStore not working

I'm trying to download a PDF file and store it in FileStore using this code in a Notebook: with open('/dbfs/FileStore/file.pdf', 'wb') as f: f.write(requests.get('https://url.com/file.pdf').content) But I'm getting this error:FileNotFoundError: [...

  • 4312 Views
  • 2 replies
  • 1 kudos
Latest Reply
msa_2j212
New Contributor II
  • 1 kudos

This worked, thanks. 

  • 1 kudos
1 More Replies
berdoni
by New Contributor III
  • 1698 Views
  • 0 replies
  • 0 kudos

Migrate an Azure Delta Table from Standard to Premium Storage

Hello,I'm exercising a migration of an azure delta table (10TB) from Azure Standard  performance tier to Azure Premium. The plan is to create a new storage account and copy the table into it. Then we will switch to the new table. The table contains r...

Data Engineering
azure
deep clone
  • 1698 Views
  • 0 replies
  • 0 kudos
Hubert-Dudek
by Databricks MVP
  • 15104 Views
  • 3 replies
  • 25 kudos

Bamboolib with databricks, low-code programming is now available on #databricks Now you can prepare your databricks code without ... coding. Low code ...

Bamboolib with databricks, low-code programming is now available on #databricksNow you can prepare your databricks code without ... coding. Low code solution is now available on Databricks. Install and import bamboolib to start (require a version of ...

Picture2 Picture3 bamboolib Picture4
  • 15104 Views
  • 3 replies
  • 25 kudos
Latest Reply
Palkers
Databricks Partner
  • 25 kudos

I have tried to load parquet file using bamboolib menu, and getting below error that path does not existI can load the same file without no problem using spark or pandas using following pathciti_pdf = pd.read_parquet(f'/dbfs/mnt/orbify-sales-raw/Wide...

  • 25 kudos
2 More Replies
Kamalpandey
by New Contributor
  • 4024 Views
  • 2 replies
  • 0 kudos

How to connect third party apps

help us to understand how integrate third party app such as M365 to databricks

  • 4024 Views
  • 2 replies
  • 0 kudos
Latest Reply
VRS
New Contributor II
  • 0 kudos

Try using "partner connect" API by databricks. They have manual connect and automatic connect options for this. databricks have individual partner connect api for each third application. Check if M365 supports this type of integration with databricks...

  • 0 kudos
1 More Replies
whleeman
by New Contributor III
  • 3934 Views
  • 2 replies
  • 2 kudos

Resolved! Can I use SQL to create a table and set an expiration date?

Can I use SQL to create a table and set and expiration date? So that the table will be deleted automatically after the expiration date.

  • 3934 Views
  • 2 replies
  • 2 kudos
Latest Reply
prakash1
New Contributor II
  • 2 kudos

Right now it i not possible. You can always create a custom trigger solution with parameter to call notebook and delete the table.

  • 2 kudos
1 More Replies
Rsamidi
by New Contributor
  • 805 Views
  • 0 replies
  • 0 kudos

Hi

This is Rajani 

  • 805 Views
  • 0 replies
  • 0 kudos
Joko
by New Contributor
  • 1294 Views
  • 1 replies
  • 0 kudos

Sharing data

Just learned in this mornings session that Databricks enables me to share data across organizations. What would be the first step to learn more about how to do this?

  • 1294 Views
  • 1 replies
  • 0 kudos
Latest Reply
Boonie123
New Contributor II
  • 0 kudos

The feature you're interested in is Delta Sharing. The feature page is located here.https://www.databricks.com/product/delta-sharingA more technical description for AWS customers can be found here:https://docs.databricks.com/data-sharing/index.html

  • 0 kudos
Ballsandeep
by New Contributor
  • 1146 Views
  • 0 replies
  • 0 kudos

Exciting #dataai Summit

Excited to be attending the #DataAISummit! Joined industry leaders, experts, and data enthusiasts at this incredible event. Learning about the latest trends, advancements, and best practices in data and AI. It's a fantastic opportunity to network an...

  • 1146 Views
  • 0 replies
  • 0 kudos
mkm
by New Contributor III
  • 1310 Views
  • 1 replies
  • 0 kudos

job alerts

Is it possible to send job alerts via microsoft teams?

  • 1310 Views
  • 1 replies
  • 0 kudos
Latest Reply
Umarshafique56
New Contributor II
  • 0 kudos

Yes , if databricks jobs are being orchestrated through ADF then you can call azure function app to send teams notifications. 

  • 0 kudos
christian_acuna
by New Contributor
  • 4653 Views
  • 3 replies
  • 0 kudos

Can you z-order a table with Spark Structured Streaming?

Hi, can you do zordering as part of a structured streaming ingestion? 

  • 4653 Views
  • 3 replies
  • 0 kudos
Latest Reply
Brian2
New Contributor III
  • 0 kudos

You can also turn on auto optimize writes for your table or session.  This is especially good if your table is partitioned.  You should also turn on auto compaction to help control the size of your files.Auto compaction can be enabled at the table or...

  • 0 kudos
2 More Replies
Labels