- 3680 Views
- 2 replies
- 1 kudos
Downloading and storing a PDF file to FileStore not working
I'm trying to download a PDF file and store it in FileStore using this code in a Notebook: with open('/dbfs/FileStore/file.pdf', 'wb') as f: f.write(requests.get('https://url.com/file.pdf').content) But I'm getting this error:FileNotFoundError: [...
- 3680 Views
- 2 replies
- 1 kudos
- 1350 Views
- 0 replies
- 0 kudos
Migrate an Azure Delta Table from Standard to Premium Storage
Hello,I'm exercising a migration of an azure delta table (10TB) from Azure Standard performance tier to Azure Premium. The plan is to create a new storage account and copy the table into it. Then we will switch to the new table. The table contains r...
- 1350 Views
- 0 replies
- 0 kudos
- 12789 Views
- 3 replies
- 25 kudos
Bamboolib with databricks, low-code programming is now available on #databricks Now you can prepare your databricks code without ... coding. Low code ...
Bamboolib with databricks, low-code programming is now available on #databricksNow you can prepare your databricks code without ... coding. Low code solution is now available on Databricks. Install and import bamboolib to start (require a version of ...
- 12789 Views
- 3 replies
- 25 kudos
- 25 kudos
I have tried to load parquet file using bamboolib menu, and getting below error that path does not existI can load the same file without no problem using spark or pandas using following pathciti_pdf = pd.read_parquet(f'/dbfs/mnt/orbify-sales-raw/Wide...
- 25 kudos
- 3211 Views
- 2 replies
- 0 kudos
How to connect third party apps
help us to understand how integrate third party app such as M365 to databricks
- 3211 Views
- 2 replies
- 0 kudos
- 0 kudos
Try using "partner connect" API by databricks. They have manual connect and automatic connect options for this. databricks have individual partner connect api for each third application. Check if M365 supports this type of integration with databricks...
- 0 kudos
- 3231 Views
- 2 replies
- 2 kudos
Resolved! Can I use SQL to create a table and set an expiration date?
Can I use SQL to create a table and set and expiration date? So that the table will be deleted automatically after the expiration date.
- 3231 Views
- 2 replies
- 2 kudos
- 2 kudos
Right now it i not possible. You can always create a custom trigger solution with parameter to call notebook and delete the table.
- 2 kudos
- 748 Views
- 0 replies
- 0 kudos
Data Engineering Associate Training
Props to the training team for the Data Engineering track at AI Summit, learned a ton and got some great experience!
- 748 Views
- 0 replies
- 0 kudos
- 734 Views
- 0 replies
- 0 kudos
- 734 Views
- 0 replies
- 0 kudos
- 35126 Views
- 21 replies
- 2 kudos
- 35126 Views
- 21 replies
- 2 kudos
- 1935 Views
- 0 replies
- 1 kudos
How to plan for 2 million json files ingestion in production
We are planning to load 2 million plus jsons into prod. How should we plan for any intermittent failures and complete loads without performance issues.
- 1935 Views
- 0 replies
- 1 kudos
- 618 Views
- 0 replies
- 0 kudos
Hi
This is Rajani
- 618 Views
- 0 replies
- 0 kudos
- 952 Views
- 1 replies
- 0 kudos
Sharing data
Just learned in this mornings session that Databricks enables me to share data across organizations. What would be the first step to learn more about how to do this?
- 952 Views
- 1 replies
- 0 kudos
- 0 kudos
The feature you're interested in is Delta Sharing. The feature page is located here.https://www.databricks.com/product/delta-sharingA more technical description for AWS customers can be found here:https://docs.databricks.com/data-sharing/index.html
- 0 kudos
- 872 Views
- 0 replies
- 0 kudos
Exciting #dataai Summit
Excited to be attending the #DataAISummit! Joined industry leaders, experts, and data enthusiasts at this incredible event. Learning about the latest trends, advancements, and best practices in data and AI. It's a fantastic opportunity to network an...
- 872 Views
- 0 replies
- 0 kudos
- 957 Views
- 1 replies
- 0 kudos
job alerts
Is it possible to send job alerts via microsoft teams?
- 957 Views
- 1 replies
- 0 kudos
- 0 kudos
Yes , if databricks jobs are being orchestrated through ADF then you can call azure function app to send teams notifications.
- 0 kudos
- 3865 Views
- 3 replies
- 0 kudos
Can you z-order a table with Spark Structured Streaming?
Hi, can you do zordering as part of a structured streaming ingestion?
- 3865 Views
- 3 replies
- 0 kudos
- 0 kudos
You can also turn on auto optimize writes for your table or session. This is especially good if your table is partitioned. You should also turn on auto compaction to help control the size of your files.Auto compaction can be enabled at the table or...
- 0 kudos
- 1301 Views
- 1 replies
- 1 kudos
Resolved! Diy spark enthusiasts?
On prem Spark enthusiasts? Setting up your own Hadooop is fun, right?
- 1301 Views
- 1 replies
- 1 kudos
- 1 kudos
This gives me ptsd. Hadoop and mapreduce has been nice and painful!
- 1 kudos
| User | Count |
|---|---|
| 1619 | |
| 790 | |
| 493 | |
| 349 | |
| 287 |
