- 523 Views
- 0 replies
- 1 kudos
2023 DataAISummit
Started with the keynote session and instantly got two ideas Safe by design and data lineage by design, excited with changes for spark3.4 and lakehouseIQ
- 523 Views
- 0 replies
- 1 kudos
Forum Posts
- 393 Views
- 0 replies
- 0 kudos
Unity Catalog
Looking forward to the ease of data security and sharing
- 393 Views
- 0 replies
- 0 kudos
- 1691 Views
- 2 replies
- 0 kudos
UnityCatalog
Can we get the lineage for onprem spark application running i. Loval
- 1691 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Yes, you can create private endpoint links and application access (depends on your cloud provider) to connect with your on-premise systems and unity catalog can sync that well. Lineage is supported for all languages and is captured down to the column...
- 0 kudos
- 1882 Views
- 2 replies
- 0 kudos
Resolved! Auto loader
How to get a list of file loaded by auto loader?
- 1882 Views
- 2 replies
- 0 kudos
Latest Reply
- 456 Views
- 0 replies
- 0 kudos
Databricks conference 2023
Eager to hear delta new capabilities
- 456 Views
- 0 replies
- 0 kudos
- 3049 Views
- 0 replies
- 0 kudos
DataAI Summit
Having a great time at the summit and learning about the advances with AI. The advantages of adding the ability to use english as a new programming language and the advantage that it will bring to the companies that adapt to the future of Databricks....
- 3049 Views
- 0 replies
- 0 kudos
- 616 Views
- 0 replies
- 0 kudos
DAIS 2023
Amazing! Excited to be part of my first DAIS. Incredible contributions. Looking forward to putting some of the tools and features into practice.
- 616 Views
- 0 replies
- 0 kudos
- 608 Views
- 0 replies
- 0 kudos
Summit
Having a great time at the data summit! It is an amazing experience and is organized very well! #databricks
- 608 Views
- 0 replies
- 0 kudos
- 4525 Views
- 1 replies
- 1 kudos
Resolved! need help with Concurrent append exception during delta merge
I have 2 datasets getting loaded into a common silver table. These are event driven and notebooks are triggered when a file is dropped into the storage account. When the files come in at the same time, one dataset fails with concurrent append excepti...
- 4525 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Databricks provides ACID guarantees since the inception of Delta format. In order to ensure the C - Consistency is addressed, it limits concurrent workflows to perform updates at the same time, like other ACID compliant SQL engines. The key differenc...
- 1 kudos
- 3093 Views
- 1 replies
- 0 kudos
- 3093 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
No difference, both are very similar only difference is that in the SQL editor you cannot take advantage of things like SQL serverless clusters, better visibility of data objects and a more simplified exploration tooling. SQL in notebooks mostly run ...
- 0 kudos
- 3059 Views
- 1 replies
- 3 kudos
Resolved! Standard SKU to Premium SKU?
What's the effort involved with converting a databricks standard workspace to a premium? Is it 1 click of a button? Or are there other considerations you need to think about?
- 3059 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
It’s pretty easy! You can use the Azure API or the CLI. To upgrade, use the Azure Databricks workspace creation API to recreate the workspace with exactly the same parameters as the Standard workspace, specifying the sku property as Premium. To use t...
- 3 kudos
- 3124 Views
- 2 replies
- 1 kudos
Downloading and storing a PDF file to FileStore not working
I'm trying to download a PDF file and store it in FileStore using this code in a Notebook: with open('/dbfs/FileStore/file.pdf', 'wb') as f: f.write(requests.get('https://url.com/file.pdf').content) But I'm getting this error:FileNotFoundError: [...
- 3124 Views
- 2 replies
- 1 kudos
Latest Reply
- 1126 Views
- 0 replies
- 0 kudos
Migrate an Azure Delta Table from Standard to Premium Storage
Hello,I'm exercising a migration of an azure delta table (10TB) from Azure Standard performance tier to Azure Premium. The plan is to create a new storage account and copy the table into it. Then we will switch to the new table. The table contains r...
- 1126 Views
- 0 replies
- 0 kudos
- 11040 Views
- 3 replies
- 25 kudos
Bamboolib with databricks, low-code programming is now available on #databricks Now you can prepare your databricks code without ... coding. Low code ...
Bamboolib with databricks, low-code programming is now available on #databricksNow you can prepare your databricks code without ... coding. Low code solution is now available on Databricks. Install and import bamboolib to start (require a version of ...
- 11040 Views
- 3 replies
- 25 kudos
Latest Reply
- 25 kudos
I have tried to load parquet file using bamboolib menu, and getting below error that path does not existI can load the same file without no problem using spark or pandas using following pathciti_pdf = pd.read_parquet(f'/dbfs/mnt/orbify-sales-raw/Wide...
- 25 kudos
- 2741 Views
- 2 replies
- 0 kudos
How to connect third party apps
help us to understand how integrate third party app such as M365 to databricks
- 2741 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Try using "partner connect" API by databricks. They have manual connect and automatic connect options for this. databricks have individual partner connect api for each third application. Check if M365 supports this type of integration with databricks...
- 0 kudos
| User | Count |
|---|---|
| 1613 | |
| 771 | |
| 349 | |
| 286 | |
| 253 |
