- 13870 Views
- 1 replies
- 2 kudos
SQL warehouse vs databricks cluster ?
Even through we have option to use databricks cluster for SQL query , when we should use SQL warehouse ?
- 13870 Views
- 1 replies
- 2 kudos
- 2 kudos
a sql warehouse can be used for interactive SQL querying.If you want to do batch processing using sql, a classic cluster is a better choice (because cheaper), but for interactive queries, performance is key. SQL warehouses are pretty fast and optimi...
- 2 kudos
- 1304 Views
- 1 replies
- 0 kudos
use cases on parquet v. delta
What would be reason of teams choosing to have their data in #parquet instead of #delta.
- 1304 Views
- 1 replies
- 0 kudos
- 0 kudos
no need for a log, always a full overwrite f.e.
- 0 kudos
- 5071 Views
- 3 replies
- 1 kudos
Resolved! Databricks Repo
Hello,What is the correct way to install packages from requierements.txt within databricks repo. Do I need to add some utils notebooks with additional scripts to my repo and run them before any of the script from the file? I suppose adding pip instal...
- 5071 Views
- 3 replies
- 1 kudos
- 1 kudos
The .py files are very handy if you create classes etc. They contain modules which you can import into a notebook with the import statement. They are not meant to be run.
- 1 kudos
- 2020 Views
- 1 replies
- 0 kudos
data ai summit 2023
The summit is a great place to meet fellow data practitioners and learn more about how other companies are using Databricks so we can best leverage the full power of the tool. I am specially interested into hearing tips about better cost management t...
- 2020 Views
- 1 replies
- 0 kudos
- 0 kudos
There was a session on migration to unity catalog today. Maybe you can check the videos. 
- 0 kudos
- 536 Views
- 0 replies
- 0 kudos
New to Data Science, Excited to meet new people :)
Hello everyone! My name is Rio Jia, currently pursuing my master's in data science at Vanderbilt University, and also have the privilege of interning in data science at Dell Technologies this summer. I learned a lot from the various sessions and expo...
- 536 Views
- 0 replies
- 0 kudos
- 960 Views
- 0 replies
- 0 kudos
multi-cloud data streaming talk today at Data + AI Summit 2023
The talk highlighted the benefits of using an open data lake for unified batch and streaming workloads and showcased features like Autoloader for data discovery, streaming triggers for seamless switching, and streaming aggregation for incremental com...
- 960 Views
- 0 replies
- 0 kudos
- 1037 Views
- 1 replies
- 0 kudos
Dais2023
Had an amazing time at Data and AI summit 2023
- 1037 Views
- 1 replies
- 0 kudos
- 0 kudos
It has been great so far! What has been your favorite session?I specially liked the talk from Appria around real time model monitoring.
- 0 kudos
- 807 Views
- 0 replies
- 0 kudos
Cannot reset the password for my databricks community edition account
My email id is bhatta.rohan@gmail.com. I am trying to reset my password but each time I am clicking on the link in the email and updating the password the page is going on loading. Please help.
- 807 Views
- 0 replies
- 0 kudos
- 1467 Views
- 0 replies
- 1 kudos
Exploring possibilities to accelerate decisions in biotech with Data & AI
I'm Kishore, Data Engineering Manager at Inari, where we use multiplex gene editing and our predictive design engine toolkit to design better yield and resilient seeds for crops such as Corn, Soy and Wheat. As a software engineer turned data engineer...
- 1467 Views
- 0 replies
- 1 kudos
- 1279 Views
- 0 replies
- 0 kudos
My experience in DAIS23
I work in ads management industry. Integrating marketplaces platforms, such as, Amazon, Google, Instacart etc. We are using databricks about 3 years. As we gathering several sources near-real time, Streaming and DLT are our main technologies nowadays...
- 1279 Views
- 0 replies
- 0 kudos
- 2637 Views
- 1 replies
- 3 kudos
Getting into Data Analytics
I used to be a Technical Recruiter and used data to understand hiring process and how to target the right candidates for niche roles. My company started hiring for the data analytics role and I thought of this as an opportunity pave my way into the a...
- 2637 Views
- 1 replies
- 3 kudos
- 3 kudos
Sasha - Congrats on building your skills and having the courage to make a big jump! Very inspiring!
- 3 kudos
- 2054 Views
- 1 replies
- 0 kudos
Data Catalog
We just implemented Data Catalog, but in terms of a data dictionary that intertwines with a business glossary, what are people using out there? I need to have something our non technical users see to understand what can be queried.
- 2054 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi ArtG,I haven't tried it myself, but Atlan's website looks interesting - data catalog and glossary not just for Databricks but also for Snowflake, Salesforce, and a whole lot more
- 0 kudos
- 856 Views
- 0 replies
- 0 kudos
- 856 Views
- 0 replies
- 0 kudos
- 2147 Views
- 3 replies
- 0 kudos
AI Summit 2023 day 1 takeaways
One thing I learned today is that we need to be more engaged with our business users and empower them to develop. I personally have been one to not always fully engage the business users. Thank you Michelin for presenting and touching on this topic t...
- 2147 Views
- 3 replies
- 0 kudos
- 0 kudos
If you mean 'Delta-rs, Apache Arrow, Polars, WASM: Is Rust the Future of Analytics', yes I was at that talk and that was really interesting
- 0 kudos
- 791 Views
- 0 replies
- 0 kudos
Getting started
Attending the Databricks conference was an immersive and enlightening experience. I gained valuable insights into the latest advancements in data analytics and AI, networked with industry experts, and left inspired by the innovative use cases shared....
- 791 Views
- 0 replies
- 0 kudos
