When you create a new project in Lakebase, you can choose Postgres 18 (Although 17 is still the default, as 18 has some limitations). #databricks more news and video https://medium.com/databrickscommunity/databricks-news-rt-lakehouse-reyden-lakebase-...
A dozen nice new IP functions have been added to Databricks SQL. #databricks more news https://medium.com/databrickscommunity/databricks-news-rt-lakehouse-reyden-lakebase-ttl-8416bdccf627
Personal network drive is now in Unity Catalog. #databricks more news https://databrickster.medium.com/databricks-news-rt-lakehouse-reyden-lakebase-ttl-8416bdccf62
In the CREATE or ALTER statement, we can specify that rows will be automatically deleted after a number of days based on the date difference between the current date and the value from the given field more news https://medium.com/@databrickster/datab...
The new data type TIME in Spark SQL represents a time value with fields hour, minute, second, and up to microseconds. All operations over the type are performed without taking any time zone into account. more news https://medium.com/@databrickster/da...
The system users group will no longer give default entitlements. It is the first step needed to develop more sophisticated entitlement rules in databricks.https://databrickster.medium.com/databricks-news-rt-lakehouse-reyden-lakebase-ttl-8416bdccf627
Not only is code CI/CD possible, but runtime CI/CD is now possible thanks to #databricks docker. more about it: https://databrickster.medium.com/databricks-docker-from-runtime-ci-cd-to-compliance-1479cf6cdf8d https://www.sunnydata.ai/blog/databricks-...
Why would we want to use docker?Wouldn't that just add unnecessary complexity?
It’s great to see that we have ZeroBus, which can push events from on-premise to the cloud. Now it’s joined by on-premises OpenSharing. This is optimal for organizations that can’t move everything to the cloud or simply don’t want to. #databricks htt...
There are so many new connectors that I stopped counting them and mentioned it in the news. Every week, there is something new. If you just need to ingest data into Databricks from a cloud source, always check the release page, as not everything is e...
None of the new features matters if your platform goes down when a region or cloud has an outage. Cross-region and cross-cloud recovery is non-negotiable. This is key for any platform hosting applications, as it enables the components mentioned above...
As the Lakehouse becomes your primary data and application platform and everything is consolidated there, you will occasionally need to push that data outwards. For example, to run a marketing campaign in Google Ads. #databricks #DataAISummit https:/...
Once you have that single platform holding all your company data, you need a knowledge graph, ideally created automatically, to build a context layer on top of it. Genie Ontology. #databricks #DataAISummit https://databrickster.medium.com/my-favorite...
Once your apps are hosted in Databricks, you need one more element... Customer data lake If you need to run campaigns and maintain master records, a customer data lake becomes essential as it allows you to build your own solution (the premise: SaaS i...
Fast reads and fast writes, thanks to Lakebase, including writes to open formats. It creates a unified platform both for analytics and operational use cases. #databricks #DataAISummit https://databrickster.medium.com/my-favorite-announcements-from-th...
Managed Tables, External Tables, Foreign Tables and... .. Catalog Managed Tables. If you are databricks user, you need to know why they are the best of all! https://databrickster.medium.com/catalog-commits-make-your-managed-delta-layer-safer-and-more...
This is included with the Databricks managed table; there is no separate catalog managed table.
