cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Engineering & Streaming

Forum Posts

brickster_2018
by Esteemed Contributor
  • 1765 Views
  • 1 replies
  • 0 kudos
  • 1765 Views
  • 1 replies
  • 0 kudos
Latest Reply
aladda
Honored Contributor II
  • 0 kudos

Deleting the Delta log directory would cause you to lose the underlying transaction history on the delta table and other delta related optimizations. In effect the table would be converted to a Parquet table at that point

  • 0 kudos
User16790091296
by Contributor II
  • 1210 Views
  • 2 replies
  • 0 kudos
  • 1210 Views
  • 2 replies
  • 0 kudos
Latest Reply
Taha
New Contributor III
  • 0 kudos

Also, a lot of examples here: https://docs.databricks.com/administration-guide/clusters/policies.html#cluster-policy-examples

  • 0 kudos
1 More Replies
brickster_2018
by Esteemed Contributor
  • 1387 Views
  • 1 replies
  • 0 kudos
  • 1387 Views
  • 1 replies
  • 0 kudos
Latest Reply
aladda
Honored Contributor II
  • 0 kudos

Global: run on every cluster in the workspace. They can help you to enforce consistent cluster configurations across your workspace. Use them carefully because they can cause unanticipated impacts, like library conflicts. Only admin users can create ...

  • 0 kudos
MoJaMa
by Valued Contributor II
  • 1203 Views
  • 1 replies
  • 0 kudos
  • 1203 Views
  • 1 replies
  • 0 kudos
Latest Reply
MoJaMa
Valued Contributor II
  • 0 kudos

Yes.Currently supported paths are:BYO VPC -> New BYO VPCDatabricks-created VPC -> New Databricks-created VPC

  • 0 kudos
brickster_2018
by Esteemed Contributor
  • 835 Views
  • 1 replies
  • 1 kudos
  • 835 Views
  • 1 replies
  • 1 kudos
Latest Reply
aladda
Honored Contributor II
  • 1 kudos

For Databricks Runtime 5.5 LTS, Spark jobs, Python notebook cells, and library installation all support both Python 2 and 3.The default Python version for clusters created using the UI is Python 3. In Databricks Runtime 5.5 LTS the default version fo...

  • 1 kudos
User16869509994
by New Contributor II
  • 1022 Views
  • 1 replies
  • 1 kudos
  • 1022 Views
  • 1 replies
  • 1 kudos
Latest Reply
aladda
Honored Contributor II
  • 1 kudos

Can you provide an example of what exactly do you mean? If the reference is to how "Repos" shows up in the UI, that's more for a Ux convenience. Repos as such are designed to be a container for version controlled notebooks that live in the Git reposi...

  • 1 kudos
User16790091296
by Contributor II
  • 1539 Views
  • 2 replies
  • 0 kudos
  • 1539 Views
  • 2 replies
  • 0 kudos
Latest Reply
aladda
Honored Contributor II
  • 0 kudos

Delta Lake on Databricks has added runtime optimizations of the Delta Engine that further enhance the performance and scale of the open source Delta Format. In additional you also get access to a whole host of capabilities available on the Databricks...

  • 0 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels