cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

User16752244127
by Databricks Employee
  • 4588 Views
  • 2 replies
  • 1 kudos
  • 4588 Views
  • 2 replies
  • 1 kudos
Latest Reply
Brian_Dirking
Databricks Employee
  • 1 kudos

A great place to learn more about Databricks integrations with AWS services is https://www.databricks.com/aws There is information on this page regarding integrations with Glue, SageMaker, Redshift and others. Many of these pages also point to our bl...

  • 1 kudos
1 More Replies
Anonymous
by Not applicable
  • 31391 Views
  • 3 replies
  • 1 kudos
  • 31391 Views
  • 3 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Multiple writers (inserts/appends) present no problems with Delta. You can have two users appending data to a Delta table at the same time without issue. Updates, deletes, merges, and compaction can run into issues when multiple user are trying to d...

  • 1 kudos
2 More Replies
User16826987838
by Databricks Employee
  • 2299 Views
  • 1 replies
  • 0 kudos
  • 2299 Views
  • 1 replies
  • 0 kudos
Latest Reply
Taha
Databricks Employee
  • 0 kudos

Not as of this comment, but our product team is aware of this request and are working on getting this implemented soon!Keep in mind that for feature requests and direct updates/communication from our product team, you can post here (or just vote up o...

  • 0 kudos
User16790091296
by Databricks Employee
  • 2931 Views
  • 1 replies
  • 0 kudos
  • 2931 Views
  • 1 replies
  • 0 kudos
Latest Reply
Taha
Databricks Employee
  • 0 kudos

The admin console exists within the workspace and let's you control access and privileges for that specific workspace. An existing admin can get to it from the drop down in the very top right and selecting Admin Console.The first screen you'll land o...

  • 0 kudos
MoJaMa
by Databricks Employee
  • 1760 Views
  • 1 replies
  • 0 kudos

Can we use SCIM to sync users/groups to Databricks from their on-prem Active Directory. Does Databricks support this?

Can we use SCIM to sync users/groups to Databricks from their on-prem Active Directory. Does Databricks support this?

  • 1760 Views
  • 1 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

Anything that can reach the control plane and use the SCIM API should work. For Azure AD Premium, there is specifically an enterprise App that does this for the customer. 

  • 0 kudos
brickster_2018
by Databricks Employee
  • 2675 Views
  • 1 replies
  • 1 kudos
  • 2675 Views
  • 1 replies
  • 1 kudos
Latest Reply
brickster_2018
Databricks Employee
  • 1 kudos

Ganglia metrics are available only if the job runs for more than 15 minutes. For jobs that are completed within 15 minutes, the metrics won't be available

  • 1 kudos
User16765131552
by Databricks Employee
  • 2954 Views
  • 1 replies
  • 0 kudos

Resolved! Databricks SQL dashboard refresh

In Databricks SQL, can you prohibit a dashboard from being refreshed?

  • 2954 Views
  • 1 replies
  • 0 kudos
Latest Reply
User16765131552
Databricks Employee
  • 0 kudos

It looks like this can be done by not granting CAN_RUN to a user/grouphttps://docs.databricks.com/sql/user/security/access-control/dashboard-acl.html#dashboard-permissions

  • 0 kudos
Anonymous
by Not applicable
  • 1584 Views
  • 1 replies
  • 0 kudos
  • 1584 Views
  • 1 replies
  • 0 kudos
Latest Reply
User16826994223
Databricks Employee
  • 0 kudos

One way to increase the CIDR range id the ip list is available or create a complete different work space on same vpc with different subnets

  • 0 kudos
User16826992666
by Databricks Employee
  • 1736 Views
  • 1 replies
  • 0 kudos

Okta Integration

My company uses Okta as a SSO provider. Can I integrate Okta with Databricks for a SSO experience?

  • 1736 Views
  • 1 replies
  • 0 kudos
Latest Reply
brickster_2018
Databricks Employee
  • 0 kudos

Yes, okta is among the supported identity providers. Read more here : https://docs.databricks.com/administration-guide/users-groups/single-sign-on/index.html

  • 0 kudos
MoJaMa
by Databricks Employee
  • 1525 Views
  • 1 replies
  • 0 kudos
  • 1525 Views
  • 1 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

Yes. There is a property called dbus_per_hour that you can add to your cluster policy.See https://docs.databricks.com/administration-guide/clusters/policies.html#cluster-policy-virtual-attribute-pathsHere's an example policy that uses it:https://docs...

  • 0 kudos
brickster_2018
by Databricks Employee
  • 8172 Views
  • 1 replies
  • 0 kudos

Resolved! My cluster is running an init script, and I want to see what's going on.

After I log in to the workspace, where can I find the logs?

  • 8172 Views
  • 1 replies
  • 0 kudos
Latest Reply
brickster_2018
Databricks Employee
  • 0 kudos

See public docs: https://docs.databricks.com/clusters/init-scripts.html#cluster-scoped-init-script-logsDon't forget to enable cluster log delivery: https://docs.databricks.com/clusters/configure.html#cluster-log-deliveryNote that this only works for ...

  • 0 kudos
User16790091296
by Databricks Employee
  • 2756 Views
  • 1 replies
  • 0 kudos
  • 2756 Views
  • 1 replies
  • 0 kudos
Latest Reply
User16790091296
Databricks Employee
  • 0 kudos

At a high level a Lakehouse must contain the following properties:Open direct access data formats (Apache Parquet, Delta Lake etc.)First class support for machine learning and data science workloadsstate of the art performance Databricks is the firs...

  • 0 kudos