- 1969 Views
- 4 replies
- 0 kudos
Databricks job with a type "Python wheel" does not work if "Package name" contains dash
HelloI created a databricks job with a type "Python wheel". In the "Package name" field I assigned a python package which contains a dash in its name (see attach). The run of the job failed saying that could not import python package due to dash in t...
- 1969 Views
- 4 replies
- 0 kudos
- 0 kudos
There you can see a complete template project with a python wheel task and modules. Please, follow the instructions for deployment.https://github.com/andre-salvati/databricks-template
- 0 kudos
- 1294 Views
- 1 replies
- 1 kudos
having Problems starting a cluster on azure
I cant get the compute Tab to open.. just spins. I also cant start a cluster from a notebook. anyone else seeing this
- 1294 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Byron , Good Day! Can you please provide more details on what you are seeing or facing when you are accessing the compute section? Also please check with your workspace admin whether you have the correct cluster permission or not. You can refer...
- 1 kudos
- 1383 Views
- 1 replies
- 0 kudos
Databricks workspace creation using Terraform and storage configuration IAM Role Arn
Hi,When creating a new AWS Databricks workspace in account console manually, it appears that IAM Role ARN is mandatory parameter when configuring a Storage ConfigurationHowever in the Terraform databricks_mws_storage_configurations resource there is ...
- 1383 Views
- 1 replies
- 0 kudos
- 0 kudos
Investigated this further... Terraform code to create the workspace resource "databricks_mws_workspaces" "databricks_ws" { provider = databricks.mws account_id = var.databricks_account_id aws_region = var.region workspace_name = "databricks-w...
- 0 kudos
- 3328 Views
- 1 replies
- 0 kudos
Editing the SPN name in databricks
As a workspace administrator, I'm finding that I cannot change the Service Principal Name (SPN) immediately after registering it through its application ID in Databricks. It appears that Databricks has linked the SPN name with its application ID and ...
- 3328 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Priyam1 , Hope you are doing well! You can change the display name of the Service Principal using the account SCIM APIs : https://docs.databricks.com/api/azure/account/accountserviceprincipals/patch Please let me know if this helps and leave a l...
- 0 kudos
- 8531 Views
- 2 replies
- 1 kudos
Databricks AWS Secrets Manager access
I have a workspace deployed in AWS and need to read some secrets from AWS Secrets Manager in my notebook. I'm aware that there is no default process similar to Azure Key Vault, however I know that we can try to access it using boto3, but I'm stuck at...
- 8531 Views
- 2 replies
- 1 kudos
- 1 kudos
- 1 kudos
- 1501 Views
- 0 replies
- 0 kudos
unable to publish power bi dashboard with Databricks as source
Able to connect using personal access token and view the data in Hive; but when I publish to dashboard to share-point it results in :- PERMISSION_DENIED: You do not have permissions to autostart 1127-******-*********
- 1501 Views
- 0 replies
- 0 kudos
- 2303 Views
- 0 replies
- 0 kudos
Connect Azure DevOps pipeline to Private Link Databricks Workspace
Hello, i have been trying to get a pipeline in Azure DevOps to communicate with a Databricks Workspace that uses private link connection. I have tried setting up a service connection using a service principle that is also attached to the workspace, h...
- 2303 Views
- 0 replies
- 0 kudos
- 5562 Views
- 3 replies
- 3 kudos
Creating a private link for DBFS root storage
I am facing an issue with securing root DBFS storage access from Databricks.As I understand, Azure Databricks creates a default blob storage (a.k.a root storage) during the deployment process which is used for storing logs and telemetry. This storage...
- 5562 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @NadithK ,You need to create the private endpoint in the resource group where the workspace is deployed and not in the workspace-managed resource group. The workspace-managed resource group has the deny assignment which will not allow to create a ...
- 3 kudos
- 4222 Views
- 7 replies
- 0 kudos
Disable harmful commands at databricks cluster/workspace level
Hi,I want to prevent user from executing harmful commands like dbutils.fs.rm at cluster level/workspace level.Can we do this in databricks? Are there any classes/APIs that we can override?
- 4222 Views
- 7 replies
- 0 kudos
- 0 kudos
Hi ,I got the similar kind of problem too.I followed this put chmod -x /bin/rm in init.sh in workspace and add it at cluster your cluster level init script or global init script.this restricts the users to use rm command.Regards,Nikhil Srivastava@Pal...
- 0 kudos
- 2288 Views
- 3 replies
- 0 kudos
Service Principal can be deleted but permissions not managed
On Azure I added a service principal X to my databricks workspace. I therefore had the Service Prinicpal Manager role on that service principal X. I accidentally downgraded my rights to Service Principal User and now can's get my Managers role back. ...
- 2288 Views
- 3 replies
- 0 kudos
- 0 kudos
I believe so because the described effect was also observed in another databricks workspace, where I did NOT make the accidental change
- 0 kudos
- 2794 Views
- 1 replies
- 0 kudos
SSO with Azure Active Directory : Authentication failed
I have a Databricks account with the E2 version of the Databricks platform. The unified login is not enabled on the account because it was created before June 21, 2023.I configured SSO authentication for the account and for a given workspace (separat...
- 2794 Views
- 1 replies
- 0 kudos
- 1931 Views
- 0 replies
- 0 kudos
Do shared clusters have multiple drivers?
Hi,I know that with single clusters, theres a single driver node and one driver per cluster. With shared clusters, multiple jobs can run concurrently. Does this still run on a single driver container or multiple driver containers run per application?...
- 1931 Views
- 0 replies
- 0 kudos
- 2233 Views
- 1 replies
- 0 kudos
Instance Profile Access Controls
I manage instance profiles assigned to specific user groups. For example, instance profile A provides access solely to group A. Currently, any user within group A has the ability to update the permissions of a cluster using instance profile A, which ...
- 2233 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod,Thank you for your guidance. I am following the strategies outlined in steps 1 and 2, and I remain concerned about a specific scenario.Consider instance profile A, which is designed to grant access exclusively to group A. If user A, ...
- 0 kudos
- 1664 Views
- 2 replies
- 0 kudos
Defaulting or overriding the cluster policy list order
I have numerous cluster policies varying that varies in sizes (Job - xsmall, Job - small, Job - medium...). However, when I create a new job and create a new job cluster the default policy selected from the drop down menu is on the bigger size. Is th...
- 1664 Views
- 2 replies
- 0 kudos
- 0 kudos
I checked on our sorting, and there does not seem to be any logic in it.They are not sorted by ID or description for sure.
- 0 kudos
- 5904 Views
- 3 replies
- 1 kudos
Resolved! Networking reduction cost for NATGateway and Shared Catalog
Use case and context:We have a databricks workspace in a specific region, reading and writing files from/to the same region.We also read from a Shared Catalog in a different company, a data provider, which is pointing to multi-region s3 buckets.The r...
- 5904 Views
- 3 replies
- 1 kudos
- 1 kudos
Thanks @Retired_mod for all the suggestions.After some days of monitoring NAT cost, I realized that the implementation of the S3 Gateway Endpoint it was actually working, the problem was that I thought that this change would be reflected right away i...
- 1 kudos
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group-
Access control
1 -
Access Delta Tables
2 -
ActiveDirectory
1 -
AmazonKMS
1 -
Apache spark
1 -
App
1 -
Availability
1 -
Availability Zone
1 -
AWS
5 -
Aws databricks
1 -
AZ
1 -
Azure
8 -
Azure Data Lake Storage
1 -
Azure databricks
6 -
Azure databricks workspace
1 -
Best practice
1 -
Best Practices
2 -
Billing
2 -
Bucket
1 -
Cache
1 -
Change
1 -
Checkpoint
1 -
Checkpoint Path
1 -
Cluster
1 -
Cluster Pools
1 -
Clusters
1 -
ClustersJob
1 -
Compliance
1 -
Compute Instances
1 -
Cost
1 -
Credential passthrough
1 -
Data
1 -
Data Ingestion & connectivity
6 -
Data Plane
1 -
Databricks Account
1 -
Databricks Control Plane
1 -
Databricks Error Message
2 -
Databricks Partner
1 -
Databricks Repos
1 -
Databricks Runtime
1 -
Databricks SQL
3 -
Databricks SQL Dashboard
1 -
Databricks workspace
1 -
DatabricksJobs
1 -
DatabricksLTS
1 -
DBFS
1 -
DBR
3 -
Dbt
1 -
Dbu
3 -
Deep learning
1 -
DeleteTags Permissions
1 -
Delta
4 -
Delta Sharing
1 -
Delta table
1 -
Dev
1 -
Different Instance Types
1 -
Disaster recovery
1 -
DisasterRecoveryPlan
1 -
DLT Pipeline
1 -
EBS
1 -
Email
2 -
External Data Sources
1 -
Feature
1 -
GA
1 -
Ganglia
3 -
Ganglia Metrics
2 -
GangliaMetrics
1 -
GCP
1 -
GCP Support
1 -
Gdpr
1 -
Gpu
2 -
Group Entitlements
1 -
HIPAA
1 -
Hyperopt
1 -
Init script
1 -
InstanceType
1 -
Integrations
1 -
IP Addresses
1 -
IPRange
1 -
Job
1 -
Job Cluster
1 -
Job clusters
1 -
Job Run
1 -
JOBS
1 -
Key
1 -
KMS
1 -
KMSKey
1 -
Lakehouse
1 -
Limit
1 -
Live Table
1 -
Log
2 -
LTS
3 -
Metrics
1 -
MFA
1 -
ML
1 -
Model Serving
1 -
Multiple workspaces
1 -
Notebook Results
1 -
Okta
1 -
On-premises
1 -
Partner
58 -
Pools
1 -
Premium Workspace
1 -
Public Preview
1 -
Redis
1 -
Repos
1 -
Rest API
1 -
Root Bucket
2 -
SCIM API
1 -
Security
1 -
Security Group
1 -
Security Patch
1 -
Service principal
1 -
Service Principals
1 -
Single User Access Permission
1 -
Sns
1 -
Spark
1 -
Spark-submit
1 -
Spot instances
1 -
SQL
1 -
Sql Warehouse
1 -
Sql Warehouse Endpoints
1 -
Ssh
1 -
Sso
2 -
Streaming Data
1 -
Subnet
1 -
Sync Users
1 -
Tags
1 -
Team Members
1 -
Thrift
1 -
TODAY
1 -
Track Costs
1 -
Unity Catalog
1 -
Use
1 -
User
1 -
Version
1 -
Vulnerability Issue
1 -
Welcome Email
1 -
Workspace
2 -
Workspace Access
1
- « Previous
- Next »
User | Count |
---|---|
40 | |
11 | |
9 | |
9 | |
9 |