cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

JohnJustus
by New Contributor III
  • 1900 Views
  • 1 replies
  • 0 kudos

Pyspark API reference

All,I am using Azure Databricks and at times I refer to pyspark API's to interact with data in Azure datalake using python, SQL here https://spark.apache.org/docs/3.5.0/api/python/reference/pyspark.sql/index.htmlDoes databricks website has the list o...

  • 1900 Views
  • 1 replies
  • 0 kudos
adrianhernandez
by New Contributor III
  • 7157 Views
  • 1 replies
  • 1 kudos

Set default database thru Cluster Spark Configuration

Set the default catalog (AKA default SQL Database) in a Cluster's Spark configuration. I've tried the following :spark.catalog.setCurrentDatabase("cbp_reporting_gold_preprod") - this works in a Notebook but doesn't do anything in the Cluster.spark.sq...

  • 7157 Views
  • 1 replies
  • 1 kudos
Latest Reply
adrianhernandez
New Contributor III
  • 1 kudos

I've tried different commands in the Cluster's Spark Config, none work, they execute at Cluster startup w/o any errors shown in the logs, but once you run a notebook attached to the cluster Default catalog is still set to 'default'.

  • 1 kudos
Wayne
by New Contributor III
  • 3913 Views
  • 4 replies
  • 1 kudos

Resolved! My exam has suspended by an unprofessional proctor- need help to reschedule

case #00378268 I passed  Spark Developer associate exam about 6 month ago  with great experience. However, this time the proctor did not even bother to show up to start the exam - checking ID, the room and the surroundings.  Somehow, I was able to st...

Get Started Discussions
Certification
Databricks Certified Data Engineer Associate
  • 3913 Views
  • 4 replies
  • 1 kudos
Latest Reply
Wayne
New Contributor III
  • 1 kudos

That will be great.

  • 1 kudos
3 More Replies
Data_Analytics1
by Contributor III
  • 1900 Views
  • 1 replies
  • 2 kudos

The base provider of Delta Sharing Catalog system does not exist.

I have enabled system tables in Databricks by following the procedure mentioned here. The owner of the system catalog is System user. I cannot see the schemas or tables of this catalog. It is showing me the error: The base provider of Delta Sharing C...

  • 1900 Views
  • 1 replies
  • 2 kudos
Latest Reply
Data_Analytics1
Contributor III
  • 2 kudos

I have already enabled all these schemas using the Databricks CLI command. After enabling, I was able to see all the tables and data inside these schemas. Then I disabled the all the schemas using the CLI command mentioned here. Now, even after re-en...

  • 2 kudos
deepthakkar007
by New Contributor
  • 1163 Views
  • 1 replies
  • 1 kudos
  • 1163 Views
  • 1 replies
  • 1 kudos
Latest Reply
User16539034020
Databricks Employee
  • 1 kudos

Hello,  Thanks for contacting Databricks Support.  It appears you're employing a CloudFormation template to establish a Databricks workspace. The recommended method for creating workspaces is through the AWS Quick Start. Please refer to the documenta...

  • 1 kudos
Upen_databricks
by New Contributor II
  • 1222 Views
  • 0 replies
  • 0 kudos

Databricks access to Microsoft Sql Server

 Hi, i am facing below error while accessing Microosfot sql server. Please suggest what permissions I need to check at database level. I have the scope and secret created and key vault set up as expected. I feel some DB permission issue.Error: com.mi...

Upen_databricks_0-1696539860979.png
  • 1222 Views
  • 0 replies
  • 0 kudos
SenthilKumar386
by New Contributor III
  • 4376 Views
  • 5 replies
  • 2 kudos

Resolved! URGENT - Data Bricks certification Exam Suspended

Hi Team, I scheduled my exam today and I showed the room in proctor. They said dull light. But I turned on with a better place. They again wanted to share the room and suspended the exam. Please help me asapWebassessor Id: npt.senthil@gmail.com

  • 4376 Views
  • 5 replies
  • 2 kudos
Latest Reply
SenthilKumar386
New Contributor III
  • 2 kudos

Thanks I got the rescheduled invite. Thanks much!

  • 2 kudos
4 More Replies
Chibberto
by New Contributor II
  • 1917 Views
  • 0 replies
  • 1 kudos

Connect to delta table from mlflow pyfunc serving endpoint

Hi, I'm creating an mlflow pyfunc serving endpoint and I would like to connect to a delta table to retrieve some information within the pyfunc. Is this possible?I ask because I don't think that serving endpoint environment has access to spark, and we...

Get Started Discussions
mlflow
serving-endpoint
  • 1917 Views
  • 0 replies
  • 1 kudos
horatiug
by New Contributor III
  • 6663 Views
  • 3 replies
  • 2 kudos

Resolved! Changing GCP billing account

Hello we need to change the billing account associated with our Databricks subscription. Is there any documentation available  describing the procedure to be followed ? ThanksHoratiu

  • 6663 Views
  • 3 replies
  • 2 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 2 kudos

Start by logging into the Google Cloud Platform. If you are a new user, you need to create an account before you subscribe to Data bricks. Once in the console, start by selecting an existing Google Cloud project, or create a new project, and confirm ...

  • 2 kudos
2 More Replies
horatiug
by New Contributor III
  • 2101 Views
  • 1 replies
  • 0 kudos

Infrastructure question

We've noticed that the GKE worker nodes which are automatically created when Databricks workspace is created inside GCP project are using the default compute engine SA which's not the best security approach, even Google doesn't recommend using defaul...

  • 2101 Views
  • 1 replies
  • 0 kudos
nramya
by New Contributor
  • 1485 Views
  • 0 replies
  • 0 kudos

How do I add static tag values in the aws databricks-multi-workspace.template.yaml

Hello Team, I have a databricks workspace running on an AWS environment. I have a requirement where the team wanted to add a few customized  tags as per the docs I see below the recommendationTagValue:Description: All new AWS objects get a tag with t...

  • 1485 Views
  • 0 replies
  • 0 kudos
SDas1
by New Contributor
  • 2514 Views
  • 0 replies
  • 0 kudos

Databricks cluster restarted inconsistantly causing job failure ( all purpose cluster)

"run failed with error message  Driver of the cluster (0307-***-gpbwt) was restarted during the run.", "effectiveIntegrationRuntime": "vnet-ir-*-**** (East US) while performing merge operation.This error is not consistant. DB runtime: 11.3 LTS (inclu...

  • 2514 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels