cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

raktim_das
by New Contributor
  • 40 Views
  • 1 replies
  • 0 kudos

Creating table in Unity Catalog with file scheme dbfs is not supported

 code:# Define the path for the staging Delta tablestaging_table_path = "dbfs:/user/hive/warehouse/staging_order_tracking"spark.sql( f"CREATE TABLE IF NOT EXISTS staging_order_tracking USING DELTA LOCATION '{staging_table_path}'" )Creating table in U...

  • 40 Views
  • 1 replies
  • 0 kudos
Latest Reply
LuisRSanchez
New Contributor III
  • 0 kudos

In UC dbfs file location and dbfs mount point for a table is consider an anti pattern by databricks, this is because dbfs is at the scope of the workspace and it has security limitations (https://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-...

  • 0 kudos
pdemeulenaer
by New Contributor
  • 26 Views
  • 0 replies
  • 0 kudos

Databricks asset bundles dependencies

Is anyone aware of a way to include a requirements.txt within the job definition of a databricks asset bundle? Documentation mentions how to have dependencies in workspace files, or Unity Catalog volumes, but I wanted to ask if it is possible to decl...

Community Discussions
databricksassetbundles
Dependency
  • 26 Views
  • 0 replies
  • 0 kudos
PragyaS
by New Contributor
  • 36 Views
  • 0 replies
  • 0 kudos

Creating Zip file on Azure storage explorer

I need to create zip file which will contain csv files which I have created from the dataframe. But I am unable to create valid zip file which will be containing all csv files. Is it possible to create zip file from code in databricks on azure storag...

  • 36 Views
  • 0 replies
  • 0 kudos
subahan_dbricks
by Visitor
  • 48 Views
  • 1 replies
  • 0 kudos

Databricks DataEngineering Learning

I am new to Databricks. I am trying to do the lab work given Databricks DataEngineering course, at workbook 4.1 I am getting below error. Please help to resolve.Expected one and only one cluster definition.Edit the config via the JSON interface to re...

  • 48 Views
  • 1 replies
  • 0 kudos
Latest Reply
Rishabh264
Honored Contributor II
  • 0 kudos

Detailed InstructionsHere’s how you can edit the JSON configuration:Step-by-Step Guide:Access the Cluster Configuration:In Databricks, navigate to the workspace where your notebook or job is located.Go to the Jobs tab or the specific notebook you are...

  • 0 kudos
Apurvatiwari
by New Contributor
  • 79 Views
  • 2 replies
  • 0 kudos

How can i create multiple workspaces in existing single azure databricks resource?

I have an azure databricks resource created in my Azure portal. I want to achieve departmental secracy in single databricks resource. Hence, I am looking for a solution where I can add multiple workspaces to my single Databricks resource. Is it even ...

  • 79 Views
  • 2 replies
  • 0 kudos
Latest Reply
Hkesharwani
Contributor II
  • 0 kudos

Hi, It is possible to create multiple workspace from a single azure account.Go to Azure portal click on Azure Databricks.Click on Create.Fill all the details and your new workspace is ready. 

  • 0 kudos
1 More Replies
Mani2105
by New Contributor
  • 25 Views
  • 0 replies
  • 0 kudos

SAP Data in Databricks

Any one using SAP data to brining in to Databricks, do you directly hit SAP ODP or use any third party tool to get the data to datalake .  Thanks,

  • 25 Views
  • 0 replies
  • 0 kudos
Prasath
by New Contributor
  • 272 Views
  • 1 replies
  • 0 kudos

Data Summi 2023

I learned about Unity catalog, LLM features and delta sharing today at Data summit.

  • 272 Views
  • 1 replies
  • 0 kudos
Latest Reply
VENKATPS035
New Contributor
  • 0 kudos

Really liked the new nnouncemns on unity catelog

  • 0 kudos
vicky403
by New Contributor
  • 24 Views
  • 0 replies
  • 0 kudos

How Development Target works for multiple users?

Hi, I'm using the Databricks asset bundle to deploy my job to Azure Databricks.I want to configure the Databricks bundle so that when anyone runs the Azure pipeline, a job is created under their name in the format dev_username_job.Using a personal ac...

  • 24 Views
  • 0 replies
  • 0 kudos
nileshtiwaari
by New Contributor
  • 33 Views
  • 0 replies
  • 0 kudos

Spark structured streaming

hi,could someone please help me with this code :-input parameter df is a spark structured streaming dataframe def apply_duplicacy_check(df, duplicate_check_columns):    if len(duplicate_check_columns) == 0:         return None, df    valid_df = df.dr...

  • 33 Views
  • 0 replies
  • 0 kudos
BarbaraMSilver
by New Contributor
  • 77 Views
  • 2 replies
  • 0 kudos

How Can I Resolve Error 103 in QBO?

I'm encountering Error 103 while trying to access my account in QBO. It seems to be related to incorrect login credentials, but I've double-checked everything. Can someone guide me on how to fix this issue?

  • 77 Views
  • 2 replies
  • 0 kudos
Latest Reply
Sharon635Davis
New Contributor
  • 0 kudos

@BarbaraMSilver Error 103 in QBO occurs due to incorrect login credentials for your bank. To resolve it:Verify Credentials: Log in to your bank’s website directly to confirm your username and password.Update Info: In QBO, go to the Banking menu, edit...

  • 0 kudos
1 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!