cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Ali_Ahmad
by New Contributor II
  • 2161 Views
  • 1 replies
  • 0 kudos

Add Raw Tabless to Unity Catalog?

Hello everyone,Hope someone here can help me out as I am a bit stuck I am currently loading some data from number of sources to parquet using ADF. This ends up in a ADLS2 storage account as .parquet. This is the staging / landing zone area.From there...

  • 2161 Views
  • 1 replies
  • 0 kudos
rodrigosanchesz
by New Contributor II
  • 13502 Views
  • 0 replies
  • 0 kudos

Change adls gen2 attached to Unity Catalog metastore from premium to standard

Hello,Our cloud platform engineer created Azure storage for the production Unity Catalog metastore in our environment, but mistakenly chose the Premium tier instead of the Standard tier.Unfortunately, this decision is impacting our costs on Azure, as...

  • 13502 Views
  • 0 replies
  • 0 kudos
Ender
by New Contributor II
  • 2831 Views
  • 2 replies
  • 0 kudos

Accessing ADLS Gen2 related Hadoop configuration in notebook

I have a cluster in which I have the required configuration to access an ADLS Gen2, and it works without any problems.I want to access this storage using the Hadoop filesystem APIs. To achieve this, I am trying to get the Hadoop configuration from th...

Ender_1-1717335940727.png Ender_3-1717336689720.png
  • 2831 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ender
New Contributor II
  • 0 kudos

By the way how do you achieve inline code highlighting in the editor I tried `` but it didn't work.

  • 0 kudos
1 More Replies
Shawn_Eary
by Contributor
  • 1704 Views
  • 1 replies
  • 2 kudos

Resolved! DAIS24 Attendee Badge - Oops

I wasn't at DAIS24, but I received one of these emails and it appears to have come from Databricks. I think I was given the badge in error. Can we have it removed?Just Wondering,Shawn

Shawn_Eary_1-1717680651702.png
  • 1704 Views
  • 1 replies
  • 2 kudos
Latest Reply
Sujitha
Databricks Employee
  • 2 kudos

Hi @Shawn_Eary Thank you for bringing this to our attention. We were conducting a test on badges, and some of our community members may have received this email by accident. We have revoked the changes now, please ignore the message.

  • 2 kudos
vabadzhiev
by New Contributor II
  • 2340 Views
  • 1 replies
  • 0 kudos

Tableau Prep Save Output to Databricks

Has anyone run into use cases where your data scientist/data engineer end users build Tableau Prep Flows and steps in Tableau Prep Flow require saving output back into Databricks? There appears to be no native support for this in Tableau Prep if the ...

  • 2340 Views
  • 1 replies
  • 0 kudos
Latest Reply
vabadzhiev
New Contributor II
  • 0 kudos

These are awesome suggestions. To expand on our setup, we also have Informatica Cloud - IICS (CMI, CDI, etc.) connected to the entire setup generally used for bringing data from a source (PaaS, SaaS, On-prem SQL, Flat Files or streaming devices) to D...

  • 0 kudos
Kushal_Nagrani
by New Contributor III
  • 3704 Views
  • 4 replies
  • 0 kudos

Resolved! Getting error while running the MLOPS demo

Hello,I am trying to run this demo in databricks community edition but i am facing error.MLOPS DEMO - https://www.databricks.com/resources/demos/tutorials/data-science-and-ai/mlops-end-to-end-pipeline?itm_data=demo_centerSomeone else also faced the s...

kushalnagrani_0-1713782286430.png kushalnagrani_1-1713782333329.png
Get Started Discussions
dbdemos
mlflow
MLOPS
  • 3704 Views
  • 4 replies
  • 0 kudos
Latest Reply
sidosq
New Contributor II
  • 0 kudos

Hey @Kushal_Nagrani , thank you for sharing this. I am facing the same issue. Could you please help me where can I find these settings? I am new, just created a community workspace and I thought given I am the admin I will have all these by default -...

  • 0 kudos
3 More Replies
ChristianRRL
by Valued Contributor III
  • 1589 Views
  • 1 replies
  • 0 kudos

Materialized Views Still In Public Preview?

The title is self-explanatory, but I'm curious if anyone has any inclination as to when Materialized Views will enter General Availability? I'm surprised it's not already in GA considering (A) it's been a year or more since Databricks originally anno...

ChristianRRL_0-1717507701190.png
  • 1589 Views
  • 1 replies
  • 0 kudos
Latest Reply
EugeniaMZ
Databricks Employee
  • 0 kudos

Yes, if the documentation states it, it's still in preview.

  • 0 kudos
kazinahian
by New Contributor III
  • 8014 Views
  • 2 replies
  • 0 kudos

Seeking Tips: Ways to Master Databricks on Azure?

Hello everyone. I'm currently learning Databricks on Azure through a Udemy course. Recently, I was surprised by a charge of $86 from Azure, which has made me cautious about continuing in this manner. Is there a more cost-effective approach to learn D...

  • 8014 Views
  • 2 replies
  • 0 kudos
Latest Reply
LauraMurphy
New Contributor II
  • 0 kudos

Thank you so much for the information.

  • 0 kudos
1 More Replies
samarth10
by New Contributor II
  • 1214 Views
  • 1 replies
  • 0 kudos

Assigning a group as USER to service principal

How can we assigning a group as USER to service principal using databricks-sdk, this is not supported?

  • 1214 Views
  • 1 replies
  • 0 kudos
Latest Reply
samarth10
New Contributor II
  • 0 kudos

I found this API, https://docs.databricks.com/api/account/accountaccesscontrol/updaterulesetbut its PUT and GET method both requires a parameter "etag", how can someone know this "etag"?

  • 0 kudos
ChristianRRL
by Valued Contributor III
  • 2555 Views
  • 3 replies
  • 2 kudos

DLT Compute: "Ephemeral" Job Compute vs. All-purpose compute

Hi there, I would like to understand for DLT jobs if there is any way to get DLT jobs running in an *existing* (and currently running) All-purpose compute rather than spinning up an "ephemeral" (not yet initialized) Job Compute?   

ChristianRRL_0-1717532769488.png
  • 2555 Views
  • 3 replies
  • 2 kudos
Latest Reply
raphaelblg
Databricks Employee
  • 2 kudos

Hi @ChristianRRL , you cannot run a DLT pipeline in an All-purpose compute cluster. DLT Clusters are managed resources. Here are some details on how to configure a DLT cluster: https://docs.databricks.com/en/delta-live-tables/settings.html#configure-...

  • 2 kudos
2 More Replies
Henrik
by New Contributor III
  • 4906 Views
  • 3 replies
  • 0 kudos

List granted access for a group or a user

Is there any way where I can see what access a group or a user have been given to objects (Tables, views, catalogs etc.)?I noticed that we have the following information_schema tables:catalog_privilegesroutine_privilegestable_privilegesschema_privile...

  • 4906 Views
  • 3 replies
  • 0 kudos
Latest Reply
anardinelli
Databricks Employee
  • 0 kudos

Hi @Henrik  To grant a user the privilege to query system tables, a metastore admin or another privileged user must grant USE and SELECT permissions on the system schemas.   GRANT USAGE ON CATALOG system TO <user_name>; GRANT USAGE ON SCHEMA informa...

  • 0 kudos
2 More Replies
Manmohan_Nayak
by New Contributor II
  • 18455 Views
  • 3 replies
  • 3 kudos

org.apache.spark.SparkException: Job aborted due to stage failure:

HiI have around 20 million records in my DF, and want to save it in HORIZINTAL SQL DB.This is error:org.apache.spark.SparkException: Job aborted due to stage failure: A shuffle map stage with indeterminate output was failed and retried. However, Spar...

  • 18455 Views
  • 3 replies
  • 3 kudos
Latest Reply
VZLA
Databricks Employee
  • 3 kudos

If there are any failures which may lead to a stage retry, but retrying the stage translates into potentially having an inconsistent result (indeterminacy) then this exception is raised. The exception is raised in newer version where the validation i...

  • 3 kudos
2 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels