- 972 Views
- 1 replies
- 0 kudos
DIAS 2023 -- recommend the training!
Did the SparkUI training yesterday with Mark Ott, and I highly recommend it. It was super helpful and provided a lot of clarity around some of the vaguer terms and metrics, and some surprise penalties.In-memory partition size is the the main thing to...
- 972 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, I can't find this course... can you please share the full name of this course? Thanks in advance
- 0 kudos
- 91 Views
- 1 replies
- 0 kudos
Dashboard sharing in Databriks with Unity Catalog enabled
Hello,I am planning to deploy a workspace with Unity Catalog enabled. Deploying permissions in one place sounds like a good solution. It can even simplify dataset architecture by masking rows and columns.As an architect, I’m concerned about the user’...
- 91 Views
- 1 replies
- 0 kudos
- 0 kudos
When you mention disable the sharing options do you refer for users inside the workspace or is it specific to users that belongs to the account level but not to the workspace itself?
- 0 kudos
- 157 Views
- 5 replies
- 0 kudos
Migrating Service Principals from Non-Unity to Unity-Enabled Databricks Workspaces - Entitlements Mi
Hello Databricks Community,I am currently in the process of migrating Service Principals from a non-Unity workspace to a Unity-enabled workspace in Databricks. While the Service Principals themselves seem to be migrating correctly, I am facing an is...
- 157 Views
- 5 replies
- 0 kudos
- 0 kudos
HI @Walter_C ,Thanks for the suggestion. I've already tried using print statements to debug the entitlements being received, but unfortunately, it still doesn't seem to work correctly. The issue persists, where the Allow cluster creation entitlement ...
- 0 kudos
- 4026 Views
- 2 replies
- 0 kudos
PPT material or document from Databricks Learning
Hello Databricks Community,I am a beginner with Databricks. I am wondering if we can download power point slides or learning documents from the Databricks Learning Platform. I like to read after taking the online course. Could you let me know? Curren...
- 4026 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello Databricks Community,I am a beginner with Databricks. I am wondering if we can download power point slides or learning documents from the Databricks Learning Platform. I like to read after taking the online course. Could you let me know? Curren...
- 0 kudos
- 79 Views
- 1 replies
- 0 kudos
Databricks, Cloud Services Pricing
i am unable to find reason of not getting Databricks, Cloud Services Pricing why?
- 79 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you please provide some more context on the issue you are facing to be able to properly assist you?
- 0 kudos
- 131 Views
- 3 replies
- 1 kudos
Delta sharing vs CosmosDB
Hi All,We have a situation where we write data to CosmosDB and create JSON data for a transaction table, which includes a mini statement in JSON format.Now, we want to introduce the concept of delta sharing and share the transaction table. The Java ...
- 131 Views
- 3 replies
- 1 kudos
- 1 kudos
Thanks for your reply,Right now, the team is transferring data from Databricks to Cosmos DB, and then they're using REST APIs to access that data. They handle about 100 requests per minute, with some tables needing around 100 requests per second due...
- 1 kudos
- 478 Views
- 1 replies
- 0 kudos
Databricks and Cloud Services Pricing
Hi,If I connect databricks (trial version) with AWS/Azure/Google Cloud and then work on dashboards and Genie - will there be any minimal charges, or its completely free to use the cloud services?
- 478 Views
- 1 replies
- 0 kudos
- 0 kudos
Anyway, you will pay for cloud provider products - VM, IPs. etc,
- 0 kudos
- 163 Views
- 2 replies
- 0 kudos
Resolved! Datagrip connection error
I am trying to connect with Datagrip provided driver. I am not getting this to work with token from datagrips. The connection url is: jdbc:databricks://dbc-******.cloud.databricks.com:443/***_analytics;httpPath=/sql/1.0/warehouses/ba***3 I am gettin...
- 163 Views
- 2 replies
- 0 kudos
- 0 kudos
hi @Alberto_Umana thanks. I created the token in databricks under User Settings > Access Tokens indeed. Not sure how to ensure is valid and has the necessary permissions to access the Databricks SQL warehouse. I generated it recently though.
- 0 kudos
- 6534 Views
- 2 replies
- 0 kudos
SAP Successfator
Hi Team,We are working on a new Data Product onboarding to the current Databricks Lakehouse Platform.The first step is foundation where we should get data from SAP success factors to S3+ Bronze layer and then do the initial setup of Lakehouse+Power B...
- 6534 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi everyone! Great article, by the way. What's your favorite strategy for winning in online games?
- 0 kudos
- 2263 Views
- 2 replies
- 1 kudos
Chrome/Edge high memory usage for Databricks tabs.
Is it normal for Databricks tabs to be using such high memory?The Chrome example I just got a screenshot of was this (rounded up/down)...3 x Databricks tabs for one user, sized at6gb, 4.5gb, and 2gbTotal = 12.5gbI know it gets higher than this too, I...
- 2263 Views
- 2 replies
- 1 kudos
- 1 kudos
Having the issue for a while now. Open Databricks notebook tabs routinely take up 3GB of memory each.
- 1 kudos
- 8801 Views
- 4 replies
- 0 kudos
Resolved! SAP HANA Smart Data Access to Databricks SQL Warehouse
HiI'm currently looking into connecting to the SQL Warehouse through SDA/SDI. Does anyone have any experience doing so and can share some takeaways on how to implement it. We want to expose the Databricks tables to SAP. We're already doing this by us...
- 8801 Views
- 4 replies
- 0 kudos
- 0 kudos
Hey,If you're exploring how to connect your SQL Warehouse to SAP or want to streamline the process of transferring data from SAP HANA into Databricks, our SAP HANA to Databricks Connector could be a valuable tool. This connector allows you to directl...
- 0 kudos
- 106 Views
- 1 replies
- 0 kudos
Converting Managed Hive Metastore Table to External Table with Mount Point Location
We have a managed Hive Metastore (HMS) table, and we would like to convert it into an external table and the location of that external hms table as mount points.
- 106 Views
- 1 replies
- 0 kudos
- 0 kudos
You could create the table as external table by using CREATE TABLE student_copy AS SELECT * FROM student; to pull the data from the managed table.
- 0 kudos
- 381 Views
- 3 replies
- 0 kudos
Databricks Lake House Data Clean Room Utilization
Hello.Is it possible to do masking on column data, etc. for the data provided by the cleanroom creatorI am wondering because I don't think Delta shaling allows masking of column data.
- 381 Views
- 3 replies
- 0 kudos
- 0 kudos
Yes, you are correct. Databricks cleanrooms are built on Delta Sharing, which is foundational to how data is securely shared in Databricks. Since Delta Sharing itself does not natively support column-level masking or row-level security, these feature...
- 0 kudos
- 253 Views
- 1 replies
- 0 kudos
About "Jobs Light Compute" Listed in the Azure Databricks Pricing Table
Hello,While reviewing the Azure Databricks pricing page to check the cost for Job Compute, I came across a term I hadn’t seen before: "Jobs Light Compute."I suspect this refers to the now end-of-support Databricks Runtime known as Databricks Light:Da...
- 253 Views
- 1 replies
- 0 kudos
- 0 kudos
"Light" is deprecated, and you can't create a new compute with that type. Usually when deprecated products show up on pricing pages, someone is paying for extended support to Microsoft, but sometimes it means they didn't edit that page. You can alw...
- 0 kudos
- 161 Views
- 0 replies
- 0 kudos
Problem when use synapse ml lightgbm with feature store
I'm running a model using LGBM with Spark, within Pipeline, but when I log it to MlFlow using the log_model feature store function, I can't replicate the pipeline in prediction. When I execute:predict = fs.score_batch(logged_model, df_pred) display(...
- 161 Views
- 0 replies
- 0 kudos
