- 1033 Views
- 2 replies
- 0 kudos
Restrict access of user/entity to hitting only specific Databricks Rest APIs
Hi community,Assume I generate a personal access token for an entity. Post generation, can I restrict the access of the entity to specific REST APIs? In other words, consider this example where once I use generate the token and setup a bearer token b...
- 1033 Views
- 2 replies
- 0 kudos
- 0 kudos
@Surajv You have to rely on access control settings on resources and entities (users or service principals or create some cluster policies), rather than directly restricting the API endpoints at the token level.Note: API access based on fine-grained ...
- 0 kudos
- 2865 Views
- 17 replies
- 3 kudos
Mounting Data IOException
Hello,I am currently taking a course from Coursera for data science using SQL. For one of our assignments we need to mount some data by running a script that has been provided to us by the class. When I run the script I receive the following error. I...
- 2865 Views
- 17 replies
- 3 kudos
- 3 kudos
Thanks for the responses EricMa and Tawfeeq. I was able to load both tables in and was able to complete Module 1 exercises.
- 3 kudos
- 88 Views
- 0 replies
- 0 kudos
Sharing Opportunities with Databricks
Hi everyone,I would like to talk to someone that could set up a process of deals sharing with Databricks following the GDPR.Thanks,Carol.
- 88 Views
- 0 replies
- 0 kudos
- 189 Views
- 3 replies
- 2 kudos
Resolved! Differences among python libraries
I am confused as to the differences between various python libraries for databricks: especially with regard to differences among [databricks-connect](https://pypi.org/project/databricks-connect/), [databricks-api](https://pypi.org/project/databricks-...
- 189 Views
- 3 replies
- 2 kudos
- 2 kudos
@szymon_dybczak,Thank you for typing all that up. It is very clear and helpful.Two follow ups if I may:1. If one's primary goal is to execute SQL queries why prefer databricks sql connector over a generic jdbc or odbc package?2. Did I miss any other ...
- 2 kudos
- 4645 Views
- 3 replies
- 0 kudos
How list all USERs FROM a especific GROUP USING SQL?
I want to list, using sql editor, all users name from a specific group.Reading documentation, I only learned how to show the groups or the users, using simples filters, like:SHOW GROUPS LIKE '*XPTO*';SHOW GROUPS WITH USER `test@gmail.com`SHOW USERS L...
- 4645 Views
- 3 replies
- 0 kudos
- 0 kudos
I don't think it's possible yet. Unfortunately, I look in all system tables and command and didn't found this kind of things.But with a Python notebook, like what did the AI, you can reconstruct it:first you list all the users withSHOW USERSthen you ...
- 0 kudos
- 178 Views
- 2 replies
- 0 kudos
Resolved! Databricks Certified Associate Developer for Apache Spark 3 Got Suspended. Require Immediate support
Hello @Cert-Team @Certificate Team,Request Id# 00544837I encountered a pathetic experience while attempting my Databricks Certified Associate Developer for Apache Spark 3 certification exam. I had answered more than 44 questions I applied for Data...
- 178 Views
- 2 replies
- 0 kudos
- 715 Views
- 6 replies
- 0 kudos
Resolved! Unable to start browser for databricks certification
Hello, I have registered for databricks certified data engineering associate exam. One of the requirements to give the exam is The exam is set for Sunday 6th October, 2024 but the browser installation (psi secure bridge browser) does not work. .Reac...
- 715 Views
- 6 replies
- 0 kudos
- 0 kudos
Hey folks,The exam setup worked successfully. For future reference, on successful installation two browsers will be installed:1. PSI Secure Browser2. Lockdown BrowserAs long as lock down browser is available and when prompted says it will open only w...
- 0 kudos
- 995 Views
- 2 replies
- 1 kudos
Private Python Package in Serverless Job
I am trying to create a Databricks Job using Serverless Compute. I am using wheel file to run the Python Job.The wheel file has setup.py file using which all dependencies are installed. One of the package dependency is a private package hosted on Git...
- 995 Views
- 2 replies
- 1 kudos
- 1 kudos
I am trying to create a Databricks Job using Serverless Compute. I am using wheel file to run the Python Job.The wheel file has setup.py file using which all dependencies are installed. One of the package dependency is a private package hosted on Git...
- 1 kudos
- 174 Views
- 1 replies
- 0 kudos
Unable to clone delta live table
Hello Team,In order to avoid any cost of running workflow for historical data, i am trying DEEP clone in order to copy data of streaming table from PROD workspace to QA workspace but it is giving below error. Please suggest some efficient data copy m...
- 174 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Anish_2 ,This is well known limitation of DLT. You can read about it at limitation section in documentation. Conclusion is following. If you want to have ability to use all feature of delta protocol, it's better not to use dlt framework. It's gre...
- 0 kudos
- 2930 Views
- 2 replies
- 0 kudos
File size upload limit through CLI
Does anyone know the size limit for uploading files through the CLI? I'm not finding it in the documentation.
- 2930 Views
- 2 replies
- 0 kudos
- 0 kudos
Does anyone know the size limit for uploading files through the CLI? I'm not finding it in the documentation.
- 0 kudos
- 479 Views
- 2 replies
- 0 kudos
CLI is not helpful in exporting Error: expected to have the absolute path of the object or directory
I try to export a job as a DBA in order to create an Asset Bundle according to thishttps://community.databricks.com/t5/data-engineering/databricks-asset-bundle-dab-from-existing-workspace/td-p/49309I am on Windows 10 Pro x64 withDatabricks CLI v0.223...
- 479 Views
- 2 replies
- 0 kudos
- 0 kudos
To export an existing folder under /Workspace/... export-dir command could be used : databricks workspace export-dir /Workspace/Applications/ucx/logs/migrate-tables/run-123-0/ /Users/artem.sheiko/logs
- 0 kudos
- 170 Views
- 1 replies
- 0 kudos
Best practices for optimizing Spark jobs
What are some best practices for optimizing Spark jobs in Databricks, especially when dealing large datasets? Any tips or resources would be greatly appreciated! I’m trying to analyze data on restaurant menu prices so that insights would be especiall...
- 170 Views
- 1 replies
- 0 kudos
- 0 kudos
There are so many.Here are a few:- look for data skew- shuffle as less as possible- avoid many small files- use spark and not only pure python- if using an autoscale cluster: check if you don't lose a lot of time scaling up/down
- 0 kudos
- 285 Views
- 1 replies
- 0 kudos
Databricks serverless Vs snowflake
Hi All,We want to switch from Snowflake to Databricks SQL Warehouse/serverless to simplify our data layers and reduce data copies before the reporting layer. Please share the benefits of using serverless over Snowflake and any limitations you see. We...
- 285 Views
- 1 replies
- 0 kudos
- 0 kudos
one big pro is that you do not need to copy data to the dwh. also your transformations and analytics queries reside on the same platform (databricks).If databricks can cover all the requirementsm compared to snowflakem is hard to tell. Probably ther...
- 0 kudos
- 6260 Views
- 6 replies
- 3 kudos
403 FORBIDDEN You don't have permission to access this page 2023-07-02 08:03:23 | Error 403 | https:
I am getting above message when trying to access the quiz for Generative AI Fundamentals.
- 6260 Views
- 6 replies
- 3 kudos
- 3 kudos
I am getting above message when trying to access the quiz for Lakehouse Fundamentals.
- 3 kudos
- 192 Views
- 0 replies
- 0 kudos
Azure Databricks to GCP Databricks Migration
Hi Team, Can you provide your thoughts on moving Databricks from Azure to GCP? What services are required for the migration, and are there any limitations on GCP compared to Azure? Also, are there any tools that can assist with the migration? Please ...
- 192 Views
- 0 replies
- 0 kudos
