- 1593 Views
- 2 replies
- 0 kudos
What's LLM?
What's LLM for generative AI?
- 1593 Views
- 2 replies
- 0 kudos
- 0 kudos
LLMs are large language models like Google Bard or OpenAI or ChatGPT, etc. "It is a type of artificial intelligence (AI) algorithm that uses deep learning techniques and massively large data sets to understand, summarize, generate and predict new con...
- 0 kudos
- 7036 Views
- 6 replies
- 7 kudos
Resolved! Cannot use docker container with runtime 13.1 and above
Hi,In our setup we use custom docker images on our job clusters. The setup of these images is in line with the docker images found on the databricks github page. The custom image works fine on runtimes, including 13.0. When using anything higher that...
- 7036 Views
- 6 replies
- 7 kudos
- 7 kudos
Interestingly enough I can use the exact same docker image on 13.3LTS Beta with no issues.
- 7 kudos
- 1539 Views
- 0 replies
- 0 kudos
The Voucher code provided to me by my organization is not working. Please help ASAP.
Hello,I have been recently given a voucher code by my organization to register for the Databricks Data Engineer Associate (Version 3) exam. However, when I tried to apply the code, the page kept showing "Candidate is not associated with the promotion...
- 1539 Views
- 0 replies
- 0 kudos
- 1530 Views
- 0 replies
- 0 kudos
My exam has suspended , Need help Urgently (21/08/2023)
Hello Team,I encountered Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam.I want to file a complain...
- 1530 Views
- 0 replies
- 0 kudos
- 1871 Views
- 1 replies
- 1 kudos
Compute cluster, SQL warehouse not starting - AWS
Hey,I am using "AWSQuickstartCloudformationLambda" to create a workspace in my trial environment and on the AWS side the stack create succeeded but on the Databricks side compute cluster is not starting. The error says:Aws Authorization Failure:Failu...
- 1871 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi, the error suggests there is some error with the credentials. You can check the credentials chain to see where aws is looking for the credentials. https://blog.leapp.cloud/aws-sdk-unable-to-locate-credentials.You can refer to another article: http...
- 1 kudos
- 1580 Views
- 1 replies
- 0 kudos
WebDriverException: Message: unknown error: Chrome failed to start: exited abnormally.
Hiiiii,I want to scratch a text from the web page with simple code:from selenium import webdriver # Set options to make browsing easier #Function is responsible to create a driver and return that driver. def get_driver(): chrome_options = webdr...
- 1580 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Looks like the issue is with your browser, could you please try to change the browser and confirm?Please tag @Debayan with your next comment, which will get me notified. Thanks!
- 0 kudos
- 3466 Views
- 4 replies
- 0 kudos
webscraping with Firefox driver failing - Python code
Getting below exception while running web scraping script, stuck at installing firefox from snap. Getting apparmor permission issue and tried to reinstall it and still getting the same. please check the error message section. Dependencies:Python li...
- 3466 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi, This is an issue with the dependencies of different packages. Please try as below: apt get update && apt get upgrade; apt install firefox;Please tag @Debayan with your next comment which will notify me.
- 0 kudos
- 12149 Views
- 1 replies
- 0 kudos
Run a job with an Azure service principal
We had a problem in pointing out the Service Principal in the “Run as” option of workflow. Below are the details about the issue we are facing.Issue Details:I had created a Workflow in Azure Databricks workspace to automate the Data movement process....
- 12149 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Could you please confirm if the service principle is already added to the workspace via admin console? https://docs.databricks.com/en/administration-guide/users-groups/service-principals.html#assign-a-service-principal-to-a-workspace-using-the-ac...
- 0 kudos
- 1580 Views
- 1 replies
- 0 kudos
Update metastore bucket
Hello,Our Databricks workspace is currently hosted on AWS account1, while the meta store bucket is configured within a separate AWS account2. We want to transfer this bucket to account1 to eliminate our reliance on account2. How to configure this buc...
- 1580 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, You can use: https://github.com/databrickslabs/migrate/blob/master/METASTORE.md# for the metastore data migration. Please tag @Debayan with your next comment which will get me notified.
- 0 kudos
- 11276 Views
- 8 replies
- 4 kudos
InternalError, error message: The output of the notebook is too large.
Hello guys. I am having the following annoying issue with DataBricks job executed from ADF. I have stopped all the logs, deleted all the print statements and display. And I am still getting this error. I don't understand what might cause it. I am att...
- 11276 Views
- 8 replies
- 4 kudos
- 4 kudos
Apologies for the late reply. I will try to upload the logs,cause it's been some time.Interesting is how I solve it. I put all the code in a single cell and It is running since then without issues. Although it was just few cells with python code. I e...
- 4 kudos
- 10486 Views
- 1 replies
- 1 kudos
S3 Permission errors
Hello Background -I have an S3 datalake set up prior to signing up with Databricks. I'm still in my evaluation period. I'm trying to read the contents of an S3 bucket but am getting all kinds of permission problems. Here is the command in the noteb...
- 10486 Views
- 1 replies
- 1 kudos
- 1 kudos
UPDATE:The permission problems only exist when the Cluster's (compute's) Access mode is "Shared No Isolation". When the Access Mode is either "Shared" or "Single User" then the IAM configuration seems to apply as expected. When set to "Shared No Is...
- 1 kudos
- 2399 Views
- 0 replies
- 0 kudos
move databricks workspace to another resource group
Hello Databricks Community,I have to issue related to Azure databricks workspace:- First: I have one azure databrick workspace in resource group A. But I want to move this to resource group B, but as I know Azure hasn't supported yet. So which is the...
- 2399 Views
- 0 replies
- 0 kudos
- 894 Views
- 0 replies
- 0 kudos
Job REST API CORS error
Hello guys,I want to integrate Databricks Job API to the share point site. But I have a CORS policy error that blocks all of the calls from the share point site. How can I white list my share point site ? Or is there any other way ? Thank you
- 894 Views
- 0 replies
- 0 kudos
- 4814 Views
- 3 replies
- 0 kudos
Cannot %run notebook using relative path
In the root of my workspace, I have the following folder structure set up:/foo / ETL / setup / utilitiesFrom a notebook in /foo/ETL or /foo/setup, if I try to %run a notebook in /foo/utilities by giving the relative path ../utilities/<x>, I get...
- 4814 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello @DManowitz-BAH ,Hope you are doing great, I tried to replicate this behavior on 12.2 LTS runtime and didn't get any errors for the same folder/workspace structure..Can you share the cluster configuration details so I can mimic exactly the same ...
- 0 kudos
- 3069 Views
- 2 replies
- 1 kudos
Apache spark proficient
What is the best way to be proficient in Apache spark?
- 3069 Views
- 2 replies
- 1 kudos
