When executing a withColumn (running on DBR 14.3 LST) I get this error:Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7feda2b2efb0>> (for post_run_cell):How shoul...
Hi @Henrik_, I recommend checking the callback function and any relevant dependencies to identify the root cause. If you can provide more details or share the relevant code snippet, I’d be happy to assist further!
I am getting an "INTERNAL_ERROR" on a databricks job submitted through the API. Which says:"Run result unavailable: run failed with error message All access to AWS S3 resource has been disabled"However, when I click on the notebook created by the job...
Hi,I'm trying to execute the following code:%sqlSELECT LSOA21CD, ST_X(ST_GeomFromWKB(Geom_Varbinary)) AS STX, ST_Y(ST_GeomFromWKB(Geom_Varbinary)) AS STYFROM ordnance_survey_lsoas_december_2021_population_weighted_centroidsWHERE LSOA21CD ...
Hello @GMB , how are you?
The "st_x" function is part of the spatial expressions supported in Photon-enabled Databricks Runtime 14.2 with the Private Preview enabled.
Here are the steps you can follow:
Ensure that you're using a Photon-enabled Datab...
I'm using DAB to deploy a "jobs" resource into Databeicks and into two environments: "dev" and "prod". I pull the notebooks from a remote git repository using "git_resource", and defined the default job to use a tag to find which version to pull. Ho...
I use target overrides to switch between branch and tags on different environments: resources:
jobs:
my_job:
git_source:
git_url: <REPO-URL>
git_provider: gitHub
targets:
staging:
resources:
jobs:
my_j...
Hi All,I am facing issue while running a new table in bronze layer.Error - AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to alter table.com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: org.a...
When I attach a Git repo to Databricks, it always puts the repo under my username/domain name:How can I create a "team" repo at the top level, so teammates don't have to drill into my username?
Hi,Interest of using a repo is to have a dedicated area for each of developers.If you want to have only a folder with the last version of the code, you should a CI/CD pipeline that will package the code and then delivered into a folder inside Workspa...
Hello.I'm currently trying to migrate a project from dbx to Databricks Asset Bundles. I have successfully created the required profile using U2M authentication with the command```databricks auth login --host <host-name>```I'm able to see the new prof...
I ran into a similar error just now, and in my case, Pycharm was running some iPython startup scripts each time it opened a console. There was, for some reason, a file at `~/.ipython/profile_default/startup/00-databricks-init-a5acf3baa440a896fa364d18...
Hi!So I’ve been wondering since I started with the Data Engineering Learning Plan on the Customer Academy, should I go with my Community Edition Databricks, or I should go with creating a premium edition on either a cloud provider or the website.Than...
Hi Databricks Support,I'm encountering an issue with creating and running jobs on Databricks. Here are the details:Problem Description:When attempting to create and run a job using the old JSON (which was successfully used to create and run jobs usin...
Hi Team I have attended the webinar long back and completed the survey as well still i have not receive any coupon voucher and because of that not able to give exam . Please look into this isue asap and provide me with the voucher .
Hi, @Kaniz . I have the same problem.Guilherme Silva dos Santosguilherme.santos@bridgetechnology.com.brWebinar & feedback on 19 march 2024Generative AI Fundamentals on 14 march 2024
I want to have a service principal run a job that uses a notebook in our github. We are AWS not Azure. How do I configure git credentials for the service principal? Does this use deploy keys?
Hi @digger_fresh_03,
Thank you for sharing your experience from DAIS Summit 2023! We're thrilled to hear that you found the training on the Databricks Lakehouse Platform valuable.
We appreciate your attendance and are excited to announce that the Dat...
Hi @Anette, That's great to hear! It sounds like you had a rewarding experience at the summit. Meeting other professionals and learning about the latest advancements in LLM must have been incredibly valuable.
I wanted to let you know that the Databri...
Hello Everyone,I'm here to learn about technology advancements and how they can help my company. Keynotes were great and learned lot of things through breakout sessions and looking forward to giving back to the community
Hi @shahebaj, We're thrilled to hear about your positive experience at DAIS 2023 and your eagerness to give back to the community!
Your participation and engagement are what make events like DAIS so valuable. We appreciate your support and look forwa...
The talk highlighted the benefits of using an open data lake for unified batch and streaming workloads and showcased features like Autoloader for data discovery, streaming triggers for seamless switching, and streaming aggregation for incremental com...
Hi @Hyperparam42,
Thank you for sharing your experience and insights from the Data + AI Summit 2023!
We're thrilled to hear that you found the talk on multicloud data streaming to be enlightening.
We wanted to let you know that the Databricks Commun...
