cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Anonymous
by Not applicable
  • 1053 Views
  • 2 replies
  • 4 kudos

Hello Everyone, I am thrilled to announce that we have our first winner for the raffle contest - @Uma Maheswara Rao Desula​ Please join me in congratu...

Hello Everyone,I am thrilled to announce that we have our first winner for the raffle contest - @Uma Maheswara Rao Desula​ Please join me in congratulating him on this remarkable achievement!UmaMahesh, your dedication and hard work have paid off, and...

Winner1
  • 1053 Views
  • 2 replies
  • 4 kudos
Latest Reply
Sujitha
Community Manager
  • 4 kudos

@Uma Maheswara Rao Desula​  Congratulations on this well deserved win!! Can't wait for you to meet our Community peers at the Data + AI Summit 2023 in SFO.

  • 4 kudos
1 More Replies
Aakash_Bhandari
by New Contributor III
  • 5292 Views
  • 6 replies
  • 2 kudos

Resolved! Accessing a FastAPI endpoint using Personal Access Token (PAT)

Hello Community,I have a FastAPI endpoint on a cluster with addess 0.0.0.0:8084/predict. And I want to send a request to this endpoint from a React App which is locally hosted on my computer. I have a Personal access token for the workspace but dont ...

  • 5292 Views
  • 6 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

@Aakash Bhandari​ :To send a request from a React App to a FastAPI endpoint on a Databricks cluster using a Personal Access Token (PAT), you can use the requests module in Python to make HTTP requests.Here's an example of how to use requests to send ...

  • 2 kudos
5 More Replies
Anonymous
by Not applicable
  • 1150 Views
  • 4 replies
  • 11 kudos

Hi team, Could everyone please help explain about the Charity and Charity Name in "Data + AI Summit 2023: VIP ALL-Access Pass" in the Reward...

Hi team,Could everyone please help explain about the Charity and Charity Name in "Data + AI Summit 2023: VIP ALL-Access Pass" in the Reward Store? I don't know what it means.Thanks and Best Regards,Jensen Nguyen

Image
  • 1150 Views
  • 4 replies
  • 11 kudos
Latest Reply
jose_gonzalez
Moderator
  • 11 kudos

Adding @Kaniz Fatma​ @Suteja Kanuri​ for visibility

  • 11 kudos
3 More Replies
sensanjoy
by Contributor
  • 11315 Views
  • 5 replies
  • 1 kudos

Resolved! Performance issue with pyspark udf function calling rest api

Hi All,I am facing some performance issue with one of pyspark udf function that post data to REST API(uses cosmos db backend to store the data).Please find the details below: # The spark dataframe(df) contains near about 30-40k data. # I am using pyt...

  • 11315 Views
  • 5 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Sanjoy Sen​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback w...

  • 1 kudos
4 More Replies
brendanc19
by New Contributor III
  • 3258 Views
  • 5 replies
  • 2 kudos

Resolved! Does cancelling a job run rollback any actions performed by query plan?

If I were to stop a rather large job run, say half way thru execution, will any actions performed on our Delta tables persist or will they be rolled back?Are there any other risks that I need to be aware of in terms of cancelling a job run half way t...

  • 3258 Views
  • 5 replies
  • 2 kudos
Latest Reply
brendanc19
New Contributor III
  • 2 kudos

Will do, thank you Vartika

  • 2 kudos
4 More Replies
Sujitha
by Community Manager
  • 893 Views
  • 1 replies
  • 3 kudos

Data + AI Summit Virtual - Register Now!  This year’s free virtual experience will include access to live-streamed keynotes, select sessions designed ...

Data + AI Summit Virtual - Register Now! This year’s free virtual experience will include access to live-streamed keynotes, select sessions designed and led by data experts, as well as unlimited access to on-demand sessions soon after the live event....

  • 893 Views
  • 1 replies
  • 3 kudos
Latest Reply
jose_gonzalez
Moderator
  • 3 kudos

Thank you for sharing @Sujitha Ramamoorthy​ !!

  • 3 kudos
andrcami1990
by New Contributor II
  • 5328 Views
  • 2 replies
  • 2 kudos

Resolved! Connect GraphQL to Data Bricks

Hi I am new to Databricks however I need to expose data found in the delta lake directly to GraphQL to be queried by several applications. Is there a connector or something similar to GraphQL that works with Databricks?

  • 5328 Views
  • 2 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Andrew Camilleri​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feed...

  • 2 kudos
1 More Replies
lasmali
by New Contributor II
  • 1870 Views
  • 3 replies
  • 0 kudos

Instance Profile creation via the Databricks REST API returns "INVALID_PARAMETER_VALUE"

# Problem StatementWe have a need to create Instance Profiles via the Databricks REST API, but the endpoint returns an "INVALID_PARAMETER_VALUE" error with "Syntactically invalid AWS instance profile ARN" message even when provided an appropriate ARN...

  • 1870 Views
  • 3 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @lasse Lidegaard​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...

  • 0 kudos
2 More Replies
bhawik21
by New Contributor II
  • 2290 Views
  • 4 replies
  • 0 kudos

Resolved! How do I invoke a data enrichment function before model.predict while serving the model

I have used mlflow and got my model served through REST API. It work fine when all model features are provided. But my use case is that only a single feature (the primary key) will be provided by the consumer application, and my code has to lookup th...

  • 2290 Views
  • 4 replies
  • 0 kudos
Latest Reply
LuisL
New Contributor II
  • 0 kudos

You can create a custom endpoint for your REST API that handles the data massaging before calling themodel.predict function. This endpoint can take in the primary key as an input, retrieve the additional features from the database based on that key, ...

  • 0 kudos
3 More Replies
lenonlmsv
by New Contributor II
  • 1636 Views
  • 3 replies
  • 0 kudos

Query API Result

Hi, I'm new here.Currently I have to read information from a query in databricks. I've used the query API to get the query definition but so far I'm not able to run the query and get the results.Is it possible? Thanks

  • 1636 Views
  • 3 replies
  • 0 kudos
Latest Reply
daniel_sahal
Esteemed Contributor
  • 0 kudos

When using the JobsAPI you need to specify dbutils.notebook.exit("returnValue") to pass the results once the notebook finished it's job (https://docs.databricks.com/notebooks/notebook-workflows.html#notebook-workflows-exit).Then you can get notebook_...

  • 0 kudos
2 More Replies
URJ24
by New Contributor II
  • 1163 Views
  • 3 replies
  • 1 kudos

I have attended Data + AI World Tour Asia Pacific this week but did not received post confirmation email.

I have attended Data + AI World Tour Asia Pacific this week but did not received post confirmation email. After webinar I received short survey and then thank you note for participation. But unexpectedly did not received any email with feedback link ...

  • 1163 Views
  • 3 replies
  • 1 kudos
Latest Reply
URJ24
New Contributor II
  • 1 kudos

Emailing apacevents@databricks.com helped.

  • 1 kudos
2 More Replies
Muni
by New Contributor II
  • 5471 Views
  • 5 replies
  • 0 kudos

Resolved! Can we expose REST API using Databricks python notebook?

We are trying to expose a REST API endpoint using python notebook. Does databricks allow this?

  • 5471 Views
  • 5 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Muniyappan Mani​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...

  • 0 kudos
4 More Replies
Sandy21
by New Contributor III
  • 1010 Views
  • 2 replies
  • 3 kudos

Queries with running REST API command in databricks to create a Job

What happens when jobs/create REST API command is run multiple times(say 3 times) with the same JSON configuration? Will 3 jobs are created with the same name or only 1 job will be created?

  • 1010 Views
  • 2 replies
  • 3 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 3 kudos

Hi @Santhosh Raj​ , We haven’t heard from you since the last response from @Debayan Mukherjee​ â€‹ ​, and I was checking back to see if his suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be help...

  • 3 kudos
1 More Replies
User16752245636
by New Contributor II
  • 574 Views
  • 0 replies
  • 1 kudos

Sergio Copy Data World tour Orchestration_v02.pptx (4)

Databricks Workflows: Reliable orchestration for data, analytics, and AIHello, I am a Solutions Architect at Databricks; and I recently presented at the Data and AI World Tour in London Databricks Workflows. You can see some of the presented slides a...

  • 574 Views
  • 0 replies
  • 1 kudos
Labels