topic Re: Databricks and Web app connectivity to build a interactive application in Data Engineering

Databricks and Web app connectivity to build a interactive application

ankris — Wed, 07 Jun 2023 10:50:46 GMT

Hi All,

Could you please guide and provide me some material on "Databricks and Web app connectivity to build a interactive application"

Objective is to build web app so that user can interact for getting different data/visuals from databricks (pyspark programming will run in background).

Greatly appreciate your precious suggestion/Guidance.

Re: Databricks and Web app connectivity to build a interactive application

-werners- — Wed, 07 Jun 2023 12:08:16 GMT

I'd use a SQL endpoint to fetch the data, and in your web app you do the visualisation etc.

Or embed some BI-tool (which is linked to Databricks).

There is such a thing like databricks dashboards, but I do not think you can embed them into a webpage (at least not in the past).

Re: Databricks and Web app connectivity to build a interactive application

ankris — Wed, 07 Jun 2023 12:38:54 GMT

Thanks a lot for prompt reply.

Could you please suggest which BI tool will be able to handle large data with performance.

Re: Databricks and Web app connectivity to build a interactive application

Anonymous — Tue, 13 Jun 2023 15:01:07 GMT

@Werner Stinckens : would you like to provide your POV here? 🙂

Re: Databricks and Web app connectivity to build a interactive application

-werners- — Tue, 13 Jun 2023 15:06:53 GMT

There are several: PowerBi, Tableau, Looker.

Not sure if you can embed them in an app though.

There are also OSS alternatives like Superset, Jaspersoft etc.

But my main take is this:

try to avoid crunching large data interactively. I would try to prepare data as much as possible, then load that into some cache (f.e. powerBI import mode) and use that in your app.

Re: Databricks and Web app connectivity to build a interactive application

Anonymous — Wed, 14 Jun 2023 06:57:17 GMT

Hi @ananthakrishna raikar

We haven't heard from you since the last response from @Werner Stinckens . Kindly share the information with us, and in return, we will provide you with the necessary solution.

Thanks and Regards