cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Adobe query support from databricks

vickytscv
New Contributor

Hi Team,

     We are working with Adobe tool for campaign metrics. which needs to pull data from AEP using explode option, when we pass query it is taking long time and performance is also very. Is there any better way to pull data from AEP, Please let let me know if there is best way to pull data from adobe tool.

#Adobe #query #ldatabricks

3 REPLIES 3

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @vickytscv,

How are you integrating Adobe tool with Databricks, via a SQL warehouse? If so, could you please advise what is the statementID of the query with low performance, as well as the settings of the warehouse?

we are using below query for getting data from Adobe, here tis queries run in loop for every segment which is mentioned as parameter. Please help how we can get data in better way   
SELECT
        sm.value.lastQualificationTime,
        sm.value.status,
        sm.key,
        ds.segment,
        ds.segment_name,
        sm.email,
        sm.region
    FROM (
        SELECT
            EXPLODE(value),
            email,
            region
        FROM (
            SELECT  
                EXPLODE(Segmentmembership),
                _lifetech.UnifiedContactProfile.emailAddress AS email,
                _lifetech.UnifiedContactProfile.contactRegion AS region
            FROM
                profile_snapshot_export_dbd09966_53c4_
            WHERE
                _lifetech.UnifiedContactProfile.emailAddress IS NOT NULL
        )
    ) sm
    JOIN adwh_dim_segments ds
    ON sm.key = ds.segment
    WHERE
        sm.key LIKE '%{segmentid}%'
        AND sm.value.lastQualificationTime > '{lastQualificationTime}'
    ) dbtable1

jodbx
Databricks Employee
Databricks Employee

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group