Adobe query support from databricks

vickytscv
New Contributor II

‎12-09-2024 09:25 PM

Hi Team,

     We are working with Adobe tool for campaign metrics. which needs to pull data from AEP using explode option, when we pass query it is taking long time and performance is also very. Is there any better way to pull data from AEP, Please let let me know if there is best way to pull data from adobe tool.

#Adobe #query #ldatabricks

0 Kudos

Alberto_Umana
Databricks Employee
Databricks Employee

‎12-10-2024 09:55 AM

Hi @vickytscv,

How are you integrating Adobe tool with Databricks, via a SQL warehouse? If so, could you please advise what is the statementID of the query with low performance, as well as the settings of the warehouse?

0 Kudos

vickytscv
New Contributor II
In response to Alberto_Umana

‎12-11-2024 03:10 AM

we are using below query for getting data from Adobe, here tis queries run in loop for every segment which is mentioned as parameter. Please help how we can get data in better way   
SELECT
        sm.value.lastQualificationTime,
        sm.value.status,
        sm.key,
        ds.segment,
        ds.segment_name,
        sm.email,
        sm.region
    FROM (
        SELECT
            EXPLODE(value),
            email,
            region
        FROM (
            SELECT  
                EXPLODE(Segmentmembership),
                _lifetech.UnifiedContactProfile.emailAddress AS email,
                _lifetech.UnifiedContactProfile.contactRegion AS region
            FROM
                profile_snapshot_export_dbd09966_53c4_
            WHERE
                _lifetech.UnifiedContactProfile.emailAddress IS NOT NULL
        )
    ) sm
    JOIN adwh_dim_segments ds
    ON sm.key = ds.segment
    WHERE
        sm.key LIKE '%{segmentid}%'
        AND sm.value.lastQualificationTime > '{lastQualificationTime}'
    ) dbtable1
0 Kudos

jodbx
Databricks Employee
Databricks Employee

‎12-11-2024 05:54 AM

https://github.com/Adobe-Marketing-Cloud/aep-cloud-ml-ecosystem 

0 Kudos