topic Matillion ETL using serverless in Data Engineering

Matillion ETL using serverless

ShankarM — Wed, 04 Dec 2024 16:49:27 GMT

Can we attach serverless compute to Matillion ETL transformation jobs while running on Databricks workspace? I am aware that we can attach a job compute cluster but not sure whether we can attach serverless compute?

Re: Matillion ETL using serverless

Alberto_Umana — Wed, 04 Dec 2024 17:24:18 GMT

Hi @ShankarM,

I did not find any internal documentation that indicates Matillion ETL supports serverless yet. I will ask internally and get back.

Have you tried running the job using serverless already?

Re: Matillion ETL using serverless

ShankarM — Thu, 05 Dec 2024 05:24:47 GMT

Hi,

No. i have not tried using it but customer is keen to use the serverless option to run Matillion jobs on Databricks and take the advantages of serverless compute. Can you please check and get back on this.

Re: Matillion ETL using serverless

ShankarM — Thu, 12 Dec 2024 09:48:52 GMT

Awaiting reply on this!