cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Is there a supported method to register a custom PySpark DataSource so that it becomes visible in th

venkatesh557
Visitor

Built a custom connector using the PySpark DataSource API (DataSource V2). The connector works programmatically, but it does not appear in the Databricks Ingestion UI (Add Data โ†’ Connectors) like the Salesforce connector.

Is there a supported method to register a custom PySpark DataSource so that it becomes visible in the Ingestion UI? If yes, can you provide documentation or steps?

1 REPLY 1

szymon_dybczak
Esteemed Contributor III

Hi @venkatesh557 ,

Unfortunately, the answer is no - there isnโ€™t a supported way for you to โ€œregisterโ€ an arbitrary PySpark DataSource V2 so that it appears as a tile in the Databricks Add data โ†’ Connectors (Ingestion) UI right now