cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is there a supported method to register a custom PySpark DataSource so that it becomes visible in th

venkatesh557
New Contributor

Built a custom connector using the PySpark DataSource API (DataSource V2). The connector works programmatically, but it does not appear in the Databricks Ingestion UI (Add Data → Connectors) like the Salesforce connector.

Is there a supported method to register a custom PySpark DataSource so that it becomes visible in the Ingestion UI? If yes, can you provide documentation or steps?

1 REPLY 1

szymon_dybczak
Esteemed Contributor III

Hi @venkatesh557 ,

Unfortunately, the answer is no - there isn’t a supported way for you to “register” an arbitrary PySpark DataSource V2 so that it appears as a tile in the Databricks Add data → Connectors (Ingestion) UI right now