cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

st_point is disabled or unsupported.

fundat
New Contributor III

On my DLT pipeline,

  • I Installed the Databricks-mosaic library
  • Photon is activated
  • I'm using a workspace premium tier
SELECT
    id,
    city_name,
    st_point(latitude, longitude) AS city_point
  FROM city_data
  ;

st_point is disabled or unsupported. Consider enabling Photon or switch to a tier that supports ST expressions.

I understand well, to use GIS functions  on ETL Pipeline we must have the Enterprise tier ?

2 REPLIES 2

emma_s
Databricks Employee
Databricks Employee

DLT pipelines are still on runtime 16.4 which doesn't have support for st_point yet. See details here https://learn.microsoft.com/en-us/azure/databricks/release-notes/dlt/

You should be able to use st_point in normal SQL editor as long as the cluster you are using is DBR 17.1 or above, it is not currently supported on classic SQL warehouses either as it is still in public preview. https://docs.databricks.com/aws/en/sql/language-manual/functions/st_point

To check the version of runtime your pipeline is running on you can use the following code:

SELECT details:create_update:runtime_version:dbr_version FROM event_log_raw WHERE event_type = 'create_update

 

fundat
New Contributor III

Thank you for your answer @emma_s. So it can be difficult to set up a GIS dlt pipeline in Databricks ?

I can create multiple notebooks in which I used this GIS functions, according to my project, and create job in which I will associate each notebook with a task. So that to apply the GIS functions. Is that right ? But I will lose the incremental advantage.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now