Over the past week we have seen a warning showing in our notebooks about the dollar param being deprecated. Which has apparently been deprecated since runtime 7, but I cannot find any info about when it will actually be removed. Will the removal be tied to a runtime release?. We are on 13.3 and are in the process of moving to 15.4.
I have also been trying to investigate further and I have found some information the says that as long as the value that we want to use where we currently have $param syntax is set using a text widget or by a python variable then this is still fine and is not impacted by what is being deprecated. I have attached this as two screenshots in this post.that show some of what I found.
Assuming that we are ok to carry on as well perhaps the code linter is just flagging this as it does not check to see how the value is set that is being $param.
For our notebooks where use $param in table create statements or in select queries for example they all have the value set via text widget so I think we are ok. But I am making this post to try and seek clarification on this in case we need to take action.
Below is an example from one of my notebooks, all bold parameter names have the value set using a text widget:
Any help on clarifying the situation would be much appreciated.
-- Example of a select query
Cell 1:
%python
dbutils.widgets.text("target_catalog_name", "dev", "Enter Catalog Name")
Cell 2:
select * from dtp_${target_catalog_name}.cleansed.testme_source_latest
where date = '2024-08-01' and date <'2024-08-11'
order by site,date,source
-- Example of one of the Create statements
Cell 1:
%python
dbutils.widgets.text('environment_name', 'dev')
dbutils.widgets.text('optional_sandbox_path', '')
dbutils.widgets.text('catalog_name', ''
environment_name = dbutils.widgets.get('environment_name')
optional_sandbox_path = dbutils.widgets.get('optional_sandbox_path')
catalog_name = dbutils.widgets.get('catalog_name')
Cell 2:
CREATE EXTERNAL TABLE IF NOT EXISTS dtp_${catalog_name}.cleansed.plausible_visit_channel_historical
using DELTA
LOCATION 'abfss://lake@testadls${environment_name}001.dfs.core.windows.net${optional_sandbox_path}/Cleansed/DataProvider=TestMe/DataFeed=visit_time/Version=1/'
