No, it is not possible to turn off redaction. No, there is not another way to return values from a notebook.

1) Using a native Databricks feature such as Autoloader is suggested.

2) They could write the list of files to be processed to a delta table and then use a lookup activity - https://docs.microsoft.com/en-us/azure/data-factory/control-flow-lookup-activity