cancel
Showing results for 
Search instead for 
Did you mean: 
smpa01
Contributor
since ‎08-27-2021
‎01-31-2026

User Stats

  • 17 Posts
  • 2 Solutions
  • 14 Kudos given
  • 2 Kudos received

User Activity

I am running a Databricks job that reads from a Delta table and writes to an ADLS Gen2 location using a SAS token for authentication.from pyspark.sql import SparkSession spark = SparkSession.builder.getOrCreate() sas_token = dbutils.secrets.get(scop...
TLDR - UDFs work fine when imported from `utilities/` folder in DLT pipelines, but custom Python DataSource APIs fail with ModuleNotFoundError: No module named 'utilities'` during serialization. Only inline definitions work. Need reusable DataSource ...
I am getting an error when I am trying to view the underlying files of the managed delta table in unity catalogsuch asfrom pyspark.sql.functions import * table_directory = "workspace.db_bronze.test_01" data = [{"x": 1, "y": 2}] df = spark.createData...
@szymon_dybczak I am experimenting to see if there is a way for me to create an external table from files written into unity catalog volume. I tried the following but it did not work.# COMMAND ---------- # DBTITLE 1, Daily Fetch and Write # sample ...
Thank you very much for the new free edition.I have a question related to dbfs.Am I to understand that dbfs is disabled in this edition and one needs to bring their own storage. I tried this and failed. What do I need to do in order to be able to use...