cancel
Showing results for 
Search instead for 
Did you mean: 
ggsmith
New Contributor III
since ‎08-14-2024
4 weeks ago

User Stats

  • 7 Posts
  • 1 Solutions
  • 1 Kudos given
  • 0 Kudos received

User Activity

What is the difference between the create_table and create_streaming_table functions in dlt?For example, this is how I have created a table that streams data from kafka written as json files to a volume.  @Dlt.table( name="raw_orders", table_...
I am using Delta Live Tables and have my pipeline defined using the code below. My understanding is that a checkpoint is automatically set when using Delta Live Tables. I am using the Unity Catalog and Schema settings in the pipeline as the storage d...
I am reading JSON files written to adls from Kafka using dlt and spark.readStream to create a streaming table for my raw ingest data. My schema is two arrays at the top levelNewRecord array, OldRecord array. I pass the schema and I run a select on Ne...
I have around 20 pgp files in a folder in my volume that I need to decrypt. I have a decryption function that accepts a file name and writes the decrypted file to a new folder in the same volume. I had thought I could create a spark dataframe with th...
Kudos given to