Hey everyone, im using autoloader x soda.I'm new to both,The idea is to ingest with quality checks in my silver table for every batch in a continuous ingestion.I tried to configure soda as str just like the docs show, but its seems that it keeps on t...
Hey guys,I've been looking for some docs on how autoloader manages the source outage, I am currently running the following code: dfBronze = (spark.readStream
.format("cloudFiles")
.option("cloudFiles.format", "json")
.schema(json_schema_b...
Hi everyone,I am currently trying to enforce the following schema: StructType([
StructField("site", StringType(), True),
StructField("meter", StringType(), True),
StructField("device_time", StringType(), True),
StructField("data", St...
