https://community.databricks.com/t5/data-engineering/pysparkruntimeerror-context-only-valid-on-driver/m-p/111342#M43852 <P>I've troubleshot this like 20+ times. I am aware that the current code is causing the spark session to be passed to the workers, where it should only be applied to the driver. Can someone please help me resolve this (the schema is defined earlier)?</P><P>---------------------------------------------------------------------</P><DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;SparkSession, DataFrame, Row</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;functions&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;F</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;azure.storage.blob&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;ContainerClient</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.types&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;delta.tables&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;DeltaTable</SPAN></DIV><DIV><SPAN>import</SPAN><SPAN>&nbsp;os</SPAN></DIV><BR /><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.types&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; StructType, StructField, StringType, IntegerType, TimestampType, ArrayType, DoubleType, BooleanType, FloatType, LongType</SPAN></DIV><DIV><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define schemas</SPAN></DIV><DIV><SPAN>schemas&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoices</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateInvoiced</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceClass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Amount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Tax</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Source</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceBalance</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItems</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LineDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Room</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CategoryID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Details</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ItemDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitQuantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitOfMeasure</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Quantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Adjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Overhead</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Profit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExtendedAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UpdatedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TimeModified</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdditionalInfoAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Mode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Amount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Source</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DiscountAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostings</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborHours</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostTypeCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Quantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UOM</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extended</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Billable</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TxnType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TimeModified</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TransferFrom</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PO</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Item</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Service</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTxnId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CalculatedBurden</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AmountPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CheckNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsForcedSync</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MD5HashAsHexString</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdjustedInvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BalanceOwing</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ChangeOrderAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectedSubtotal</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ConsumablesCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitAmountAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitPercentageAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitAmountFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitPercentageFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUninvoicedAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUnpaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialEstimate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalInvoiced</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialsCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OriginalEstimate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProfessionalFee</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RecognizedRevenue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SubtradeCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SupplementEstimate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalCollected</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalEstimates</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalJobCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalWorkOrderBudget</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WarrantyCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateDepreciation</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Addresses</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Main Phone</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Other Phones</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Nullable struct</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Anniversary</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assistant</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTitle</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompany</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationScores.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CloseRatio</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Score</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderScores.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Score</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DashCompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalEnterpriseID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferenceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TypeOfLoss</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderLossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClientName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfLoss</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateReceived</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CatReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyLimits</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DwellingAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContentsAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherStructuresAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClientID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Caller</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimEnteredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PreferredProviderName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PreferredProviderLocationName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsProviderCreatedClaim</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReportedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CodeRedID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimCustomer</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimCustomerType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CustomerName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyHolderType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Division</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderReasonForClosing</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminJob</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsClosed</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsOnHold</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnvironmentalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReceivedByFullName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Priority</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SpecialInstructions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialFindings</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RoomsAffected</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssociatedJobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderCatastropheName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderDivisionType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnvironmentalCodeDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCompletionPercentage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MasterBuilderNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeDatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RegionalAreaManager</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WaterJobCat</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WaterJobClass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobSource</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminJobNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminDivision</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminReasonForClosing</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Program</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProgramID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProgramName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NationalAccountDirector</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReasonForClosingCategoryName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsEmergencyServiceRequired</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LicenseNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminInsuranceCarrier</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminInsuranceCarrierID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminJobStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobLeadID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Services</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyClaimInformation</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePolicyStart</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePolicyExpiration</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>YearBuilt</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalFileNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SecondaryLossType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReportedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredByFullName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceOfLoss</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobSize</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderLossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentServices</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DeductibleAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectWhen</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLienRights</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLienLiened</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLienReleased</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MbJobNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossContactInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactPerson</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Customer</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobPolicyHolderType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceIndividual</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceCompany</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceEmployee</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceMarketingCampaign</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CampaignName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([ &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>EmployeeDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EmployeeInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EmployeeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>InternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participants</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobExternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingRank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingRank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDates.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateTypeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Value</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AuditDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WhenEntered</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LinkedAssignmentDetails.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedExternalAssignments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalSystemType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>NotesSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAddedTime</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SurveySummary.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MostRecentSurveyDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsIncludedForSurvey</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsSendTriggerCompleted</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreValue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreLabel</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NoSurveyReason</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>EmployeeContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EmployeeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Phones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UFOC</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalEnterpriseLocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainFax</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddresses</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressValue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryContact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Phone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BusinessDevelopmentManagerName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchisorID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnterpriseID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderSuspensions.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SuspensionID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StartDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LiftDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsValid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Level</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Reason</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LiftMethod</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SuspensionType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Visibility</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AffectedDivisions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>])</SPAN></DIV><DIV><SPAN>}</SPAN></DIV></DIV><P>--------------------------------------------------------------</P><DIV><DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;SparkSession</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.functions&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.types&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;azure.storage.blob&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;ContainerClient</SPAN></DIV><DIV><SPAN>import</SPAN><SPAN>&nbsp;os</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Function to create or get Spark session with optimized configurations</SPAN></DIV><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>create_spark_session</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;SparkSession.builder \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>appName</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Highly Optimized JSON Pipeline</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.catalogImplementation</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>hive</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.adaptive.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.adaptive.coalescePartitions.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.files.maxPartitionBytes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>128</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN><SPAN>&nbsp;</SPAN><SPAN>1024</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN><SPAN>&nbsp;</SPAN><SPAN>1024</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.files.minPartitionNum</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>256</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.dynamicAllocation.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.dynamicAllocation.minExecutors</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>4</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.dynamicAllocation.maxExecutors</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>16</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.executor.cores</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>32</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.executor.memory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>200g</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.driver.memory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>64g</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.driver.cores</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>8</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.parquet.compression.codec</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>zstd</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.memory.fraction</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>0.9</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.memory.storageFraction</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>0.3</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.shuffle.partitions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>256</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.adaptive.skewJoin.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.serializer</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>org.apache.spark.serializer.KryoSerializer</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>fs.azure.account.key.amrdatalake01.blob.core.windows.net</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>e3dTBwzl+nu4xTxqsBj+WgWOy5fa2ve7SICaBjVOmrLOw5fYshIZk+FSoz8IoM87GttRSYyL5yJM+AStFYUMGw==</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>getOrCreate</SPAN><SPAN>()</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Initialize Spark session globally (only on driver)</SPAN></DIV><DIV><SPAN>spark&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>create_spark_session</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>sc&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.sparkContext</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define Storage Account Details</SPAN></DIV><DIV><SPAN>storage_account_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>secret##</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>container_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>secret##</SPAN><SPAN>"</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define base paths using abfss directly</SPAN></DIV><DIV><SPAN>output_base_path&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>f</SPAN><SPAN>"abfss://</SPAN><SPAN>{</SPAN><SPAN>container_name</SPAN><SPAN>}</SPAN><SPAN>@</SPAN><SPAN>{</SPAN><SPAN>storage_account_name</SPAN><SPAN>}</SPAN><SPAN>.dfs.core.windows.net/dash.test/output"</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>list_json_files</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"""</SPAN><SPAN>List JSON files from Azure Blob Storage with robust authentication handling.</SPAN><SPAN>"""</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>try</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; container_client&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ContainerClient</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; account_url</SPAN><SPAN>=</SPAN><SPAN>f</SPAN><SPAN>"https://</SPAN><SPAN>{</SPAN><SPAN>storage_account_name</SPAN><SPAN>}</SPAN><SPAN>.blob.core.windows.net"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; container_name</SPAN><SPAN>=</SPAN><SPAN>container_name,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; credential</SPAN><SPAN>=</SPAN><SPAN>"</SPAN><SPAN>secret##</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; container_client.</SPAN><SPAN>get_container_properties</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Successfully authenticated with container&nbsp;</SPAN><SPAN>{</SPAN><SPAN>container_name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; all_blobs&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>list</SPAN><SPAN>(container_client.</SPAN><SPAN>list_blobs</SPAN><SPAN>())</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Total blobs found in container:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>len</SPAN><SPAN>(all_blobs)</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Sample blob names:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>'</SPAN><SPAN>,&nbsp;</SPAN><SPAN>'</SPAN><SPAN>.</SPAN><SPAN>join</SPAN><SPAN>(blob.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;blob&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;all_blobs[:</SPAN><SPAN>5</SPAN><SPAN>])&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;all_blobs&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;</SPAN><SPAN>'</SPAN><SPAN>None</SPAN><SPAN>'</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; json_files&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[</SPAN><SPAN>f</SPAN><SPAN>"abfss://</SPAN><SPAN>{</SPAN><SPAN>container_name</SPAN><SPAN>}</SPAN><SPAN>@</SPAN><SPAN>{</SPAN><SPAN>storage_account_name</SPAN><SPAN>}</SPAN><SPAN>.dfs.core.windows.net/</SPAN><SPAN>{</SPAN><SPAN>blob.name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;blob&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;all_blobs&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;blob.name.</SPAN><SPAN>endswith</SPAN><SPAN>(</SPAN><SPAN>'</SPAN><SPAN>.JSON</SPAN><SPAN>'</SPAN><SPAN>)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Total JSON Files Found (.JSON):&nbsp;</SPAN><SPAN>{</SPAN><SPAN>len</SPAN><SPAN>(json_files)</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Sample JSON File Paths:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>json_files[:</SPAN><SPAN>5</SPAN><SPAN>]&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;json_files&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;</SPAN><SPAN>'</SPAN><SPAN>No JSON files found</SPAN><SPAN>'</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;json_files</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>except</SPAN><SPAN>&nbsp;</SPAN><SPAN>Exception</SPAN><SPAN>&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;e:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Error listing files:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>e</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;[]</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Helper functions for DataFrame processing</SPAN></DIV><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_structs</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_0-1740614786516.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15115i008DECAB844ABB7D/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_0-1740614786516.png" alt="JW_99_0-1740614786516.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; struct_fields&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, StructType)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>while</SPAN><SPAN>&nbsp;struct_fields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;struct_fields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; empty_struct&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.</SPAN><SPAN>createDataFrame</SPAN><SPAN>([], df.schema[field].dataType).</SPAN><SPAN>first</SPAN><SPAN>().</SPAN><SPAN>asDict</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; empty_struct&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{k:&nbsp;</SPAN><SPAN>None</SPAN><SPAN>&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;k&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;empty_struct}</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(field,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(field).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(field)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>struct</SPAN><SPAN>(</SPAN><SPAN>**</SPAN><SPAN>empty_struct)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; subfields&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.schema[field].dataType.fields</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;subfield&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;subfields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; new_col_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><SPAN>{</SPAN><SPAN>field</SPAN><SPAN>}</SPAN><SPAN>_</SPAN><SPAN>{</SPAN><SPAN>subfield.name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(new_col_name,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><SPAN>{</SPAN><SPAN>field</SPAN><SPAN>}</SPAN><SPAN>.</SPAN><SPAN>{</SPAN><SPAN>subfield.name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>drop</SPAN><SPAN>(field)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; struct_fields&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, StructType)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_columns</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_1-1740614786523.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15113i6632EEC2F04E5C5B/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_1-1740614786523.png" alt="JW_99_1-1740614786523.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; array_columns&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, ArrayType)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;explode_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;array_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(col_name).</SPAN><SPAN>isNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>array</SPAN><SPAN>()).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(col_name)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(col_name)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>expected_columns</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_2-1740614786524.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15114i534447EBACC6F021/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_2-1740614786524.png" alt="JW_99_2-1740614786524.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; current_columns&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.columns</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;col_name, col_type&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;expected_columns.</SPAN><SPAN>items</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;current_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(col_type))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_3-1740614786524.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15116i092ECA8323C7D95A/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_3-1740614786524.png" alt="JW_99_3-1740614786524.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; problematic_columns&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, (StructType, ArrayType))]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;problematic_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>infer_and_merge_schema</SPAN><SPAN>(</SPAN><SPAN>file_path</SPAN><SPAN>,&nbsp;</SPAN><SPAN>predefined_schema</SPAN><SPAN>=</SPAN><SPAN>None</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_4-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15118iD3D4C6E0E9A443B6/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_4-1740614786525.png" alt="JW_99_4-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>try</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; inferred_schema&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.read.</SPAN><SPAN>json</SPAN><SPAN>(file_path, multiLine</SPAN><SPAN>=</SPAN><SPAN>True</SPAN><SPAN>).schema</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;predefined_schema:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;inferred_schema.fields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;field.name&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;[f.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;f&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;predefined_schema.fields]:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; predefined_schema.</SPAN><SPAN>add</SPAN><SPAN>(field)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;predefined_schema</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;inferred_schema</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>except</SPAN><SPAN>&nbsp;</SPAN><SPAN>Exception</SPAN><SPAN>&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;e:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Error inferring schema for&nbsp;</SPAN><SPAN>{</SPAN><SPAN>file_path</SPAN><SPAN>}</SPAN><SPAN>:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>e</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;predefined_schema</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Flattening functions for DataFrame processing</SPAN></DIV><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_accounting_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_5-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15117i8FC9CBBBDEA48B89/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_5-1740614786525.png" alt="JW_99_5-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoices</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.ExternalID</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceNumber</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceDateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.DateAdded</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceDateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceMemo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Memo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceDateInvoiced</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.DateInvoiced</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.BillTo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceClass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceClass</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Amount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Tax</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Tax</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Source</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Source</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Status</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceBalance</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceBalance</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdditionalInfoAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.AdditionalInfoAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceType</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceLineItems</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.InvoiceLineItemID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.LineDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Room</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Room</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CategoryID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.CategoryID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Details</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Details</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ItemDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.ItemDescription</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitQuantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.UnitQuantity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitOfMeasure</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.UnitOfMeasure</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Quantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Quantity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.LaborRate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.MaterialRate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.EquipmentRate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Adjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Adjustment</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Overhead</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Overhead</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Profit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Profit</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Rate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemExtendedAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.ExtendedAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemAddedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.AddedDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemUpdatedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.UpdatedDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemTimeModified</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.TimeModified</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Status</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payments</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.PaymentID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentInvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.InvoiceID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentDateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DateAdded</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentDateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Mode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Mode</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DatePaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.ReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Amount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentMemo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Memo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentSource</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Source</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.IsPaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Status</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentDiscountAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DiscountAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostings</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.JobCostingID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Date</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborHours</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.LaborHours</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostTypeCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.JobCostTypeCategory</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingQuantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Quantity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UOM</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.UOM</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Rate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extended</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Extended</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Billable</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Billable</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.PaymentTo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Description</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TxnType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.TxnType</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Status</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TransferFrom</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.TransferFrom</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.AddedBy</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PO</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.PO</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Item</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Item</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Service</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Service</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Memo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTxnId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.BillTxnId</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CalculatedBurden</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.CalculatedBurden</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.LinkedVendorPayments</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.VendorPaymentID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentAmountPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.AmountPaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentDatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.DatePaid</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CheckNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.CheckNumber</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoices</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Payments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobCostings</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Invoice</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Payment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobCosting</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_accounting_summary</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_6-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15120i1D2804ADEBF416D9/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_6-1740614786525.png" alt="JW_99_6-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobId</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobId</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsForcedSync</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsForcedSync</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MD5HashAsHexString</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MD5HashAsHexString</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfit</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfit</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdjustedInvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdjustedInvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BalanceOwing</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BalanceOwing</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ChangeOrderAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ChangeOrderAmount</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectedSubtotal</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectedSubtotal</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ConsumablesCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ConsumablesCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitAmountAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitAmountAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitPercentageAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitPercentageAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitAmountFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitAmountFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitPercentageFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitPercentageFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfit</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfit</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUninvoicedAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUninvoicedAmount</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUnpaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUnpaid</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialEstimate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialEstimate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalInvoiced</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalInvoiced</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialsCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialsCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OriginalEstimate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OriginalEstimate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProfessionalFee</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProfessionalFee</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RecognizedRevenue</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RecognizedRevenue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SubtradeCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SubtradeCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SupplementEstimate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SupplementEstimate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalCollected</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalCollected</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalEstimates</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalEstimates</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalJobCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalJobCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalWorkOrderBudget</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalWorkOrderBudget</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WarrantyCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WarrantyCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateDepreciation</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateDepreciation</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_internal_participants</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_7-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15119iF48F4C8928B5F1FB/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_7-1740614786525.png" alt="JW_99_7-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participants</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.ID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParticipantID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.Type</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParticipantType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.PersonName.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.PersonName.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_dates</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_8-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15121iD08494AC15C78225/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_8-1740614786526.png" alt="JW_99_8-1740614786526.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>array</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.AuditDetails</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.AuditDetails</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>struct</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredBy</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WhenEntered</SPAN><SPAN>"</SPAN><SPAN>))))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails_EnteredBy</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails.EnteredBy</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails.EnteredBy</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>struct</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>))))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.DateTypeID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateTypeID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.DateName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.Value</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateValue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails.WhenEntered</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WhenEntered</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails_EnteredBy.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredByFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails_EnteredBy.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredByLastName</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_9-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15122i9F5306CCB5BA212F/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_9-1740614786526.png" alt="JW_99_9-1740614786526.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_structs</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Email</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_City</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_StateProvince</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_PostalCode</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_Country</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_MainPhone_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_MainPhone_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_OtherPhones_Category</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_OtherPhones_PhoneNumbers_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_OtherPhones_PhoneNumbers_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Email</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_City</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_StateProvince</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_PostalCode</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_Country</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_MainPhone_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_MainPhone_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_OtherPhones_Category</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_OtherPhones_PhoneNumbers_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_OtherPhones_PhoneNumbers_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobInfo_RoomsAffected</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AdminInfo_Services</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceCompany</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceIndividual</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceEmployee</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceMarketingCampaign</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, df.schema.fields)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_external_participants</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_10-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15123i8688C2A1E95BEFCF/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_10-1740614786526.png" alt="JW_99_10-1740614786526.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.ContactsDetails</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.RelationshipType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.CompanyName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.MarketingRank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyMarketingRank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Email</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContactEmail</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Website</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContactWebsite</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCity</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCountry</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCounty</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.RelationshipType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.IndividualID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.Title</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualTitle</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.CompanyName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualCompanyName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.PreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualPreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.MarketingRank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualMarketingRank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Email</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContactEmail</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCity</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCountry</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCounty</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.PersonName.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.PersonName.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualLastName</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyMarketingRank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContactEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContactWebsite</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualTitle</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualCompanyName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualPreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualMarketingRank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualContactEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualFirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualLastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_tags</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_11-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15124i62F9D9AEDD82F781/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_11-1740614786527.png" alt="JW_99_11-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN><SPAN>"</SPAN><SPAN>JobTags</SPAN><SPAN>"</SPAN><SPAN>])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTag</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTags</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTags_TagName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTag.TagName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())).</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTag</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobTags_TagName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()})</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_survey_summary</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_12-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15125iA96EFE904842608E/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_12-1740614786527.png" alt="JW_99_12-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN><SPAN>"</SPAN><SPAN>SurveyDetails</SPAN><SPAN>"</SPAN><SPAN>])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetails</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MostRecentSurveyDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MostRecentSurveyDate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.IsIncludedForSurvey</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsIncludedForSurvey</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.IsSendTriggerCompleted</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsSendTriggerCompleted</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyScoreValue</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreValue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyScoreLabel</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreLabel</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.NoSurveyReason</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NoSurveyReason</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>0</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Yes</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>1</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>No</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>2</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Sent</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>3</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Received</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_linked_assignments</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_13-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15128i99EC5F2E5C0823A9/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_13-1740614786527.png" alt="JW_99_13-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedExternalAssignments</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment.ID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssignmentID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment.ExternalSystemType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalSystemType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment.ExternalID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_notes_summary</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_14-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15127i1AD4F11716D9E1C4/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_14-1740614786527.png" alt="JW_99_14-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAdded</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAdded</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAddedTime</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAddedTime</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_company_contacts</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_15-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15129i423AF4E9F82B068C/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_15-1740614786527.png" alt="JW_99_15-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>array</SPAN><SPAN>()).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.ContactID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Website</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingCity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingStateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingCountry</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingPostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingCounty</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingCity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingStateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingCountry</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingPostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingCounty</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_company_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_16-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15131i0CFF31F616ED9E5B/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_16-1740614786528.png" alt="JW_99_16-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>([f.dataType&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;f&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;f.name&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>][</SPAN><SPAN>0</SPAN><SPAN>], StringType):</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>from_json</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.ResponsibleRep.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.ResponsibleRep.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Name</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Name</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Rank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Rank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferralType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferralType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferredBy</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferredBy</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStatus</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStatus</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Type</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Type</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ).</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Name</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Rank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferralType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferredBy</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStage</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStatus</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Type</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_individual_contacts</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_17-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15130iF2CBFB05D0528DFE/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_17-1740614786528.png" alt="JW_99_17-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>array</SPAN><SPAN>()).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.ContactID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Email</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>OtherPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PhoneNumber</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_individual_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_18-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15134i13BAD3BBBF5D1EA1/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_18-1740614786528.png" alt="JW_99_18-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>else</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>else</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Anniversary</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Anniversary</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ContactType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.JobTitle</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTitle</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Name.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Name.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ParentCompany</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompany</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Rank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ReferralType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ReferredBy</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.SalesStage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.SalesStatus</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Title</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Anniversary</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ContactType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobTitle</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ParentCompany</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_provider_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_19-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15132iCA7D4734390422CB/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_19-1740614786528.png" alt="JW_99_19-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchisorID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchisorID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnterpriseID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnterpriseID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryEmail</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_provider_scores</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_20-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15133iEB92650C32ED1821/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_20-1740614786528.png" alt="JW_99_20-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.Score</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VpassScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_provider_suspensions</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_21-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15136iBCDB92EDDE371C27/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_21-1740614786529.png" alt="JW_99_21-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNull</SPAN><SPAN>()&nbsp;</SPAN><SPAN>|</SPAN><SPAN>&nbsp;(</SPAN><SPAN>size</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>))&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>0</SPAN><SPAN>),&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>))).</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SuspensionID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>StartDate</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LiftDate</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IsValid</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Level</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Reason</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LiftMethod</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SuspensionType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Visibility</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AffectedDivisionName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_location_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_22-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15137i634E525787E56556/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_22-1740614786529.png" alt="JW_99_22-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.City</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiStateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.StateProvince</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiPostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.PostalCode</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCountry</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.Country</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.City</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.Country</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCity</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiStateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiStateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiPostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiPostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCountry</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCountry</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_location_scores</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_23-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15135i5475FDA7282C6373/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_23-1740614786529.png" alt="JW_99_23-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CloseRatio</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CloseRatio</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.Score</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VpassScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define transformation mapping</SPAN></DIV><DIV><SPAN>transformation_mapping&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_accounting_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_accounting_summary,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>InternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_internal_participants,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDates.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_dates,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobExternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_external_participants,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobTags.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_tags,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SurveySummary.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_survey_summary,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LinkedAssignmentDetails.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_linked_assignments,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>NotesSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_notes_summary,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_company_contacts,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_company_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_individual_contacts,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_individual_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_provider_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderScores.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_provider_scores,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderSuspensions.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_provider_suspensions,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_location_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationScores.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_location_scores</SPAN></DIV><DIV><SPAN>}</SPAN></DIV><DIV><SPAN>transformation_mapping_bc&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;sc.</SPAN><SPAN>broadcast</SPAN><SPAN>(transformation_mapping)</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Broadcast schemas (assuming schemas dict is defined elsewhere)</SPAN></DIV><DIV><SPAN>schemas_json&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{k: v.</SPAN><SPAN>json</SPAN><SPAN>()&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;k, v&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;schemas.</SPAN><SPAN>items</SPAN><SPAN>()}&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>'</SPAN><SPAN>schemas</SPAN><SPAN>'</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;</SPAN><SPAN>globals</SPAN><SPAN>()&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;{}</SPAN></DIV><DIV><SPAN>schemas_bc&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;sc.</SPAN><SPAN>broadcast</SPAN><SPAN>(schemas_json)</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_partition</SPAN><SPAN>(</SPAN><SPAN>partition</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_24-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15139i16737208325CD839/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_24-1740614786529.png" alt="JW_99_24-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"""</SPAN><SPAN>Process a partition of JSON files inside worker nodes using the existing Spark session.</SPAN><SPAN>"""</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Use the global spark session (implicitly available via SparkContext on workers)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;row&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;partition:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; path, file_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;row[</SPAN><SPAN>"</SPAN><SPAN>path</SPAN><SPAN>"</SPAN><SPAN>], row[</SPAN><SPAN>"</SPAN><SPAN>file_name</SPAN><SPAN>"</SPAN><SPAN>]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; folder_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;file_name.</SPAN><SPAN>replace</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>.JSON</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>""</SPAN><SPAN>).</SPAN><SPAN>replace</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>.json</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>""</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; output_path&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><SPAN>{</SPAN><SPAN>output_base_path</SPAN><SPAN>}</SPAN><SPAN>/</SPAN><SPAN>{</SPAN><SPAN>folder_name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Retrieve schema JSON from broadcast and convert to StructType</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; schema_json&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;schemas_bc.value.</SPAN><SPAN>get</SPAN><SPAN>(file_name)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; schema&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;StructType.</SPAN><SPAN>fromJson</SPAN><SPAN>(schema_json)&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;schema_json&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;</SPAN><SPAN>None</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>try</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Infer schema only if no predefined schema exists</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;schema&nbsp;</SPAN><SPAN>is</SPAN><SPAN>&nbsp;</SPAN><SPAN>None</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; inferred_df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.read.</SPAN><SPAN>option</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>inferSchema</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>json</SPAN><SPAN>(path, multiLine</SPAN><SPAN>=</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; schema&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;inferred_df.schema</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; raw_df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.read.</SPAN><SPAN>schema</SPAN><SPAN>(schema).</SPAN><SPAN>json</SPAN><SPAN>(path, multiLine</SPAN><SPAN>=</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Apply the appropriate transformation function</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; transform_func&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;transformation_mapping_bc.value.</SPAN><SPAN>get</SPAN><SPAN>(file_name)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;transform_func:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; raw_df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>transform_func</SPAN><SPAN>(raw_df, path)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Write to Parquet with optimization</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; raw_df.</SPAN><SPAN>coalesce</SPAN><SPAN>(</SPAN><SPAN>32</SPAN><SPAN>).write.</SPAN><SPAN>mode</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>append</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>partitionBy</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>parquet</SPAN><SPAN>(output_path)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_25-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15138i3164483962BB2499/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_25-1740614786526.png" alt="JW_99_25-1740614786526.png" /></span><P>&nbsp;</P><SPAN>&nbsp;Processed&nbsp;</SPAN><SPAN>{</SPAN><SPAN>file_name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>except</SPAN><SPAN>&nbsp;</SPAN><SPAN>Exception</SPAN><SPAN>&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;e:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_26-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15141i1D28F639CC47D04A/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_26-1740614786526.png" alt="JW_99_26-1740614786526.png" /></span><P>&nbsp;</P><SPAN>&nbsp;Error processing&nbsp;</SPAN><SPAN>{</SPAN><SPAN>file_name</SPAN><SPAN>}</SPAN><SPAN>:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>e</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_json_files_parallel</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"""</SPAN><SPAN>Parallel processing of JSON files.</SPAN><SPAN>"""</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; json_files&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>list_json_files</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;json_files:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>No files to process.</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; df_files&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.</SPAN><SPAN>createDataFrame</SPAN><SPAN>([(path, os.path.</SPAN><SPAN>basename</SPAN><SPAN>(path))&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;path&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;json_files], [</SPAN><SPAN>"</SPAN><SPAN>path</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>file_name</SPAN><SPAN>"</SPAN><SPAN>])</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Repartition to match cluster cores (128) for maximum parallelism</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df_files.</SPAN><SPAN>repartition</SPAN><SPAN>(</SPAN><SPAN>128</SPAN><SPAN>).rdd.</SPAN><SPAN>foreachPartition</SPAN><SPAN>(process_partition)</SPAN></DIV><BR /><DIV><SPAN>if</SPAN><SPAN>&nbsp;__name__&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>__main__</SPAN><SPAN>"</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>process_json_files_parallel</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; spark.</SPAN><SPAN>stop</SPAN><SPAN>()</SPAN></DIV></DIV></DIV> Thu, 27 Feb 2025 00:08:38 GMT JW_99 2025-02-27T00:08:38Z https://community.databricks.com/t5/data-engineering/pysparkruntimeerror-context-only-valid-on-driver/m-p/111342#M43852 <P>I've troubleshot this like 20+ times. I am aware that the current code is causing the spark session to be passed to the workers, where it should only be applied to the driver. Can someone please help me resolve this (the schema is defined earlier)?</P><P>---------------------------------------------------------------------</P><DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;SparkSession, DataFrame, Row</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;functions&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;F</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;azure.storage.blob&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;ContainerClient</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.types&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;delta.tables&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;DeltaTable</SPAN></DIV><DIV><SPAN>import</SPAN><SPAN>&nbsp;os</SPAN></DIV><BR /><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.types&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; StructType, StructField, StringType, IntegerType, TimestampType, ArrayType, DoubleType, BooleanType, FloatType, LongType</SPAN></DIV><DIV><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define schemas</SPAN></DIV><DIV><SPAN>schemas&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoices</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateInvoiced</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceClass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Amount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Tax</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Source</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceBalance</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItems</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LineDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Room</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CategoryID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Details</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ItemDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitQuantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitOfMeasure</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Quantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Adjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Overhead</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Profit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExtendedAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UpdatedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TimeModified</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdditionalInfoAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Mode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Amount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Source</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DiscountAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostings</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborHours</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostTypeCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Quantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UOM</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extended</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Billable</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TxnType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TimeModified</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TransferFrom</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PO</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Item</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Service</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTxnId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CalculatedBurden</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AmountPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CheckNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsForcedSync</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MD5HashAsHexString</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdjustedInvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BalanceOwing</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ChangeOrderAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectedSubtotal</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ConsumablesCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitAmountAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitPercentageAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitAmountFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitPercentageFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUninvoicedAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUnpaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialEstimate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalInvoiced</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialsCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OriginalEstimate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProfessionalFee</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RecognizedRevenue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SubtradeCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SupplementEstimate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalCollected</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalEstimates</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalJobCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalWorkOrderBudget</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WarrantyCost</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateDepreciation</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Addresses</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Main Phone</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Other Phones</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Nullable struct</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Anniversary</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assistant</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTitle</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompany</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationScores.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CloseRatio</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Score</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderScores.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Score</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DashCompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalEnterpriseID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferenceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TypeOfLoss</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderLossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClientName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfLoss</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateReceived</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CatReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyLimits</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DwellingAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContentsAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherStructuresAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClientID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Caller</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimEnteredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PreferredProviderName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PreferredProviderLocationName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsProviderCreatedClaim</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReportedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CodeRedID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimCustomer</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimCustomerType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CustomerName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyHolderType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Division</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderReasonForClosing</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminJob</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsClosed</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsOnHold</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnvironmentalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReceivedByFullName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Priority</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SpecialInstructions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialFindings</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RoomsAffected</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssociatedJobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderCatastropheName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderDivisionType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnvironmentalCodeDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCompletionPercentage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MasterBuilderNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeDatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RegionalAreaManager</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WaterJobCat</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WaterJobClass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobSource</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminJobNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminDivision</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminReasonForClosing</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Program</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProgramID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProgramName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NationalAccountDirector</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReasonForClosingCategoryName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsEmergencyServiceRequired</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LicenseNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminInsuranceCarrier</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminInsuranceCarrierID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdminJobStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobLeadID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Services</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyClaimInformation</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ClaimNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PolicyNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePolicyStart</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePolicyExpiration</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>YearBuilt</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalFileNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SecondaryLossType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReportedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredByFullName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceOfLoss</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobSize</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderLossCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentServices</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DeductibleAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>DoubleType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectWhen</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLienRights</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLienLiened</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateLienReleased</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MbJobNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LossContactInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactPerson</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Customer</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobPolicyHolderType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceIndividual</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceCompany</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceEmployee</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SourceMarketingCampaign</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CampaignName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([ &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>EmployeeDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EmployeeInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EmployeeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp;</SPAN><SPAN>"</SPAN><SPAN>InternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participants</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobExternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingRank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddress</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingRank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Category</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PersonName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDates.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateTypeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Value</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AuditDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WhenEntered</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>TimestampType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LinkedAssignmentDetails.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedExternalAssignments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalSystemType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>NotesSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAddedTime</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SurveySummary.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MostRecentSurveyDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetails</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScore</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsIncludedForSurvey</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsSendTriggerCompleted</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreValue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreLabel</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NoSurveyReason</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>EmployeeContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EmployeeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Phones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UFOC</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalEnterpriseLocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainFax</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddresses</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressValue</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryContact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Phone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Number</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BusinessDevelopmentManagerName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchisorID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnterpriseID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>]),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderSuspensions.JSON</SPAN><SPAN>"</SPAN><SPAN>&nbsp;:&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SuspensionID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StartDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LiftDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsValid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>False</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Level</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Reason</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LiftMethod</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SuspensionType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Visibility</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>), &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AffectedDivisions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>) &nbsp;</SPAN></DIV><DIV><SPAN>])</SPAN></DIV><DIV><SPAN>}</SPAN></DIV></DIV><P>--------------------------------------------------------------</P><DIV><DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;SparkSession</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.functions&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;pyspark.sql.types&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN></DIV><DIV><SPAN>from</SPAN><SPAN>&nbsp;azure.storage.blob&nbsp;</SPAN><SPAN>import</SPAN><SPAN>&nbsp;ContainerClient</SPAN></DIV><DIV><SPAN>import</SPAN><SPAN>&nbsp;os</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Function to create or get Spark session with optimized configurations</SPAN></DIV><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>create_spark_session</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;SparkSession.builder \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>appName</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Highly Optimized JSON Pipeline</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.catalogImplementation</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>hive</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.adaptive.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.adaptive.coalescePartitions.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.files.maxPartitionBytes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>128</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN><SPAN>&nbsp;</SPAN><SPAN>1024</SPAN><SPAN>&nbsp;</SPAN><SPAN>*</SPAN><SPAN>&nbsp;</SPAN><SPAN>1024</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.files.minPartitionNum</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>256</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.dynamicAllocation.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.dynamicAllocation.minExecutors</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>4</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.dynamicAllocation.maxExecutors</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>16</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.executor.cores</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>32</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.executor.memory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>200g</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.driver.memory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>64g</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.driver.cores</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>8</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.parquet.compression.codec</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>zstd</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.memory.fraction</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>0.9</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.memory.storageFraction</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>0.3</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.shuffle.partitions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>256</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.sql.adaptive.skewJoin.enabled</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>spark.serializer</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>org.apache.spark.serializer.KryoSerializer</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>config</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>fs.azure.account.key.amrdatalake01.blob.core.windows.net</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>e3dTBwzl+nu4xTxqsBj+WgWOy5fa2ve7SICaBjVOmrLOw5fYshIZk+FSoz8IoM87GttRSYyL5yJM+AStFYUMGw==</SPAN><SPAN>"</SPAN><SPAN>) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; .</SPAN><SPAN>getOrCreate</SPAN><SPAN>()</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Initialize Spark session globally (only on driver)</SPAN></DIV><DIV><SPAN>spark&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>create_spark_session</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>sc&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.sparkContext</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define Storage Account Details</SPAN></DIV><DIV><SPAN>storage_account_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>secret##</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>container_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>secret##</SPAN><SPAN>"</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define base paths using abfss directly</SPAN></DIV><DIV><SPAN>output_base_path&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>f</SPAN><SPAN>"abfss://</SPAN><SPAN>{</SPAN><SPAN>container_name</SPAN><SPAN>}</SPAN><SPAN>@</SPAN><SPAN>{</SPAN><SPAN>storage_account_name</SPAN><SPAN>}</SPAN><SPAN>.dfs.core.windows.net/dash.test/output"</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>list_json_files</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"""</SPAN><SPAN>List JSON files from Azure Blob Storage with robust authentication handling.</SPAN><SPAN>"""</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>try</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; container_client&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ContainerClient</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; account_url</SPAN><SPAN>=</SPAN><SPAN>f</SPAN><SPAN>"https://</SPAN><SPAN>{</SPAN><SPAN>storage_account_name</SPAN><SPAN>}</SPAN><SPAN>.blob.core.windows.net"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; container_name</SPAN><SPAN>=</SPAN><SPAN>container_name,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; credential</SPAN><SPAN>=</SPAN><SPAN>"</SPAN><SPAN>secret##</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; container_client.</SPAN><SPAN>get_container_properties</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Successfully authenticated with container&nbsp;</SPAN><SPAN>{</SPAN><SPAN>container_name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; all_blobs&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>list</SPAN><SPAN>(container_client.</SPAN><SPAN>list_blobs</SPAN><SPAN>())</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Total blobs found in container:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>len</SPAN><SPAN>(all_blobs)</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Sample blob names:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>'</SPAN><SPAN>,&nbsp;</SPAN><SPAN>'</SPAN><SPAN>.</SPAN><SPAN>join</SPAN><SPAN>(blob.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;blob&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;all_blobs[:</SPAN><SPAN>5</SPAN><SPAN>])&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;all_blobs&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;</SPAN><SPAN>'</SPAN><SPAN>None</SPAN><SPAN>'</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; json_files&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[</SPAN><SPAN>f</SPAN><SPAN>"abfss://</SPAN><SPAN>{</SPAN><SPAN>container_name</SPAN><SPAN>}</SPAN><SPAN>@</SPAN><SPAN>{</SPAN><SPAN>storage_account_name</SPAN><SPAN>}</SPAN><SPAN>.dfs.core.windows.net/</SPAN><SPAN>{</SPAN><SPAN>blob.name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;blob&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;all_blobs&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;blob.name.</SPAN><SPAN>endswith</SPAN><SPAN>(</SPAN><SPAN>'</SPAN><SPAN>.JSON</SPAN><SPAN>'</SPAN><SPAN>)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Total JSON Files Found (.JSON):&nbsp;</SPAN><SPAN>{</SPAN><SPAN>len</SPAN><SPAN>(json_files)</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Sample JSON File Paths:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>json_files[:</SPAN><SPAN>5</SPAN><SPAN>]&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;json_files&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;</SPAN><SPAN>'</SPAN><SPAN>No JSON files found</SPAN><SPAN>'</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;json_files</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>except</SPAN><SPAN>&nbsp;</SPAN><SPAN>Exception</SPAN><SPAN>&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;e:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Error listing files:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>e</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;[]</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Helper functions for DataFrame processing</SPAN></DIV><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_structs</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_0-1740614786516.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15115i008DECAB844ABB7D/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_0-1740614786516.png" alt="JW_99_0-1740614786516.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; struct_fields&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, StructType)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>while</SPAN><SPAN>&nbsp;struct_fields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;struct_fields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; empty_struct&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.</SPAN><SPAN>createDataFrame</SPAN><SPAN>([], df.schema[field].dataType).</SPAN><SPAN>first</SPAN><SPAN>().</SPAN><SPAN>asDict</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; empty_struct&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{k:&nbsp;</SPAN><SPAN>None</SPAN><SPAN>&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;k&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;empty_struct}</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(field,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(field).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(field)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>struct</SPAN><SPAN>(</SPAN><SPAN>**</SPAN><SPAN>empty_struct)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; subfields&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.schema[field].dataType.fields</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;subfield&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;subfields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; new_col_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><SPAN>{</SPAN><SPAN>field</SPAN><SPAN>}</SPAN><SPAN>_</SPAN><SPAN>{</SPAN><SPAN>subfield.name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(new_col_name,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><SPAN>{</SPAN><SPAN>field</SPAN><SPAN>}</SPAN><SPAN>.</SPAN><SPAN>{</SPAN><SPAN>subfield.name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>drop</SPAN><SPAN>(field)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; struct_fields&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, StructType)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_columns</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_1-1740614786523.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15113i6632EEC2F04E5C5B/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_1-1740614786523.png" alt="JW_99_1-1740614786523.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; array_columns&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, ArrayType)]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;explode_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;array_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(col_name).</SPAN><SPAN>isNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>array</SPAN><SPAN>()).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(col_name)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(col_name)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>expected_columns</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_2-1740614786524.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15114i534447EBACC6F021/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_2-1740614786524.png" alt="JW_99_2-1740614786524.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; current_columns&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.columns</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;col_name, col_type&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;expected_columns.</SPAN><SPAN>items</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;current_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(col_type))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_3-1740614786524.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15116i092ECA8323C7D95A/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_3-1740614786524.png" alt="JW_99_3-1740614786524.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; problematic_columns&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;[field.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>(field.dataType, (StructType, ArrayType))]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;col_name&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;problematic_columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(col_name,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>infer_and_merge_schema</SPAN><SPAN>(</SPAN><SPAN>file_path</SPAN><SPAN>,&nbsp;</SPAN><SPAN>predefined_schema</SPAN><SPAN>=</SPAN><SPAN>None</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_4-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15118iD3D4C6E0E9A443B6/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_4-1740614786525.png" alt="JW_99_4-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>try</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; inferred_schema&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.read.</SPAN><SPAN>json</SPAN><SPAN>(file_path, multiLine</SPAN><SPAN>=</SPAN><SPAN>True</SPAN><SPAN>).schema</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;predefined_schema:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;field&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;inferred_schema.fields:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;field.name&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;[f.name&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;f&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;predefined_schema.fields]:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; predefined_schema.</SPAN><SPAN>add</SPAN><SPAN>(field)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;predefined_schema</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;inferred_schema</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>except</SPAN><SPAN>&nbsp;</SPAN><SPAN>Exception</SPAN><SPAN>&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;e:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"Error inferring schema for&nbsp;</SPAN><SPAN>{</SPAN><SPAN>file_path</SPAN><SPAN>}</SPAN><SPAN>:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>e</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;predefined_schema</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Flattening functions for DataFrame processing</SPAN></DIV><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_accounting_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_5-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15117i8FC9CBBBDEA48B89/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_5-1740614786525.png" alt="JW_99_5-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoices</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.ExternalID</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceNumber</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceDateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.DateAdded</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceDateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceMemo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Memo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceDateInvoiced</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.DateInvoiced</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.BillTo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceClass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceClass</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Amount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Tax</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Tax</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Source</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Source</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.Status</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceBalance</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceBalance</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdditionalInfoAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.AdditionalInfoAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceType</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoice.InvoiceLineItems</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.InvoiceLineItemID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.LineDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Room</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Room</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CategoryID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.CategoryID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Details</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Details</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ItemDescription</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.ItemDescription</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitQuantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.UnitQuantity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UnitOfMeasure</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.UnitOfMeasure</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Quantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Quantity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.LaborRate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.MaterialRate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.EquipmentRate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Adjustment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Adjustment</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Overhead</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Overhead</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Profit</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Profit</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Rate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemExtendedAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.ExtendedAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemAddedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.AddedDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemUpdatedDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.UpdatedDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemTimeModified</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.TimeModified</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItemStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem.Status</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payments</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.PaymentID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentInvoiceID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.InvoiceID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentDateAdded</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DateAdded</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentDateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DateLastUpdate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Mode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Mode</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DatePaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.ReferenceNumber</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Amount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentMemo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Memo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentSource</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Source</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.IsPaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.Status</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentDiscountAmount</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Payment.DiscountAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostings</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.JobCostingID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingDate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Date</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborHours</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.LaborHours</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostTypeCategory</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.JobCostTypeCategory</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingQuantity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Quantity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>UOM</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.UOM</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingRate</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Rate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Extended</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Extended</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Billable</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Billable</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PaymentTo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.PaymentTo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Description</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TxnType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.TxnType</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCostingStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Status</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TransferFrom</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.TransferFrom</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddedBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.AddedBy</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PO</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.PO</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Item</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Item</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Service</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Service</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Memo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.Memo</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillTxnId</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.BillTxnId</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CalculatedBurden</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.CalculatedBurden</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobCosting.LinkedVendorPayments</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.VendorPaymentID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentAmountPaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.AmountPaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>DoubleType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VendorPaymentDatePaid</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.DatePaid</SPAN><SPAN>"</SPAN><SPAN>)) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CheckNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment.CheckNumber</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Invoices</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Payments</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobCostings</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Invoice</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>InvoiceLineItem</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Payment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobCosting</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LinkedVendorPayment</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_accounting_summary</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_6-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15120i1D2804ADEBF416D9/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_6-1740614786525.png" alt="JW_99_6-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobId</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobId</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsForcedSync</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsForcedSync</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MD5HashAsHexString</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MD5HashAsHexString</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfit</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfit</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ActualGrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdjustedInvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AdjustedInvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BalanceOwing</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BalanceOwing</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ChangeOrderAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ChangeOrderAmount</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectedSubtotal</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CollectedSubtotal</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ConsumablesCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ConsumablesCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EquipmentCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitAmountAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitAmountAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitPercentageAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfitPercentageAfterWOAdjustment</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitAmountFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitAmountFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitPercentageFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimatedGrossProfitPercentageFromEstimateImport</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfit</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateGrossProfit</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUninvoicedAmount</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUninvoicedAmount</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUnpaid</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateUnpaid</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GrossProfitPercentage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialEstimate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InitialEstimate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InvoiceSubtotal</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalInvoiced</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalInvoiced</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LaborCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialsCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MaterialsCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OriginalEstimate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OriginalEstimate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>OtherCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProfessionalFee</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProfessionalFee</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RecognizedRevenue</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>RecognizedRevenue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralFeeCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SubtradeCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SubtradeCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SupplementEstimate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SupplementEstimate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalCollected</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalCollected</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalEstimates</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalEstimates</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalJobCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalJobCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalWorkOrderBudget</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>TotalWorkOrderBudget</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WarrantyCost</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WarrantyCost</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateDepreciation</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EstimateDepreciation</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_internal_participants</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_7-1740614786525.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15119iF48F4C8928B5F1FB/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_7-1740614786525.png" alt="JW_99_7-1740614786525.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participants</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.ID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParticipantID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.Type</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParticipantType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.PersonName.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Participant.PersonName.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_dates</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_8-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15121iD08494AC15C78225/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_8-1740614786526.png" alt="JW_99_8-1740614786526.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>array</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Dates</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.AuditDetails</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.AuditDetails</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>struct</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredBy</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WhenEntered</SPAN><SPAN>"</SPAN><SPAN>))))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails_EnteredBy</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails.EnteredBy</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNotNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails.EnteredBy</SPAN><SPAN>"</SPAN><SPAN>))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>struct</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>))))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.DateTypeID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateTypeID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.DateName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date.Value</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateValue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails.WhenEntered</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>TimestampType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>WhenEntered</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails_EnteredBy.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredByFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Date_AuditDetails_EnteredBy.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnteredByLastName</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_9-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15122i9F5306CCB5BA212F/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_9-1740614786526.png" alt="JW_99_9-1740614786526.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_structs</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Email</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_City</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_StateProvince</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_PostalCode</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_Address_Country</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_MainPhone_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_MainPhone_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_OtherPhones_Category</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_OtherPhones_PhoneNumbers_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_IndividualDetails_ContactsDetails_OtherPhones_PhoneNumbers_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Email</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_City</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_StateProvince</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_PostalCode</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_Address_Country</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_MainPhone_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_MainPhone_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_OtherPhones_Category</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_OtherPhones_PhoneNumbers_Number</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Customer_CompanyDetails_ContactsDetails_OtherPhones_PhoneNumbers_Extension</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobInfo_RoomsAffected</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AdminInfo_Services</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceCompany</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceIndividual</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceEmployee</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobReferralDetails_SourceMarketingCampaign</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, df.schema.fields)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_external_participants</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_10-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15123i8688C2A1E95BEFCF/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_10-1740614786526.png" alt="JW_99_10-1740614786526.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.ContactsDetails</SPAN><SPAN>"</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.ContactsDetails</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.RelationshipType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.CompanyName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyRelations.CompanyDetails.MarketingRank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyMarketingRank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Email</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContactEmail</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Website</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContactWebsite</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCity</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCountry</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCounty</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.RelationshipType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.RelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.IndividualID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.Title</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualTitle</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.CompanyName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualCompanyName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.PreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualPreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.MarketingRank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualMarketingRank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Email</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContactEmail</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCity</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCountry</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCounty</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.PersonName.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualRelations.IndividualDetails.PersonName.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualLastName</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillToType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyMarketingRank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContactEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContactWebsite</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyAddressCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualRelationshipTypeName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualTitle</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualCompanyName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualPreferredCommunicationMethod</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualMarketingRank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualContactEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualAddressCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualMainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualFirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualLastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_job_tags</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_11-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15124i62F9D9AEDD82F781/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_11-1740614786527.png" alt="JW_99_11-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN><SPAN>"</SPAN><SPAN>JobTags</SPAN><SPAN>"</SPAN><SPAN>])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTag</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTags</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTags_TagName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTag.TagName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())).</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTag</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobTags_TagName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()})</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_survey_summary</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_12-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15125iA96EFE904842608E/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_12-1740614786527.png" alt="JW_99_12-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_array_columns</SPAN><SPAN>(df, [</SPAN><SPAN>"</SPAN><SPAN>SurveyDetails</SPAN><SPAN>"</SPAN><SPAN>])</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetails</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MostRecentSurveyDate</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MostRecentSurveyDate</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.IsIncludedForSurvey</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsIncludedForSurvey</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.IsSendTriggerCompleted</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsSendTriggerCompleted</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyScoreValue</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreValue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.SurveyScoreLabel</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyScoreLabel</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyDetail.NoSurveyReason</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NoSurveyReason</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>0</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Yes</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>1</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>No</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>2</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Sent</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SurveyStatus</SPAN><SPAN>"</SPAN><SPAN>)&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>3</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Received</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_linked_assignments</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_13-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15128i99EC5F2E5C0823A9/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_13-1740614786527.png" alt="JW_99_13-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LinkedExternalAssignments</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment.ID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssignmentID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment.ExternalSystemType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalSystemType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Assignment.ExternalID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ExternalID</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_notes_summary</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_14-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15127i1AD4F11716D9E1C4/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_14-1740614786527.png" alt="JW_99_14-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAdded</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAdded</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAddedTime</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastNoteAddedTime</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_company_contacts</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_15-1740614786527.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15129i423AF4E9F82B068C/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_15-1740614786527.png" alt="JW_99_15-1740614786527.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>array</SPAN><SPAN>()).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.ContactID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Website</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingCity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingStateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingCountry</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingPostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>BillingCounty</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.BillingAddress.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingCity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingStateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingCountry</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingPostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MailingCounty</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MailingAddress.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CorrespondenceEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>InquiryEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>BillingCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingAddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingCity</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingStateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingCountry</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingPostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MailingCounty</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_company_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_16-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15131i0CFF31F616ED9E5B/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_16-1740614786528.png" alt="JW_99_16-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>isinstance</SPAN><SPAN>([f.dataType&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;f&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.schema.fields&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;f.name&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>][</SPAN><SPAN>0</SPAN><SPAN>], StringType):</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>from_json</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>ArrayType</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StructType</SPAN><SPAN>([</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ]),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>StructField</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; ])))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.ResponsibleRep.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.ResponsibleRep.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Name</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Name</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Rank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Rank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferralType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferralType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferredBy</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferredBy</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStatus</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStatus</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Type</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Type</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; ).</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_FranchiseeID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Name</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ParentCompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Rank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferralType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ReferredBy</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_FirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_ResponsibleRep_LastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStage</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_SalesStatus</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Type</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_Categories</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyInfo_MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_individual_contacts</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_17-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15130iF2CBFB05D0528DFE/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_17-1740614786528.png" alt="JW_99_17-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNull</SPAN><SPAN>(),&nbsp;</SPAN><SPAN>array</SPAN><SPAN>()).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.ContactID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Email</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Number</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.MainPhone.Extension</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contact.Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Contacts</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Contact</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>OtherPhones</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>OtherPhone</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PhoneNumbers</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PhoneNumber</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ContactID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Email</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SecondaryEmail</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MainPhoneExtension</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_individual_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_18-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15134i13BAD3BBBF5D1EA1/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_18-1740614786528.png" alt="JW_99_18-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>BooleanType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Assistant</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>else</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ResponsibleRep</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>else</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>concat_ws</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>StringType</SPAN><SPAN>())) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Categories</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Anniversary</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Anniversary</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ContactType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ContactType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>LongType</SPAN><SPAN>()).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.JobTitle</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobTitle</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Name.FirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Name.LastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ParentCompany</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ParentCompany</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Rank</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ReferralType</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.ReferredBy</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.SalesStage</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.SalesStatus</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IndividualDetailInfo.Title</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Anniversary</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AssistantFirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AssistantLastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Categories</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ContactType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>DateOfBirth</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>FranchiseeId</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>LongType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>GroupAndRoutes</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobTitle</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>MarketingCampaigns</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>FirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ParentCompany</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralRevenue</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>PotentialReferralVolume</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Rank</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ReferralType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ReferredBy</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepFirstName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ResponsibleRepLastName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SageAccountNumber</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SalesStage</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SalesStatus</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Title</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_provider_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_19-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15132iCA7D4734390422CB/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_19-1740614786528.png" alt="JW_99_19-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchisorID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>FranchisorID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Name</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderName</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CompanyID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnterpriseID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EnterpriseID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Type</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderType</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryEmail</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PrimaryEmail</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Website</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsActive</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.County</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>County</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_provider_scores</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_20-1740614786528.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15133iEB92650C32ED1821/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_20-1740614786528.png" alt="JW_99_20-1740614786528.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.Score</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VpassScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_provider_suspensions</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_21-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15136iBCDB92EDDE371C27/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_21-1740614786529.png" alt="JW_99_21-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>isNull</SPAN><SPAN>()&nbsp;</SPAN><SPAN>|</SPAN><SPAN>&nbsp;(</SPAN><SPAN>size</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>))&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>0</SPAN><SPAN>),&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>))).</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Suspensions</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>ensure_all_columns</SPAN><SPAN>(df, {</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SuspensionID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>IntegerType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>StartDate</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LiftDate</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Description</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Status</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IsValid</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>BooleanType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Level</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Reason</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LiftMethod</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SuspensionType</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Visibility</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>(),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AffectedDivisionName</SPAN><SPAN>"</SPAN><SPAN>:&nbsp;</SPAN><SPAN>StringType</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; })</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>null_out_problematic_columns</SPAN><SPAN>(df)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_location_detail</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_22-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15137i634E525787E56556/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_22-1740614786529.png" alt="JW_99_22-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCity</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.City</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiStateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.StateProvince</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiPostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.PostalCode</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCountry</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(EdiAddress) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress.Country</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddress</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine1</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.AddressLine2</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.City</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.StateProvince</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.PostalCode</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>when</SPAN><SPAN>(</SPAN><SPAN>expr</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>typeof(Address) = 'struct'</SPAN><SPAN>"</SPAN><SPAN>),&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address.Country</SPAN><SPAN>"</SPAN><SPAN>)).</SPAN><SPAN>otherwise</SPAN><SPAN>(</SPAN><SPAN>lit</SPAN><SPAN>(</SPAN><SPAN>None</SPAN><SPAN>))) \</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.</SPAN><SPAN>drop</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Address</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiAddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCity</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCity</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiStateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiStateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiPostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiPostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCountry</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>EdiCountry</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine1</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>AddressLine2</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>City</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>StateProvince</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>PostalCode</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Country</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>flatten_location_scores</SPAN><SPAN>(</SPAN><SPAN>df</SPAN><SPAN>,&nbsp;</SPAN><SPAN>file_path</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_23-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15135i5475FDA7282C6373/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_23-1740614786529.png" alt="JW_99_23-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>lit</SPAN><SPAN>(file_path.</SPAN><SPAN>split</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>/</SPAN><SPAN>"</SPAN><SPAN>)[</SPAN><SPAN>-</SPAN><SPAN>2</SPAN><SPAN>]).</SPAN><SPAN>cast</SPAN><SPAN>(</SPAN><SPAN>IntegerType</SPAN><SPAN>()))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;df.columns:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>withColumn</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>explode_outer</SPAN><SPAN>(</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpasses</SPAN><SPAN>"</SPAN><SPAN>)))</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN><SPAN>&nbsp;df.</SPAN><SPAN>select</SPAN><SPAN>(</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>LocationID</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CloseRatio</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>CloseRatio</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>NpsScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.Score</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>VpassScore</SPAN><SPAN>"</SPAN><SPAN>),</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>col</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>Vpass.IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>alias</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>IsAdminScore</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; )</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Define transformation mapping</SPAN></DIV><DIV><SPAN>transformation_mapping&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_accounting_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>AccountingSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_accounting_summary,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>InternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_internal_participants,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDates.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_dates,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobExternalParticipants.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_external_participants,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>JobTags.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_job_tags,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>SurveySummary.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_survey_summary,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LinkedAssignmentDetails.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_linked_assignments,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>NotesSummary.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_notes_summary,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_company_contacts,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>CompanyDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_company_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualContacts.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_individual_contacts,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>IndividualDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_individual_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_provider_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderScores.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_provider_scores,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>ProviderSuspensions.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_provider_suspensions,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationDetail.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_location_detail,</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"</SPAN><SPAN>LocationScores.JSON</SPAN><SPAN>"</SPAN><SPAN>: flatten_location_scores</SPAN></DIV><DIV><SPAN>}</SPAN></DIV><DIV><SPAN>transformation_mapping_bc&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;sc.</SPAN><SPAN>broadcast</SPAN><SPAN>(transformation_mapping)</SPAN></DIV><BR /><DIV><SPAN>#</SPAN><SPAN>&nbsp;Broadcast schemas (assuming schemas dict is defined elsewhere)</SPAN></DIV><DIV><SPAN>schemas_json&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;{k: v.</SPAN><SPAN>json</SPAN><SPAN>()&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;k, v&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;schemas.</SPAN><SPAN>items</SPAN><SPAN>()}&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>'</SPAN><SPAN>schemas</SPAN><SPAN>'</SPAN><SPAN>&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;</SPAN><SPAN>globals</SPAN><SPAN>()&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;{}</SPAN></DIV><DIV><SPAN>schemas_bc&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;sc.</SPAN><SPAN>broadcast</SPAN><SPAN>(schemas_json)</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_partition</SPAN><SPAN>(</SPAN><SPAN>partition</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_24-1740614786529.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15139i16737208325CD839/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_24-1740614786529.png" alt="JW_99_24-1740614786529.png" /></span><P>&nbsp;</P></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"""</SPAN><SPAN>Process a partition of JSON files inside worker nodes using the existing Spark session.</SPAN><SPAN>"""</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Use the global spark session (implicitly available via SparkContext on workers)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;row&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;partition:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; path, file_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;row[</SPAN><SPAN>"</SPAN><SPAN>path</SPAN><SPAN>"</SPAN><SPAN>], row[</SPAN><SPAN>"</SPAN><SPAN>file_name</SPAN><SPAN>"</SPAN><SPAN>]</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; folder_name&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;file_name.</SPAN><SPAN>replace</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>.JSON</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>""</SPAN><SPAN>).</SPAN><SPAN>replace</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>.json</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>""</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; output_path&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><SPAN>{</SPAN><SPAN>output_base_path</SPAN><SPAN>}</SPAN><SPAN>/</SPAN><SPAN>{</SPAN><SPAN>folder_name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Retrieve schema JSON from broadcast and convert to StructType</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; schema_json&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;schemas_bc.value.</SPAN><SPAN>get</SPAN><SPAN>(file_name)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; schema&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;StructType.</SPAN><SPAN>fromJson</SPAN><SPAN>(schema_json)&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;schema_json&nbsp;</SPAN><SPAN>else</SPAN><SPAN>&nbsp;</SPAN><SPAN>None</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>try</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Infer schema only if no predefined schema exists</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;schema&nbsp;</SPAN><SPAN>is</SPAN><SPAN>&nbsp;</SPAN><SPAN>None</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; inferred_df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.read.</SPAN><SPAN>option</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>inferSchema</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>true</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>json</SPAN><SPAN>(path, multiLine</SPAN><SPAN>=</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; schema&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;inferred_df.schema</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; raw_df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.read.</SPAN><SPAN>schema</SPAN><SPAN>(schema).</SPAN><SPAN>json</SPAN><SPAN>(path, multiLine</SPAN><SPAN>=</SPAN><SPAN>True</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Apply the appropriate transformation function</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; transform_func&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;transformation_mapping_bc.value.</SPAN><SPAN>get</SPAN><SPAN>(file_name)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;transform_func:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; raw_df&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>transform_func</SPAN><SPAN>(raw_df, path)</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Write to Parquet with optimization</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; raw_df.</SPAN><SPAN>coalesce</SPAN><SPAN>(</SPAN><SPAN>32</SPAN><SPAN>).write.</SPAN><SPAN>mode</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>append</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>partitionBy</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>JobID</SPAN><SPAN>"</SPAN><SPAN>).</SPAN><SPAN>parquet</SPAN><SPAN>(output_path)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_25-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15138i3164483962BB2499/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_25-1740614786526.png" alt="JW_99_25-1740614786526.png" /></span><P>&nbsp;</P><SPAN>&nbsp;Processed&nbsp;</SPAN><SPAN>{</SPAN><SPAN>file_name</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>except</SPAN><SPAN>&nbsp;</SPAN><SPAN>Exception</SPAN><SPAN>&nbsp;</SPAN><SPAN>as</SPAN><SPAN>&nbsp;e:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>f</SPAN><SPAN>"</SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JW_99_26-1740614786526.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/15141i1D28F639CC47D04A/image-size/medium?v=v2&amp;px=400" role="button" title="JW_99_26-1740614786526.png" alt="JW_99_26-1740614786526.png" /></span><P>&nbsp;</P><SPAN>&nbsp;Error processing&nbsp;</SPAN><SPAN>{</SPAN><SPAN>file_name</SPAN><SPAN>}</SPAN><SPAN>:&nbsp;</SPAN><SPAN>{</SPAN><SPAN>e</SPAN><SPAN>}</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><BR /><DIV><SPAN>def</SPAN><SPAN>&nbsp;</SPAN><SPAN>process_json_files_parallel</SPAN><SPAN>():</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>"""</SPAN><SPAN>Parallel processing of JSON files.</SPAN><SPAN>"""</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; json_files&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;</SPAN><SPAN>list_json_files</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>if</SPAN><SPAN>&nbsp;</SPAN><SPAN>not</SPAN><SPAN>&nbsp;json_files:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>print</SPAN><SPAN>(</SPAN><SPAN>"</SPAN><SPAN>No files to process.</SPAN><SPAN>"</SPAN><SPAN>)</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</SPAN><SPAN>return</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp; df_files&nbsp;</SPAN><SPAN>=</SPAN><SPAN>&nbsp;spark.</SPAN><SPAN>createDataFrame</SPAN><SPAN>([(path, os.path.</SPAN><SPAN>basename</SPAN><SPAN>(path))&nbsp;</SPAN><SPAN>for</SPAN><SPAN>&nbsp;path&nbsp;</SPAN><SPAN>in</SPAN><SPAN>&nbsp;json_files], [</SPAN><SPAN>"</SPAN><SPAN>path</SPAN><SPAN>"</SPAN><SPAN>,&nbsp;</SPAN><SPAN>"</SPAN><SPAN>file_name</SPAN><SPAN>"</SPAN><SPAN>])</SPAN></DIV><BR /><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>#</SPAN><SPAN>&nbsp;Repartition to match cluster cores (128) for maximum parallelism</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; df_files.</SPAN><SPAN>repartition</SPAN><SPAN>(</SPAN><SPAN>128</SPAN><SPAN>).rdd.</SPAN><SPAN>foreachPartition</SPAN><SPAN>(process_partition)</SPAN></DIV><BR /><DIV><SPAN>if</SPAN><SPAN>&nbsp;__name__&nbsp;</SPAN><SPAN>==</SPAN><SPAN>&nbsp;</SPAN><SPAN>"</SPAN><SPAN>__main__</SPAN><SPAN>"</SPAN><SPAN>:</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp;&nbsp;</SPAN><SPAN>process_json_files_parallel</SPAN><SPAN>()</SPAN></DIV><DIV><SPAN>&nbsp; &nbsp; spark.</SPAN><SPAN>stop</SPAN><SPAN>()</SPAN></DIV></DIV></DIV> Thu, 27 Feb 2025 00:08:38 GMT https://community.databricks.com/t5/data-engineering/pysparkruntimeerror-context-only-valid-on-driver/m-p/111342#M43852 JW_99 2025-02-27T00:08:38Z https://community.databricks.com/t5/data-engineering/pysparkruntimeerror-context-only-valid-on-driver/m-p/111345#M43854 <P>Heard of that SparkSession already reside in Spark Cluster which is Databricks compute resource.&nbsp; Instea of initializing that object, you can utilize that variable "spark" which is already in Cluster out there.&nbsp; It can be re-configured with othere settings.&nbsp;</P> Thu, 27 Feb 2025 02:13:15 GMT https://community.databricks.com/t5/data-engineering/pysparkruntimeerror-context-only-valid-on-driver/m-p/111345#M43854 haijian 2025-02-27T02:13:15Z https://community.databricks.com/t5/data-engineering/pysparkruntimeerror-context-only-valid-on-driver/m-p/111348#M43856 <P>You cannot use Spark session explicitly inside Executor logic. Here you are trying mapPartitions which makes the customlogic to get executed inside the executor thread. Either you need to change whole problem approach to segregate spark variable usage to outside of executor logic Or you can use python native functions /modules inside the Executor.&nbsp;</P> Thu, 27 Feb 2025 05:19:26 GMT https://community.databricks.com/t5/data-engineering/pysparkruntimeerror-context-only-valid-on-driver/m-p/111348#M43856 narasimha_reddy 2025-02-27T05:19:26Z