New Contributor III
since ‎05-09-2023
3 weeks ago

User Stats

  • 12 Posts
  • 1 Solutions
  • 5 Kudos given
  • 1 Kudos received

User Activity

To read Bigquery data using, i'm using a query. This query executes and creates a table on the materializationDataset. df ="bigquery") \.option("query", query) \.option("materializationProject", materializationProject) \...
I have a notebook where i want to use the workflow name and task name that it will be running under. How do i access these information?
I am trying to insert a record into Delta table using notebook written in python. This record has a timestamp column that should be blank initially, later i have a plan to update the timestamp value.How am i inserting the record: stmt_insert_audit_r...
I specify init scripts in my deployment.conf, as below: basic-static-cluster: &basic-static-cluster new_cluster: spark_version: "13.0.x-scala2.12" num_workers: 1 node_type_id: "n2-highmem-2" init_scripts: - worksp...