cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
cancel
Showing results for 
Search instead for 
Did you mean: 

log delivery are not creating data in s3 bucket

k2
New Contributor II

Hiii, Does anyone have an idea about the typical duration for Databricks to create logs in an S3 bucket using the databricks_mws_log_delivery Terraform resource? I've implemented the code provided in the Databricks official documentation, but I've been waiting for the logs to appear in my bucket for over three hours.Knowing that the I am seeing the resource created and I have this msg when I ask for the status of the log delivery

 

{
  "log_delivery_configuration": {
    "account_id":"**************",    
    "config_id":"**************",
    "config_name":"Usage Logs",
    "creation_time":1713371829000,
    "credentials_id":"**************",
    "delivery_path_prefix":"",
    "delivery_start_time":"2024-03",
    "log_delivery_status": {
      "message":"Log Delivery Configuration is successfully created. Status will be updated after the first delivery attempt.",
      "status":"CREATED"
    },
    "log_type":"BILLABLE_USAGE",
    "output_format":"CSV",
    "status":"ENABLED",
    "storage_configuration_id":"**************",
    "update_time":1713371829000
  }
}

 

 

 

 

1 REPLY 1

k2
New Contributor II

The issue has been resolved. There was no problem with the code or the API. However, it took over 12 hours for logs to start appearing in my bucket, despite Databricks documentation indicating that logs should appear within 1 hour..
Thank you!