log delivery are not creating data in s3 bucket
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-17-2024 12:54 PM - edited 04-17-2024 01:19 PM
Hiii, Does anyone have an idea about the typical duration for Databricks to create logs in an S3 bucket using the databricks_mws_log_delivery Terraform resource? I've implemented the code provided in the Databricks official documentation, but I've been waiting for the logs to appear in my bucket for over three hours.Knowing that the I am seeing the resource created and I have this msg when I ask for the status of the log delivery
{
"log_delivery_configuration": {
"account_id":"**************",
"config_id":"**************",
"config_name":"Usage Logs",
"creation_time":1713371829000,
"credentials_id":"**************",
"delivery_path_prefix":"",
"delivery_start_time":"2024-03",
"log_delivery_status": {
"message":"Log Delivery Configuration is successfully created. Status will be updated after the first delivery attempt.",
"status":"CREATED"
},
"log_type":"BILLABLE_USAGE",
"output_format":"CSV",
"status":"ENABLED",
"storage_configuration_id":"**************",
"update_time":1713371829000
}
}
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-19-2024 08:52 AM
The issue has been resolved. There was no problem with the code or the API. However, it took over 12 hours for logs to start appearing in my bucket, despite Databricks documentation indicating that logs should appear within 1 hour..
Thank you!

