cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

log delivery are not creating data in s3 bucket

Olfa_Kamli
New Contributor II

Hiii, Does anyone have an idea about the typical duration for Databricks to create logs in an S3 bucket using the databricks_mws_log_delivery Terraform resource? I've implemented the code provided in the Databricks official documentation, but I've been waiting for the logs to appear in my bucket for over three hours.Knowing that the I am seeing the resource created and I have this msg when I ask for the status of the log delivery

 

{
  "log_delivery_configuration": {
    "account_id":"**************",    
    "config_id":"**************",
    "config_name":"Usage Logs",
    "creation_time":1713371829000,
    "credentials_id":"**************",
    "delivery_path_prefix":"",
    "delivery_start_time":"2024-03",
    "log_delivery_status": {
      "message":"Log Delivery Configuration is successfully created. Status will be updated after the first delivery attempt.",
      "status":"CREATED"
    },
    "log_type":"BILLABLE_USAGE",
    "output_format":"CSV",
    "status":"ENABLED",
    "storage_configuration_id":"**************",
    "update_time":1713371829000
  }
}

 

 

 

 

1 REPLY 1

Olfa_Kamli
New Contributor II

The issue has been resolved. There was no problem with the code or the API. However, it took over 12 hours for logs to start appearing in my bucket, despite Databricks documentation indicating that logs should appear within 1 hour..
Thank you!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group