Python custom Logging on Databricks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-21-2023 01:43 AM
I am planning to introduce a custom logging to the databricks workload. To achieve this I am using a python logging module. I am storing logs in driver memory "file:/tmp/" directory before I move those logs to blob storage. In my personal databricks account, I am able to list the files in "file:/tmp/" directory and can see my log file and the logs written on that file using dbutils.fs.head("path_to_file"). But when I try to implement the similar logic in client workspace, I am getting an exception.
"java.lang.SecurityException: User does not have permission SELECT on any file."
How to resolve this issue?
- Labels:
-
Logging
-
Python
-
Security Exception
![](/skins/images/F150478535D6FB5A5FF0311D4528FC89/responsive_peak/images/icon_anonymous_profile.png)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-21-2023 09:30 PM
Hi @MARKSACHIN K
Great to meet you, and thanks for your question!
Let's see if your peers in the community have an answer to your question. Thanks.
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/582998B45490C7019731A5B3A872C751/responsive_peak/images/icon_anonymous_message.png)