cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
deng_dev
New Contributor III
since ‎11-27-2023
Thursday

User Stats

  • 13 Posts
  • 1 Solutions
  • 4 Kudos given
  • 3 Kudos received

User Activity

Databricks AutoLoader IncrementalListing mode changes

Thursday
Hi everyone!I wan investigating how Databricks AutoLoader IncrementalListing mode changes will impact my current autoloader streams. Currently all of them are set to cloudFiles.useIncrementalListing: auto. So I wanted to check if any of streams is ac...

Databricks Apps pricing

11-07-2025
Hi everyone!I was investigating Databricks Apps as solution for my task and didn't fully understood pricing.I have found this page and it indicates it will cost 75$ / DBU for Premium subscription plan when using AWS cloud. Is it full cost or will the...

Autoloader: Cross-account bucket Assume role access denied

02-06-2025
 Hi everyone!I have a Databricks instance profile role that has permission to assume a role in another AWS account to access an S3 bucket in that account.When I try to assume the role using boto3, it correctly reads the Databricks AWS credentials, as...

Autoloader File Notifications mode S3 Access Denied error

08-23-2024
Hi everyone!We are reading json files from cross-account S3 bucket using Autoloader and decided to switch from directory listing mode to files notification mode.We have set up all permissions mentioned here in our IAM role. But now the pipeline is fa...

Autoloader ignore one folder in path

05-21-2024
Hi everyone!I am trying to setup Autoloader to read json file with specific name from all subfolders under the path except one.Could someone advice how this can be achieved? For example, I need to read from .../*/specific_name.json, but ignore test f...
View more