cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Mathias_Peters
Contributor II
since ‎01-12-2024
Wednesday

User Stats

  • 27 Posts
  • 2 Solutions
  • 5 Kudos given
  • 7 Kudos received

User Activity

Avoid AWS SDK 1.x dependencies in cluster classpaths

2 weeks ago
Hi, As part of an AWS well architected review, we received a recommendation to stop using AWS SDK 1.x since this version has been deprecated since end of 2025. A cloud trail search showed that this lib is still in use in our data AWS accounts. In the...

Question on how to properly write a dataset of custom objects to MonogDB

11-23-2025
Hi, I am implementing a Spark Job in Kotlin (unfortunately a must-have) which reads from and writes to MongoDB. The reason for this is to reuse existing code in a MapFunction. The result of applying that map is a DataSet of type Consumer, a custom ob...

Streamed DLT Pipeline using a lookup table

11-20-2025
Hi, I need to join three streams/streamed data sets in a DLT pipeline. I am reading from a Kinesis data stream a sequence of events per group key. The logically first of the events per group contains a marker which determines whether that group is re...

Reading MongoDB collections into an RDD

11-03-2025
Hi, for a Spark job which does some custom computation, I need to access data from a MongoDB collection and access the elements as of type Document. The reason for this is, that I want to apply some custom type serialization which is already implemen...

Is there a way to use name prefixes for asset bundle deployments to prevent collisions

10-09-2024
Hi, we are using asset bundles to deploy artefacts in Databricks. We use a service account and github workflows for that. Currently, we deploy in dev mode whenever a PR is created against the main branch of our gh repo. So far so good. However, we ar...
View more