cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
AmanSehgal
Honored Contributor III
since ‎02-10-2022
‎11-13-2025

User Stats

  • 155 Posts
  • 23 Solutions
  • 25 Kudos given
  • 171 Kudos received

User Activity

Column Name Case sensitivity in DLT pipeline

05-18-2025
I've a DLT pipeline that processes messages from event grid. The schema of the message has two columns in different cases - "employee_id" and  "employee_ID",I tried setting spark.sql.caseSensitive to true in my DLT notebook as well in DLT configurati...

Job cluster vs All purpose cluster

12-15-2022
Environment: AzureI've a workflow that takes approximately a minute to execute and I want to run the job every 2 minutes.. All purpose cluster:On attaching all purpose cluster to the job, it takes approx. 60 seconds to execute.Using job cluster:On at...

How concurrent runs in a job matches to cluster configuration?

07-14-2022
In databricks jobs, there's a field to add concurrent runs which can be set to 1000.If I've a cluster with 4 worker nodes and 8 cores each, then at max how many concurrent jobs I'll be able to execute?What will happen if I launch 100 instances of sam...

Error on using Databricks Account API - invalid endpoint

05-09-2022
I'm trying to configure audit logs for databricks and as a part of it I need to configure S3 storage using endpoint storage-configurations.But for some reason I'm getting invalid endpoint. I'm using following URL with basicAuth.https://accounts.cloud...

How to merge all the columns into one column as JSON?

04-26-2022
I have a task to transform a dataframe. The task is to collect all the columns in a row and embed it into a JSON string as a column.Source DF:Target DF: 
View more