Databricks Community

ManojkMohan

Use Case:I want to expose a data bricks API URL in Salesforce, Salesforce will hit that exposed end point every time a record is created and data will be transferred from Salesforce to DatabricksWhen i try creating a serving end pointI am unable to s...

ManojkMohan · 09-19-2025

AskCan we get a UC catalog (like prod or genie) in free edition of data bricks ?Problem i am solving:Structuring Data in Databricks before sending customer, account data to salesforceissue:cannot see workspace-local tables (workspace.default.structur...

ManojkMohan · 09-16-2025

Use Case:Converting unstructured data from PDF to structured format before sending to SalesforceAsk:Best practices to structure my table better before sending to a system like salesforceOutput in structured format looks like: My code:Extract Tables f...

ManojkMohan · 09-13-2025

Use Case:Kafka real time steaming network telemetry logsIn a real use case approx. 40 TB of data can be real time streamed in a dayArchitecture:issue encountered: when i try to simulate kakfa like streaming in databricks itself , as this is a free e...

ManojkMohan · 09-08-2025

Problem i am solving:Upload PDF → available in /Volumes/<catalog>/<schema>/<volume>/.Extract text with pdfplumber (or OCR if scanned).Store in Delta table for governance.Parse intelligently using:ai_query() with Databricks LLMs for flexible JSON outp...

ManojkMohan

@DE5 Some recent updates moved comparison features into the SQL Editor side panel or rely on “Cell Actions,” where you can generate code or format it and then see differences before applying changeshttps://www.databricks.com/blog/introducing-new-sql-...

ManojkMohan

@Y_WANG The root cause of the AttributeError you face when importing assertDataFrameEqual from pyspark.testing in Spark 3.5 is due to Spark's code using the deprecated np.NaN attribute, which was removed in NumPy 2.0 (replaced by np.nan). This break...

ManojkMohan

@databricksero 1) What changed between CLI versions 0.274.0 and 0.276.0 that causes this validation error?The CLI dropped support for open-source Spark Declarative Pipelines and now fully supports only Lakeflow Declarative Pipelines. This means conf...

ManojkMohan

@jorperort Merging your composite PK columns into a single column primary key would not inherently eliminate the concurrency or retry conflicts causing duplicates if multiple distributed Spark partitions are retrying the same record inserts independe...

ManojkMohan

@jorperort Creating and using a staging table followed by a MERGE operation in SQL Server is considered the best practice especially when working with distributed systems like Sparkthe issue often arises not from duplicates in the DataFrame itself bu...

Databricks Community

User Stats

User Activity

Exposing Databricks API in Salesforce

Databricks ro Salesforce | Unity Catalog Query

Parsing from PDF to a Structured Table | Looking for best practies

Simulating Real Time Streaming in Databricks free edition

Extracting PDFs and using AI queries | best practices

Re: Unable to see the Assistant suggested code and current code side by side

Re: Want to use DataFrame equality functions but also Numpy >= 2.0

Re: Databricks Bundle Validation Error After CLI Upgrade (0.274.0 → 0.276.0)

Re: Spark JDBC Write Fails for Record Not Present - PK error

Re: Spark JDBC Write Fails for Record Not Present - PK error