All missing-QuestionPost posts

Re: Databricks slack channel

Oliver_Angelil — Thu, 19 Mar 2026 17:49:15 GMT

new link: https://join.slack.com/t/databricks-users/shared_invite/zt-3sz8g2on9-DV6BtHyIYIwTkmg4vJWQrg (never expires)

Re: Databricks slack channel

Oliver_Angelil — Thu, 19 Mar 2026 17:48:25 GMT

@Sachin61 https://join.slack.com/t/databricks-users/shared_invite/zt-3sz8g2on9-DV6BtHyIYIwTkmg4vJWQrg (never expires)

Re: Databricks slack channel

SeanLam — Thu, 19 Mar 2026 14:14:07 GMT

thanks for created this channel

Re: Databricks slack channel

Sachin61 — Thu, 19 Mar 2026 11:45:07 GMT

Please share the new link

@Oliver_Angelil old link not working

Re: Databricks slack channel

TomFielding — Mon, 18 Aug 2025 12:13:24 GMT

Hello,

Please can you share a new link to join the slack group?

Re: Databricks slack channel

josh__ — Thu, 12 Jun 2025 13:11:34 GMT

Hi . I'm Josh. I'd love to join the slack channel. Please let me know how. The links are expired.

Databricks Certification and Badge not received

abhisheksreddy1 — Wed, 26 Mar 2025 13:44:24 GMT

Hello, I passed DEA-C01 exam on March 25, 2025. I haven't received my certification or credentials yet. Can you please check?

Re: Databricks slack channel

Oliver_Angelil — Thu, 06 Jun 2024 11:14:18 GMT

@Yash use this link: https://join.slack.com/t/databricks-users/shared_invite/zt-277w1vbk2-Eo_TSv2FZpFLzuT_KaitJA

Re: Databricks slack channel

YashP — Thu, 06 Jun 2024 10:56:48 GMT

I joined with same email and it says try different emails. How do I join?

Re: Discrepancies between official spark 3.3.2 and what's provided in Databricks Runtime 12.2 LTS le

OsamaNabih — Thu, 11 Jan 2024 10:12:50 GMT

I ran into the same issue
Did you happen to find any fix?

Re: Databricks slack channel

Oliver_Angelil — Wed, 22 Nov 2023 05:45:05 GMT

UPDATE:

Changed workspace name to databricks-users. Click here to join https://databricks-users.slack.com

Or click this link (expires in 1 month)

Re: Databricks slack channel

Oliver_Angelil — Thu, 16 Nov 2023 19:25:43 GMT

The community manager has gotten back to me privately and said they see no need for a slack channel since the community forums are sufficient. I have therefore started my own "databricks-clients" slack workspace.

Please click this link to join it (note, this link expires after 30 days).

You should also be able to join by going to this link: https://databricks-clients.slack.com

And please spread the word. The dream would be to fill this workspace with thousands of Databricks users, and where we can share ideas / seek support / showcase our business use-cases.

@luanmenezes @YashP @karthik_p @pvignesh92

Re: Databricks slack channel

luanmenezes — Tue, 31 Oct 2023 15:41:35 GMT

Comment just to follow

Re: Databricks slack channel

YashP — Mon, 25 Sep 2023 15:09:57 GMT

Any update on Slack channel for Databrick?

Re: When creating a cluster, ERROR: "Missing required field 'spark_version'" even though i

Norway — Tue, 29 Aug 2023 13:38:47 GMT

Hi, Matt. Would be super useful if you could provide a more complete code example on how it worked.

Re: Databricks slack channel

Oliver_Angelil — Fri, 25 Aug 2023 08:35:24 GMT

kind reminder here @Retired_mod

Re: Databricks slack channel

Oliver_Angelil — Thu, 29 Jun 2023 20:27:45 GMT

@Retired_mod any update on this?

Discrepancies between official spark 3.3.2 and what's provided in Databricks Runtime 12.2 LTS leads to NoSuchMethodError when creating ParquetToSparkSchemaConverter

396827 — Fri, 23 Jun 2023 13:33:09 GMT

I am trying to run my spark-dependent application on a Databricks cluster:

spark-3.3.2
on a cluster with Databricks Runtime 12.2 LTS (spark-3.3.2, scala-2.12)

I end up with:

NoSuchMethodError: org.apache.spark.sql.execution.datasources.parquet.ParquetToSparkSchemaConverter$.$lessinit$greater$default$4()Z

It seems that the spark included in Databricks Runtime 12.2 LTS does not include the commit that changed the definition of ParquetToSparkSchemaConverter: https://issues.apache.org/jira/browse/SPARK-40819 (spark github: https://github.com/apache/spark/blame/a7bbaca013ad1ae92a437b12206fadfe93fea10f/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala#L58) . Anyway the difference can be spotted by comparing the release notes of both spark and Databricks Runtime:

Anyway, I investigated the case further and disassembled the class that comes with spark 3.3.2

```

Compiled from "ParquetSchemaConverter.scala"

public class org.apache.spark.sql.execution.datasources.parquet.ParquetToSparkSchemaConverter {

private final boolean assumeBinaryIsString;

private final boolean assumeInt96IsTimestamp;

private final boolean caseSensitive;

private final boolean nanosAsLong;

public static boolean $lessinit$greater$default$4();

Code:

0: getstatic #85 // Field org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.MODULE$:Lorg/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$;

3: invokevirtual #87 // Method org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.$lessinit$greater$default$4:()Z

6: ireturn

public static boolean $lessinit$greater$default$3();

Code:

0: getstatic #85 // Field org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.MODULE$:Lorg/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$;

3: invokevirtual #90 // Method org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.$lessinit$greater$default$3:()Z

6: ireturn

public static boolean $lessinit$greater$default$2();

Code:

0: getstatic #85 // Field org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.MODULE$:Lorg/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$;

3: invokevirtual #93 // Method org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.$lessinit$greater$default$2:()Z

6: ireturn

public static boolean $lessinit$greater$default$1();

Code:

0: getstatic #85 // Field org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.MODULE$:Lorg/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$;

3: invokevirtual #96 // Method org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.$lessinit$greater$default$1:()Z

6: ireturn

```

When check on the Databricks-provided jar:

```

Compiled from "ParquetSchemaConverter.scala"

public class org.apache.spark.sql.execution.datasources.parquet.ParquetToSparkSchemaConverter {

private final boolean assumeBinaryIsString;

private final boolean assumeInt96IsTimestamp;

private final boolean caseSensitive;

public static boolean $lessinit$greater$default$3();

Code:

0: getstatic #84 // Field org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.MODULE$:Lorg/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$;

3: invokevirtual #86 // Method org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.$lessinit$greater$default$3:()Z

6: ireturn

public static boolean $lessinit$greater$default$2();

Code:

0: getstatic #84 // Field org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.MODULE$:Lorg/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$;

3: invokevirtual #89 // Method org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.$lessinit$greater$default$2:()Z

6: ireturn

public static boolean $lessinit$greater$default$1();

Code:

0: getstatic #84 // Field org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.MODULE$:Lorg/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$;

3: invokevirtual #92 // Method org/apache/spark/sql/execution/datasources/parquet/ParquetToSparkSchemaConverter$.$lessinit$greater$default$1:()Z

6: ireturn

```

So in fact `public static boolean $lessinit$greater$default$4()` is NOT present.

Can someone confirm that this change is in fact expected? How should that be handled

Re: Init Script not 'Absolute'

alexiswl — Fri, 23 Jun 2023 08:59:38 GMT

Hi @Debayan

> Looks like it is not able to get the package from the repo.

Not sure what you mean by this?

I managed to resolve the issue (also couldn't find the log files after setting the logging to dbfs://cluster-logs/ which was strange).

In this case, I think had a sneaky space character before '/Workspace' which caused my issue.

After that resolved, I got an error saying that this path didn't exist.

My guess was that by selecting workspace in the destination settings dropdown menu, I was already in the /workspace directory.

Hence by using `/Repos/services+databricks@umccr.org/data-portal-analytics/notebooks/RPackagesToInstall.sh` instead I was able to run the init script successfully.

Is there any examples of init scripts when using repos available? I couldn't find any. This could be quite useful for others!

Alexis

Re: Init Script not 'Absolute'

Debayan — Fri, 23 Jun 2023 07:05:20 GMT

Hi, could you please enable init script logging and provide the elaborated logs here? Looks like it is not able to get the package from the repo.

https://docs.databricks.com/clusters/init-scripts.html#init-script-logging

Also, please tag @Debayan Mukherjee with your next update so that I will get notified.