cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

how to create a scala jar using db notebook and save it in a file path inside databricks

swatish0395
New Contributor III

I have scala function as below, i am unable to understand how to write a scala jar with the same,

please find below code i have used Enforcing Column-Level Encryption - Databrick

%scala

import com.macasaet.fernet.{Key, StringValidator, Token}

import org.apache.hadoop.hive.ql.exec.UDF;

import java.time.{Duration, Instant};

class Validator extends StringValidator {

 override def getTimeToLive() : java.time.temporal.TemporalAmount = {

  Duration.ofSeconds(Instant.MAX.getEpochSecond());

 }

}

class udfDecrypt extends UDF {

 def evaluate(inputVal: String, sparkKey : String): String = {

  if( inputVal != null && inputVal!="" ) {

   val keys: Key = new Key(sparkKey)

   val token = Token.fromString(inputVal)

   val validator = new Validator() {}

   val payload = token.validateAndDecrypt(keys, validator)

   payload

  } else return inputVal

 }

}

please tell ema solution to create a jar with the above scala function inside DB notebook

#Scalaโ€‹ #DBnotebookโ€‹ #Jarsโ€‹ #[Jar Scala]โ€‹ 

1 ACCEPTED SOLUTION

Accepted Solutions

swatish0395
New Contributor III

I had to finally create the jar using teh intellij and sbt iconfiguration on the same env. and then installed the jar in the cluster it worked

View solution in original post

3 REPLIES 3

-werners-
Esteemed Contributor III

for a jar you need to build it (using SBT for example). Notebooks are not able to do that.

I create jars in IntelliJ with SBT.

What you can do is not using a jar at all but use package cells.

However I do not think those are used a lot because a while ago I asked a question on the forum who uses package cells and nobody confirmed they did.

Anonymous
Not applicable

Hi @swati sharmaโ€‹ 

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance! 

swatish0395
New Contributor III

I had to finally create the jar using teh intellij and sbt iconfiguration on the same env. and then installed the jar in the cluster it worked

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group