topic Re: conversion of code from scala to python in Data Engineering

conversion of code from scala to python

vanshikagupta — Wed, 09 May 2018 15:19:30 GMT

does databricks community edition provides with databricks ML visualization for pyspark, just the same as provided in this link for scala. https://docs.azuredatabricks.net/_static/notebooks/decision-trees.html

also please help me to convert this line of code to python as i am new to python and have no knowledge of scala. "val tree = model.stages.last.asInstanceOf[DecisionTreeClassificationModel]

display(tree)"

Thank you in advance!

Re: conversion of code from scala to python

miklos — Wed, 09 May 2018 15:29:47 GMT

Yes, CE supports it.

It isn't supported in python yet.

Re: conversion of code from scala to python

vanshikagupta — Wed, 09 May 2018 23:54:21 GMT

Thank you! but just a small query, i read in a post of 2015 that the visualizations are not supported in python, but uptill now should'nt pyspark support them?

Re: conversion of code from scala to python

thelogicplus — Sat, 14 Dec 2024 18:15:23 GMT

you may explore the tool and services from Travinto Technologies . They have very good tools. We had explored their tool for our code coversion from Informatica, Datastage and abi initio to DATABRICKS , pyspark. Also we used for SQL queries, stored procedure, trigger, cursor etc.