2 weeks ago
Hi there,
What kind of source and target paths can I use in Transpile command?
I'm trying to run command:
databricks labs lakebridge transpile --source-dialect tsql --input-source
and I get error:
ERROR [src/databricks/labs/lakebridge.transpile] ValueError: Invalid path for '--input-source', does not exist XXX
Error: unexpected end of JSON input
I tried using dbfs paths as well as my local paths, and it didn't work.
2 weeks ago - last edited 2 weeks ago
Hi @Fikrat ,
First of all make sure that you're using newest version of databricks lakebridge. In newest version --source-dialect supports following values:
- datastage
- informatica (desktop edition)
- informatica cloud
- mssql (your case)
- netezza
- oracle
- synapse
- teradata
Now, --input-source argument expect absolute path to a file that contains sql to transpile.
In my case, I've installed lakebridge on my PC following official guide. Here's how I executed command. It worked without any issue.
Here's a status of successful transpilation process:
Official guide:
Transpile Guide | Lakebridge
2 weeks ago
Excellent, would you be able to provide a sample code or any reference material on that?
2 weeks ago - last edited 2 weeks ago
Hi @Fikrat ,
First of all make sure that you're using newest version of databricks lakebridge. In newest version --source-dialect supports following values:
- datastage
- informatica (desktop edition)
- informatica cloud
- mssql (your case)
- netezza
- oracle
- synapse
- teradata
Now, --input-source argument expect absolute path to a file that contains sql to transpile.
In my case, I've installed lakebridge on my PC following official guide. Here's how I executed command. It worked without any issue.
Here's a status of successful transpilation process:
Official guide:
Transpile Guide | Lakebridge
2 weeks ago
Thanks, @szymon_dybczak , that resolved my initial problem and I was able to run command fine. Is it possible to run Transpile from notebook as well? The official document includes example of using Reconcile from notebook, but not sure about Transpile.
Thanks!
2 weeks ago
Hi @Fikrat ,
Great that it worked for you ๐ And yes, I think it should work from notebook as well
2 weeks ago
Excellent, would you be able to provide a sample code or any reference material on that?
2 weeks ago
Basically, follow the same steps as in guide to which I've shared a link above. If you will have trouble with installation, let me know and tomorrow I can try to create it on my databricks instance ๐
2 weeks ago
I didn't find any info on usage of Transpiler classes from python in that guide, that's why asked. But it's okay if you don't have answers. This product is new and documentation they provided is scarce, so hopefully they add more materials soon.
Thanks!
2 weeks ago
Also, what cloud source locations are available for Transpile- dbfs, Unity Catalog volumes, etc?
Passionate about hosting events and connecting people? Help us grow a vibrant local communityโsign up today to get started!
Sign Up Now