Tuesday
Hi community experts,
I am getting error "cannot import name 'recon' from 'databricks.labs.lakebridge.reconcile.execute'" importing modules as shown in attached screenshot. I am follwing steps as mentioned in your partner training module "Lakebridge for SQL Source System Migration". Please help to resolve this issue.
Tuesday
Hi @shubham007 ,
They made refactoring to that module in last month so that's why it stopped working. Probably Lakebridge for SQL Source System Migration module was recorded before that change.
And why they made change? It is explained here:
Split recon execute into smaller modules (#1892) ยท databrickslabs/lakebridge@7caba7a ยท GitHub
So now the correct way to use this module is like this:
from databricks.labs.lakebridge import __version__
from databricks.sdk import WorkspaceClient
from databricks.labs.lakebridge.reconcile.trigger_recon_service import TriggerReconService
from databricks.labs.lakebridge.reconcile.exception import ReconciliationException
ws = WorkspaceClient(product="lakebridge", product_version=__version__)
try:
result = TriggerReconService.trigger_recon(
ws = ws,
spark = spark, # notebook spark session
table_recon = table_recon, # previously created
reconcile_config = reconcile_config # previously created
)
print(result.recon_id)
print(result)
except ReconciliationException as e:
recon_id = e.reconcile_output.recon_id
print(f" Failed : {recon_id}")
print(e)
except Exception as e:
print(e.with_traceback)
raise e
print(f"Exception : {str(e)}")
Thursday
Hi community experts,
I am getting error while Data and Schema Validation with the Reconciler. As attached here screenshots. Please help resolve this issue.
Output:
Thursday
Thursday
Regarding which configuration ? I have created scope and secrets correctly. You mean about โdatabricks labs Lakebridge configure-reconcileโ ?
Thursday
I think you have mistake in your config file. Do you have a NONE catalog? I guess you don't have, so something went wrong during configuration phase:
NONE.SalesLT.customer
Did you follow this guide?
Reconcile Guide | Lakebridge
Thursday - last edited Thursday
I am following that guide only. My recon_config_file as below:
and given below parameters while configuring reconcile:
Thursday
Could you send me link to a guide you're using? I'll try to recreate your scenario then
Thursday - last edited Thursday
https://databrickslabs.github.io/lakebridge/docs/reconcile/
My Azure SQL DB:
connection string: jdbc:sqlserver://sqldb.database.windows.net:1433;database=sqldb;user=sqladmin@sqldb;password={your_password_here};encrypt=true;trustServerCertificate=false;hostNameInCertificate=*.database.windows.net;loginTimeout=30;
Target-Databricks:
here need to migrate tables:
Thursday
Hi @szymon_dybczak , which type of .sql scripts are required for migration such as legacy metadata and INSERT scripts to populate data in respective tables ?
Passionate about hosting events and connecting people? Help us grow a vibrant local communityโsign up today to get started!
Sign Up Now