Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
assert verify_delta_format, "Data not written in Delta format"
assert verify_num_data_files > 0, "No data written"
del verify_files, verify_delta_format, verify_num_data_files
print("All test pass")
AssertionError Traceback (most recent call last) <command-1787238488083573> in <cell line: 11>() 9 10 assert verify_delta_format,"Data not written in Delta format"---> 11assert verify_num_data_files >0,"No data written" 12 del verify_files, verify_delta_format, verify_num_data_files 13 print("All test pass")AssertionError: No data written
verify_files = dbutils.fs.ls(productsOutputPath) verify_delta_format = False verify_num_data_files = 0 for f in verify_files: if f.name == '_delta_log/': verify_delta_format = True elif f.name.endswith('.parquet'): verify_num_data_files += 1
assert verify_delta_format, "Data not written in Delta format" assert verify_num_data_files > 0, "No data written" del verify_files, verify_delta_format, verify_num_data_files
Join 100K+ Data Experts: Register Now & Grow with Us!
Excited to expand your horizons with us? Click here to Register and begin your journey to success!
Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!