DLT - Importing Python Package
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-07-2024 04:05 PM
Hello,
I'm creating a DLT pipeline where I read a Kafka stream, perform transformations using UDFs, and save the data in multiple tables. When I define the functions directly in the same notebook, the code works fine. However, if I move the code into a Python file and try to import it as a package, the pipeline fails with the following error:
I've tried renaming the files and changing their locations -although the pipeline and the package are in the same directory-
Despite these efforts, nothing worked. Here is how I'm trying to import the module:
Any insights or solutions would be greatly appreciated!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-08-2024 05:00 AM - edited 08-08-2024 05:01 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-08-2024 10:14 AM - edited 08-08-2024 10:16 AM
yes, I did, the pipeline would work for seconds and then fails with the same error "No module named 'eventlog_utils'". And that's why it's confusing because I tried this on another pipeline with different setup/functions and it works fine!

