Hey @HarishKumarM , I did some digging and found some helpful information to help you troubleshoot.
What the error means
Your workspace isn’t currently enrolled in the Zerobus Ingest preview. Even though Zerobus is labeled a Public Preview, it’s still gated. Workspaces have to be explicitly enrolled by Databricks before the SDK is allowed to create a stream.
That’s exactly why you’re seeing: “The workspace is not enrolled in Zerobus gated preview.”
Enrollment is handled per workspace through Databricks’ Preview Portal (an internal workflow). Until your specific workspace ID is approved and enrolled, Zerobus endpoints will consistently return UNAUTHENTICATED at stream creation time — which matches the behavior you’re hitting.
You can reach out to your account team to see if you can get enrolled in the program.
Hope this helps, Louis.