AiGatewayConfig non backward compatibly issue from 16.3 to 16.4

Administration & Architecture

Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.

We're moving form version 16.3 to version 16.4 LTD, and looks like there is a non backward compatibly issue.

This is the import that I have in my code

from databricks.sdk.service.serving import (   # type: ignore # noqa
    ServedModelInput,   # type: ignore # noqa
    EndpointCoreConfigInput,   # type: ignore # noqa
    TrafficConfig,   # type: ignore # noqa
    Route,   # type: ignore # noqa
    AiGatewayConfig,   # type: ignore # noqa
    AiGatewayInferenceTableConfig,   # type: ignore # noqa
)   # type: ignore # noqa

After the move in my model mosaic code I have this error

ImportError: cannot import name 'AiGatewayConfig' from 'databricks.sdk.service.serving' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/service/serving.py)