stevomcnevo007
New Contributor III

Just wanted to add some clarity on this issue that might shine some light regarding the issue, i've tried setting up multiple models including the Databricks 'dbdemos', 'llm-tag-chatbot' examples and it's resulted in the same directory issues around agents.deploy() 

  1. Model Details:

    • What is the exact model name and version you’re trying to deploy?
      - The model is called egg_chat and version 12 at the moment but i've been trying the right version throughout
    • Is the model registered under Unity Catalog or the workspace's default model registry?
      - The model is registered in the Unity Catalog 'My organization' under the 'main' folder, I've tried switching the workspace default catalog to main but the problem still persists  
  2. Cluster/Endpoint Setup:

    • Are you using a specific cluster mode (e.g., serverless, shared, or single-user)?
      - Workspace is setup using 'Default Compute and storage' advanced option when creating workspace 
    • Is the llm_endpoint (databricks-meta-llama-3-3-70b-instruct) accessible and correctly set up for your workspace?
      - Yes, everything is working fine when using Playground
  3. Error Message Context:

    • Can you confirm where the deployment is failing (e.g., during agents.deploy or a related step)?
      - failing at agents.deploy() due to directory access issue
    • Share the full error message (or stack trace) if possible, as it can provide more insight.
      - This is the error message from the dbdemos example but it's the same error for the egg_chat notebook:

      RestException:
      NOT_FOUND: The directory being accessed is not found.
      File <command-2153827424805746>, line 5 2 print(MODEL_NAME_FQN) 3 # Deploy to enable the Review APP and create an API endpoint 4 # Note: scaling down to zero will provide unexpected behavior for the chat app. Set it to false for a prod-ready application. ----> 5 deployment_info = agents.deploy("rag_chatbot.basic_rag_demo", model_version=uc_registered_model_info.version, scale_to_zero=True) 7 instructions_to_reviewer = f"""## Instructions for Testing the Databricks Documentation Assistant chatbot 8 9 Your inputs are invaluable for the development team. By providing detailed feedback and corrections, you help us fix issues and improve the overall quality of the application. We rely on your expertise to identify any gaps or areas needing enhancement.""" 11 # Add the user-facing instructions to the Review App
  4. Config File Alignment:

    • Does the config.yml align with the actual model location in the registry? For example, is main.egg_shop.* referencing the correct schema for viable_test.default.egg_chat?
      viable_test.default.egg_chat does not exist, this is the issue I believe