inference table not working

YanivShani · ‎01-10-2024

Hi,

I'm trying to enable inference table for my llama_2_7b_hf serving endpoint, however I'm getting the following error:

"Inference tables are currently not available with accelerated inference."

Anyone one have an idea on how to overcome this issue?

Cheers