How to benchmark LLMs deployed on Amazon SageMaker

Learn how to benchmark LLMs on Amazon SageMaker endpoints. We will be benchmarking Llama 2 13B chat model on Amazon SageMaker Endpoint using awscurl.
 •  0 comments  •  flag
Share on Twitter
Published on November 23, 2023 12:45
No comments have been added yet.