Building LLM applications for production

A question that I���ve been asked a lot recently is how large language models (LLMs) will change MLOps workflows. After working with several companies who have adopted prompt engineering into their workflows and personally going down a rabbit hole building my applications, I realized two things:

It���s easy to make something cool with LLMs, but very hard to make something production-ready with them. LLM limitations are exacerbated by a lack of engineering rigor in prompt engineering, parti...