How to build LLM-based product

If you are considering building an LLM-powered product, such as customer support, internal document search, or a conversational assistant, how do you implement them? In this talk, I will review the basic components and the product pipeline. I will review the options of building in-house (using Llama 2) or using third-party solutions (such as ChatGPT). Another major component is semantic search or document retrieval. I will review both in house and third-party to this problem. By the end of this talk, you will gain a clear overview of LLM product pipeline, and understand where your skill can be best applied.

Speaker: JunLing Hu, Coach.ai