GenAIExamples/supported_examples.md

Supported Examples

This document introduces the supported examples of GenAIExamples. The supported Vector Database, LLM models, serving frameworks and hardwares are listed as below.

ChatQnA

ChatQnA is an example of chatbot for question and answering through retrieval augmented generation (RAG).

Framework	LLM	Embedding	Vector Database	Serving	HW	Description
LangChain/LlamaIndex	NeuralChat-7B	BGE-Base	Redis	TGI TEI	Xeon/Gaudi2/GPU	Chatbot
LangChain/LlamaIndex	NeuralChat-7B	BGE-Base	Chroma	TGI TEI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	BGE-Base	Redis	TGI TEI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	BGE-Base	Qdrant	TGI TEI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Qwen2-7B	BGE-Base	Redis	TEI	Xeon/Gaudi2	Chatbot

CodeGen

CodeGen is an example of copilot designed for code generation in Visual Studio Code.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	meta-llama/CodeLlama-7b-hf	TGI	Xeon/Gaudi2	Copilot

CodeTrans

CodeTrans is an example of chatbot for converting code written in one programming language to another programming language while maintaining the same functionality.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	HuggingFaceH4/mistral-7b-grok	TGI	Xeon/Gaudi2	Code Translation

DocSum

DocSum is an example of chatbot for summarizing the content of documents or reports.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	NeuralChat-7B	TGI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	TGI	Xeon/Gaudi2	Chatbot

Language Translation

Language Translation is an example of chatbot for converting a source-language text to an equivalent target-language text.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	haoranxu/ALMA-13B	TGI	Xeon/Gaudi2	Language Translation

SearchQnA

SearchQnA is an example of chatbot for using search engine to enhance QA quality.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	NeuralChat-7B	TGI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	TGI	Xeon/Gaudi2	Chatbot

VisualQnA

VisualQnA is an example of chatbot for question and answering based on the images.

LLM	HW	Description
LLaVA-1.5-7B	Gaudi2	Chatbot

NOTE: The Language Translation, SearchQnA, VisualQnA and other use cases not listing here are in active development. The code structure of these use cases are subject to change.