This document introduces the supported examples of GenAIExamples. The supported Vector Database, LLM models, serving frameworks and hardwares are listed as below. ## ChatQnA [ChatQnA](./ChatQnA/README.md) is an example of chatbot for question and answering through retrieval augmented generation (RAG).

Framework	LLM	Embedding	Vector Database	Serving	HW	Description
LangChain/LlamaIndex	NeuralChat-7B	BGE-Base	Redis	TGI TEI	Xeon/Gaudi2/GPU	Chatbot
LangChain/LlamaIndex	NeuralChat-7B	BGE-Base	Chroma	TGI TEI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	BGE-Base	Redis	TGI TEI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	BGE-Base	Qdrant	TGI TEI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Qwen2-7B	BGE-Base	Redis	TEI	Xeon/Gaudi2	Chatbot

### CodeGen [CodeGen](./CodeGen/README.md) is an example of copilot designed for code generation in Visual Studio Code.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	meta-llama/CodeLlama-7b-hf	TGI	Xeon/Gaudi2	Copilot

### CodeTrans [CodeTrans](./CodeTrans/README.md) is an example of chatbot for converting code written in one programming language to another programming language while maintaining the same functionality.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	HuggingFaceH4/mistral-7b-grok	TGI	Xeon/Gaudi2	Code Translation

### DocSum [DocSum](./DocSum/README.md) is an example of chatbot for summarizing the content of documents or reports.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	NeuralChat-7B	TGI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	TGI	Xeon/Gaudi2	Chatbot

### Language Translation [Language Translation](./Translation/README.md) is an example of chatbot for converting a source-language text to an equivalent target-language text.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	haoranxu/ALMA-13B	TGI	Xeon/Gaudi2	Language Translation

### SearchQnA [SearchQnA](./SearchQnA/README.md) is an example of chatbot for using search engine to enhance QA quality.

Framework	LLM	Serving	HW	Description
LangChain/LlamaIndex	NeuralChat-7B	TGI	Xeon/Gaudi2	Chatbot
LangChain/LlamaIndex	Mistral-7B	TGI	Xeon/Gaudi2	Chatbot

### VisualQnA [VisualQnA](./VisualQnA/README.md) is an example of chatbot for question and answering based on the images.

LLM	HW	Description
LLaVA-1.5-7B	Gaudi2	Chatbot

> **_NOTE:_** The `Language Translation`, `SearchQnA`, `VisualQnA` and other use cases not listing here are in active development. The code structure of these use cases are subject to change.