Create a chat generation Q&A application¶

You can create a chat generation Q&A application with DataRobot to explore knowledge base Q&A use cases while leveraging Generative AI to repeatedly make business decisions and showcase business value. Q&Aアプリは、構築したLLMモデルの結果をプロトタイプ化、調査、および共有するための直感的で応答性に優れた方法を提供します。 The Q&A app powers generative AI conversations backed by citations and allows you to provide feedback on responses. さらに、DataRobot以外のユーザーとアプリを共有して、使いやすさを広めることもできます。

Prepare a text generation deployment¶

To build a chat generation Q&A application, you must first prepare and configure a deployment. You need to create a deployment with a text generation target type.

Once you have created the deployment, you have the option to configure an external custom metric to collect feedback for the Q&A app's responses:

1. Access the deployment from the Console > Deployments page. Select the deployment and navigate to the Monitoring > Custom metrics tab.

   

2. Click Add new custom metric and select Add an external custom metric from the dropdown.

   

3. Configure the feedback metric as displayed in the screenshot below. When you have finished configuration, click Add custom metric.

   

4. Additionally, set up an association ID for the deployment in order to store submitted feedback (via the custom metric) with the associated prompt and response data. Without an association ID, the feedback custom metric is only able to store responses aggregated by time values.

5. After configuring the deployment with the appropriate custom metrics, note the deployment ID and custom metric ID. They are be used to build the chat generation Q&A application. To locate the custom metric ID, select the menu icon on the configured custom metric in the deployment and click Edit. The dialog box lists the metric ID.

   

Build a chat generation Q&A application¶

To build a chat generation Q&A app, use the following steps:

1. In the Registry, navigate to the Applications page and click Add > Create Chat generation Q&A template.

   

2. Select the text generation deployment configured previously, and provide the custom metric ID for the feedback metric.

   

3. After specifying a deployment and custom metric ID, click Create app. The application is added to the All applications list with the Initializing status. After it builds, you can click Open to view and use the application.

   

   備考

   アプリケーションタブでカスタムアプリケーションの横にあるアクションメニュー をクリックすると、アプリケーションの共有や削除ができます。

Use the chat generation Q&A application¶

To begin using the chat generation Q&A application, go to the Registry, locate your QA app in the Applications > All applications list, then click Open.

When the Q&A application loads, provide a prompt to initiate a chat. Allow some time for the app to run and return an answer to the prompt.

The app will respond with an answer. You can provide feedback for an application by selecting thumbs up or down for a prompt's response. Additionally, click Citations to view a dialog box that details the source(s) from which the application finds its answer to the prompt.

Manage the chat generation Q&A application¶

You can manage multiple Streamlit settings for the chat generation Q&A application. To access the settings, after opening the application, click the action menu in the top right corner.