This article explains the AI Provider settings in Brilliant Assessments. It covers how to switch your AI interactions from Azure OpenAI to Anthropic Claude on Amazon Bedrock, how to upload reference documents that ground the platform's AI features, and how to associate those documents with individual assessments.
By default, Brilliant Assessments uses Azure OpenAI for all AI interactions. Enabling AWS Bedrock + RAG routes those interactions to Anthropic Claude on Amazon Bedrock and unlocks document-grounded responses. RAG stands for Retrieval Augmented Generation, a technique in which the AI retrieves relevant passages from your uploaded documents and uses them as source material when generating output.
Tip: Use AWS Bedrock + RAG when you want AI features to answer from your own source material (for example a methodology, a framework, or a book you have written) rather than from general knowledge. It also provides improved handling of large AI queries.
On this page
1. What AWS Bedrock and RAG provide
Enabling AWS Bedrock + RAG changes two things about how your site uses AI.
- Provider. AI interactions are routed to Anthropic Claude on Amazon Bedrock instead of Azure OpenAI.
- Document grounding. You may upload reference documents that the platform's AI features draw on as source material. When a document is associated with an assessment, the AI answers primarily from that document.
This setting is configured per site and applies across the platform once enabled.
2. Which AI features use uploaded documents
Once AWS Bedrock + RAG is enabled and documents are associated with an assessment, the following AI features may use those documents as grounding material:
- AI Build (the Builder Assistant). Building sections, subsections, and questions from your source material. Read more about Designing Assessments Using AI Build.
- AI Interpret. Generating interpretive feedback text for reports. Read more about Creating AI Interpret for Reports.
- AI Discuss. Generating discussion content for the results dashboard. Read more about Creating AI Discuss for Results Dashboard.
When writing the prompt for any of these features, you may direct the AI to a specific part of a document (for example a particular chapter or section) to focus the output. For guidance on prompt wording, see Writing Effective AI Interpret Prompts.
3. Enable AWS Bedrock + RAG
- Navigate to Site Settings > Integrations > AI Provider.
- Select the Use AWS Bedrock + RAG checkbox.
- Save your settings.
Once enabled, your AI interactions are routed to Anthropic Claude on Amazon Bedrock, and the Upload panel becomes available on the same tab.
Note: Switching the AI provider affects how AI features generate output across your site. If you have existing AI Interpret content, AI Discuss content, or AI-built assessment material, review the output after enabling to confirm it still meets your expectations.
4. Upload reference documents
Use the Upload panel on the AI Provider tab to add the documents you want AI features to use as grounding material.
- In the Upload panel, click Choose File.
- Select a document from your computer.
- Click Upload.
The document is sent to Amazon Bedrock for ingestion and appears in the document list below the panel.
Supported file types: PDF, DOCX, TXT, MD, and HTML.
Note: Excel files are not supported at this time.
You may upload many documents. There is no practical limit on the number of reference documents you can add.
5. Confirm a document is indexed
After upload, Amazon Bedrock ingests the document. A document is only available for AI retrieval once its Status shows Indexed.
- Locate the document in the list below the Upload panel.
- Review the Status column.
- If the status is not yet Indexed, click Refresh status to update it.
The document list displays the file name, type, size, status, upload date, and the user who uploaded it.
Note: Indexing is not instantaneous. If a newly uploaded document is not yet indexed, wait a short time and click Refresh status again.
6. Associate documents with an assessment
Uploading a document makes it available to your site, but each assessment must specify which documents it should use. You associate documents from the assessment itself.
- Open the assessment and navigate to Assessment Settings.
- Select the Options tab. Read more about the Options Tab.
- Locate the AI Project Documents section near the bottom of the tab.
- Select the checkbox beside each document this assessment should use.
- Click Save associations.
Note:
- The AI Project Documents section only appears when AWS Bedrock + RAG (Anthropic) is enabled for your site.
- Only documents in the Indexed state can be associated with an assessment. If a document you uploaded does not appear in the list, confirm its status is Indexed on the AI Provider tab (see Confirm a document is indexed).
Once associated, the assessment's AI features (AI Build, AI Interpret, and AI Discuss) draw primarily on the selected documents. For example, if you have written a book and uploaded it, you may associate it with one assessment or with several, and the AI will answer the assessment's questions primarily from that source material.
7. Manage and remove documents
You may remove a document at any time from the document list on the AI Provider tab.
- Locate the document in the list.
- Click Delete in the Actions column.
Removing a document makes it unavailable for future AI retrieval. Review any assessments that referenced the document to confirm their AI features still produce the output you expect.
FAQs & Troubleshooting
Use the questions below to troubleshoot common setup issues.
Related Articles
- Designing Assessments Using AI Build - Building sections, subsections, and questions with AI.
- Creating AI Interpret for Reports - Generating interpretive feedback text for reports.
- Creating AI Discuss for Results Dashboard - Generating discussion content for the results dashboard.
- Writing Effective AI Interpret Prompts - Guidance on prompt wording.
- Assessment Settings: Options Tab - Where you associate documents with an assessment.
- Configuring Site Settings - Integrations tab overview.
Comments
0 comments
Please sign in to leave a comment.