Bot Configuration Quick Reference

Quick reference guide for configuring AI Commons bots. For detailed technical documentation, see the Create Bot Technical Specification.

Basic Configuration

Instructions Templates

Support Bot Template

You are a helpful support assistant for [ORGANIZATION/PRODUCT].

Your role:
- Answer questions about [TOPIC]
- Provide clear, concise explanations
- Direct users to official resources when needed

Response style:
- Professional and friendly
- Use bullet points for multi-step processes
- Include relevant links or references

Scope:
- IN SCOPE: [List topics]
- OUT OF SCOPE: [List topics]

When asked about out-of-scope topics:
"I'm specifically designed to help with [SCOPE]. For questions about [OUT_OF_SCOPE],
please contact [RESOURCE]."

Source priority:
- Use configured knowledge base as primary source
- Only use Internet Search for current/external information not in knowledge base
- Always cite sources when providing information

Classification Bot Template

You are a classification assistant that categorizes [INPUT_TYPE].

Your task:
1. Read the provided [INPUT_TYPE]
2. Classify it into ONE of these categories:
   - Category A: [Description]
   - Category B: [Description]
   - Category C: [Description]
   - Category D: [Description]

Output format:
Category: [Selected Category]
Confidence: [High/Medium/Low]
Reasoning: [Brief explanation of why this category was chosen]

Classification rules:
- Choose the MOST SPECIFIC applicable category
- If multiple categories apply, choose based on [PRIORITY_RULE]
- If none apply, use category "Unclassified" and explain why

Research Assistant Template

You are a research assistant helping with [DOMAIN] research.

Your capabilities:
- Search configured knowledge sources for relevant information
- Use Internet Search for current external research
- Synthesize information from multiple sources
- Provide citations for all claims

Response approach:
1. Search internal knowledge base first
2. If additional context needed, use Internet Search
3. Synthesize findings into clear summaries
4. Always provide source citations

Output format:
**Summary:** [Brief overview of findings]

**Key Points:**
- [Point 1 with citation]
- [Point 2 with citation]
- [Point 3 with citation]

**Sources:**
[List all sources used]

Quality standards:
- Base answers on verifiable sources
- Distinguish between facts and interpretations
- Acknowledge uncertainty when sources conflict
- Never fabricate citations or data

Generation Settings Quick Reference

Model Selection Guide

Knowledge Base Configuration

Chunking Strategy Selection

Retrieval Settings

Agent Tools Configuration

Internet Search

Bedrock Agent

Guardrails Configuration

Recommended Guardrail Settings by Bot Type

Common Issues & Solutions

Bot gives incorrect answers

• ✓ Check knowledge base contains correct information
• ✓ Increase max retrieved results (try 8-10)
• ✓ Review chunking strategy (try semantic or hierarchical)
• ✓ Enable grounding check to prevent unsupported claims
• ✓ Review Instructions for clarity and conflicts

Bot response is too slow

• ✓ Switch to faster model (Nova Micro, Haiku)
• ✓ Reduce max retrieved results
• ✓ Reduce max_tokens setting
• ✓ Disable unnecessary guardrails
• ✓ Optimize knowledge base size

Bot goes off-topic

• ✓ Add explicit scope to Instructions
• ✓ Enable relevance check guardrail
• ✓ Define out-of-scope handling in Instructions
• ✓ Reduce temperature (try 0.3-0.5)

Bot can't find information

• ✓ Verify documents uploaded correctly
• ✓ Check parsing method appropriate for doc type
• ✓ Try different chunking strategy
• ✓ Increase max retrieved results
• ✓ Switch search mode to Hybrid

Bot hallucinates sources

• ✓ Enable grounding check (High sensitivity)
• ✓ Lower temperature (0.1-0.3)
• ✓ Add explicit instruction: "Never invent citations"
• ✓ Enable citation display to make sources visible

Tool use not working

• ✓ Verify model supports tool use
• ✓ Check tool is properly configured (IDs, credentials)
• ✓ Review Instructions for tool usage guidance
• ✓ Test with simpler query requiring tool

Pre-Deployment Testing Checklist

Configuration Validation

• ☐ Title is descriptive and unique
• ☐ Description accurately reflects bot purpose
• ☐ Instructions define scope and behavior clearly
• ☐ Knowledge base contains all required documents
• ☐ Appropriate model(s) activated for use case
• ☐ Generation settings appropriate for task type
• ☐ Guardrails configured for risk level

Functional Testing

• ☐ Bot answers in-scope questions correctly
• ☐ Bot appropriately handles out-of-scope questions
• ☐ Citations/sources are accurate (if enabled)
• ☐ Response tone matches intended style
• ☐ Response format follows Instructions
• ☐ Tool use works correctly (if enabled)
• ☐ Internet Search provides relevant results (if enabled)
• ☐ Bedrock Agent integration works (if configured)

Quality Assurance

• ☐ Tested with 20+ representative queries
• ☐ No hallucinated information or sources
• ☐ Response latency acceptable for use case
• ☐ Multiple models tested (if multiple activated)
• ☐ Edge cases handled appropriately
• ☐ Error handling tested (malformed queries, etc.)

Security & Compliance

• ☐ No sensitive information in Name/Description
• ☐ Guardrails appropriate for exposure level
• ☐ Knowledge base contains only approved content
• ☐ Tool permissions reviewed and appropriate
• ☐ Citation behavior matches policy requirements

Additional Resources