Teacher Guide

Overview

The teacher/review panel allows you to browse, review, and grade all student submissions.

Accessing the Review Panel

1. Log in with a teacher or admin account
2. Click Review in the navigation bar

Browsing Submissions

The left sidebar lists all submissions. You can:

• Search by keyword, student ID, or name
• Filter by status (All / Submitted / Pending / Passed / Failed / Draft)
• Sort by Last Saved, Created, Student ID, or Status

Each submission card shows:

• Problem title
• Student name and ID
• Status badge (color-coded)
• Date

Reviewing a Submission

Click a submission to view its details:

Content View

• Background / Question / Answer — the student's natural-language reasoning
• Logic type — Propositional or First-Order
• Translation mapping — the student's symbol definitions
• Premises and Conclusion — rendered in LaTeX
• Entails — whether the student claims validity

Content Editing

Click Edit (next to the "Content" tab) to switch to Edit mode:

• Modify any field (background, question, answer, translations, premises, conclusion)
• Changes are validated for well-formed formulas on save
• The edit is saved when you click Save Review

Validity Check

Click Check Validity to run Z3 on the submission:

• The solver checks if the premises logically entail the conclusion
• Results: Valid ✅ / Invalid ❌ (with counterexample) / Unknown ⚠️

LLM Challenge Verification

If the student submitted LLM challenge links:

• Each link appears with its detected platform (ChatGPT, DeepSeek, etc.)
• Click the link to open it in a new tab and verify the conversation
• Select Pass if the student successfully misled the LLM
• Select Fail if the link does not demonstrate successful deception
• Leave unselected if not yet reviewed

Writing a Review

1. Enter your comments in the Review Comment text area
2. Select a grade:
   • Excellent — outstanding formalization and reasoning
   • Good — correct with minor issues
   • Fair — partially correct, needs improvement
   • Fail — incorrect formalization
   • Pending — needs resubmission
   • None — no grade (reset)
3. Click Save Review

Review History

When a student resubmits and you review again:

• The previous review is automatically archived
• Click View Review History to see past reviews alongside the content snapshot from that time

JSON Export

Click JSON Export → Show at the bottom of any submission to see the raw JSON data. This is useful for:

• Debugging formula parsing issues
• Exporting data for research
• Verifying the stored SMT-LIB code

Tips

• Use the Content Edit mode to fix minor student errors before running validity checks
• The validity check uses the saved formulas — make sure to save before checking
• Grades and reviews are immediately visible to students