Activity 1.8: AI World-Building Evaluation Assignment
Learning Targets
I can evaluate AI-generated writing and explain why human creativity matters in world-building.
Your Task
You've spent three weeks building worlds with your own imagination. Now you're going to look at what happens when AI tries to do the same thing. This isn't about whether AI is "good" or "bad" — it's about understanding what AI can and can't do so you can make informed choices about when (and whether) to use it in your creative work.
The Prompt
Below are two trading post descriptions. One was written by a student in this course. The other was generated by an AI tool given the prompt: "Write a 200-word description of a fantasy trading post with sensory details and a named character." Read both carefully.
Description A
The Gilded Serpent trading post stood at the crossroads of two ancient trade routes, its weathered oak door creaking open to reveal a warm, dimly lit interior. The aroma of dried spices and exotic teas wafted through the air, mingling with the faint scent of pine from the crackling fireplace. Candles flickered on rough-hewn tables where travelers from distant lands compared the quality of their wares. Behind the counter, a stout woman named Marta sorted bolts of cloth with practiced ease, her sharp eyes appraising every newcomer. The sound of a lute drifted from a shadowy corner where a hooded bard plucked a melancholy tune. Colorful tapestries adorned the stone walls, depicting scenes of legendary trade caravans and mythical creatures. The floorboards groaned underfoot, worn smooth by years of heavy boots and dragged cargo.
Description B
Nobody goes to Fen's unless they're lost or lying about something. The place is three bridges past the Last Market, in the part of Millhaven where the canal water turns brown and the gulls get bold enough to steal from your plate. The whole building tilts east — Fen says it's "character," but everyone knows it's the foundation rotting. Inside, the air tastes like lamp oil and fish stew that's been simmering so long it's basically a philosophy. Fen herself is missing two fingers on her left hand, and if you ask about it, she'll tell you three different stories, each one less believable than the last. She keeps a one-eyed cat named Diplomacy on the counter. The regulars don't sit in chairs — they sit on overturned shipping crates, because Fen sold the chairs last winter "for a good reason" that she refuses to explain.
Analysis Questions
Respond to each of the following in your submission. Write 2–3 sentences for each question unless otherwise noted.
- Which description was written by a human and which by AI? Explain your reasoning. What specific clues helped you decide?
- Both descriptions include sensory details. How are the sensory details DIFFERENT in quality or effect? Be specific — compare at least one detail from each.
- Both descriptions include a named character. How are the characters different? Which one feels more like a real person and why?
- One common pattern in AI writing is that it sounds competent but "safe." It avoids risks, unexpected choices, or details that don't fit a predictable pattern. Where do you see this pattern — and where do you see its opposite?
- Based on this comparison, what do you think AI does well in creative writing, and what does it struggle with? How does this affect your own thinking about when AI is and isn't useful for writers?
The Reveal
Description A was AI-generated. Description B was written by a student.
If you identified them correctly, you're developing an important critical eye. If you got them mixed up, that's worth reflecting on too — what fooled you?
Sentence Frames for Support
Use these if you need help getting started:
Requirements
- Responses to all 5 analysis questions (2–3 sentences each)
- Specific evidence from the text for each answer
- Thoughtful final reflection on AI's role in creative writing
Rubric
| Criterion | Developing (1–2) | Proficient (3) | Exemplary (4) |
|---|---|---|---|
| Textual Evidence | Responses are vague or lack specific references to the descriptions | Responses reference specific details from both descriptions | Responses use precise, well-chosen evidence to support clear analytical claims |
| Critical Analysis | Surface-level observations without explanation | Identifies meaningful differences and explains their significance | Connects observations to larger ideas about AI, creativity, and craft |
| Reflection on AI | Oversimplified view (AI is "bad" or "good") | Nuanced understanding of AI's strengths and limitations | Thoughtful, evidence-based position on AI's role in the creative process |
How to Submit Your Work
Choose how to present your work:
Option A: Written Responses
Submit your responses to all 5 questions as a document.
Option B: Written + Annotated Text
Submit your responses along with an annotated copy of the two descriptions, highlighting the specific details you reference in your analysis.
Option C: Audio + Written
Submit an audio recording (3–5 minutes) of you discussing your analysis, plus written notes for each question.
Responsible Decision-Making
As AI tools become more powerful, every writer will face choices about when to use them and when not to. There's no single right answer, but making that choice thoughtfully matters. The analysis you just completed gives you firsthand evidence of what AI does well and where it falls short. That's the kind of evidence-based thinking that helps you make good decisions, not just about writing tools, but in every area where technology offers shortcuts. What matters most to you about the work you create?
AI Guidance for This Activity
Ironic as it sounds — do not use AI to complete this activity about evaluating AI. The analysis needs to come from YOUR reading experience and YOUR critical thinking. This is about building your judgment, which only happens through practice.
What's Next
You've completed the final activity for Unit 1. Move on to Unit 1 Reflection: World-Building to reflect on your growth as a world-builder.