4 Prompt Engineering Basics
Tentative time: 12 minutes
4.0.1 Learning Objectives
- Master the fundamentals of effective prompting
- Transform vague requests into powerful prompts
- Avoid common mistakes
- Create reusable professional context for better AI interactions
4.1 The Power and the Problem
Large Language Models are incredibly powerful tools, but they’re not clairvoyant. As Ethan Mollick observed in his work on “good enough prompting”:
“LLMs (such as ChatGPT, Claude, or Bard) are powerful but not clairvoyant. They need sufficient information and clarity to produce useful responses.”
This insight captures a fundamental truth about working with AI: the quality of what you get out depends heavily on the quality of what you put in. But unlike Google searches where you can get away with a few keywords, LLMs work best when you treat them like a collaborative partner who needs context and clear direction.
Let’s break down what this means practically:
“Powerful” - LLMs can handle complex tasks that would take humans hours or days: summarizing dozens of papers, translating between languages, analyzing patterns in data, or drafting professional documents. They have access to vast knowledge and can process large amounts of text quickly.
“But not clairvoyant” - They can’t read your mind or guess what you really need. They don’t know if you’re writing for undergraduates or policymakers, whether you need a formal or casual tone, or what specific angle matters most for your research.
“Need sufficient information and clarity” - The more context and specific instructions you provide, the better the output. This is where prompt engineering comes in.
4.2 From Our Mental Model to Better Prompts
Remember our “jagged frontier” mental model from Chapter 1? LLMs excel at some tasks (like summarizing text or finding patterns) but struggle with others (like providing current information or understanding subtle context). Good prompting helps you:
- Navigate the jagged frontier - Direct the AI toward tasks it handles well
- Provide human expertise - Give the AI the context and knowledge it lacks
- Maintain quality control - Structure requests so you can easily evaluate the output
Think of it this way: you bring the expertise and judgment, the AI brings the scale and speed. But you need to communicate effectively to make this partnership work.
4.3 The Power of Chaining Prompts
One advanced technique worth mentioning is prompt chaining - breaking complex tasks into sequential steps rather than asking for everything at once. This often produces better results because:
- Each step can be optimized for a specific task
- You can review and refine the output before moving to the next step
- The AI has clearer focus at each stage
- You maintain better quality control throughout the process
For example, instead of asking “analyze this email thread and draft a response,” you might: 1. First, ask for analysis and clarification 2. Then, ask for a draft response based on that analysis
This approach is particularly valuable for complex or high-stakes communications where you want to ensure accuracy and appropriateness.
4.4 Two Powerful Prompt Enhancers
Before we move to the templates, here are two simple additions that can dramatically improve your prompts:
“Please ask me clarifying questions” - This encourages the AI to seek additional information rather than making assumptions. It’s surprisingly effective at producing more tailored and useful outputs.
“Tell me when you’re unsure about something” - This helps reduce hallucinations by encouraging the AI to admit uncertainty rather than fabricating plausible-sounding answers.
These simple additions can save you from misleading or inappropriate responses, especially when dealing with complex or sensitive topics.
4.5 The Anatomy of an Effective Prompt
Based on research from Anthropic and other AI labs, effective prompts typically include:
Context - Who you are, what you’re working on, what the AI needs to know Task - What specifically you want the AI to do
Format - How you want the output structured Constraints - Any limitations, requirements, or things to avoid Examples - Sample inputs/outputs if helpful
For academic research, this might look like:
Context: I'm a development researcher studying urban poverty in South Asia
Task: Summarize the key findings from this paper about migration patterns
Format: 3-4 bullet points focusing on policy implications
Constraints: Keep it under 200 words, use objective academic language
[Then upload or paste the paper or abstract]
4.6 Hands-On Activity: Building Your Research Context
Let’s practice with something directly useful for your research. We’ll create a professional context that you can reuse across different AI conversations.
4.6.1 Step 1: Create Your Professional Context
Copy and modify this template with your own information:
# [Your Name] - Professional Context
## Domain Expertise & Background
[Describe your main research areas, methodology preferences, and key expertise. Include your educational background and any relevant professional experience.]
## Current Roles & Affiliations
[List your current positions, institutional affiliations, and key responsibilities]
## Research Focus Areas
[Outline your main research interests and current projects]
## Communication Style & Audience
[Describe who you typically write for and how you prefer to communicate research findings]
## Technical Approach
[Mention any specific tools, methods, or analytical approaches you use]
Here’s how this might look for a researcher:
# Teal Emery - Professional Context
## Domain Expertise & Background
I'm a research consultant specializing in sovereign debt, emerging markets, and Chinese lending to developing countries. I combine domain expertise with data science tools to turn complex information into actionable insights. I have 10+ years of experience as an emerging markets investor and analyst, including 7 years at Morgan Stanley as a sovereign research analyst covering China, Africa, the Middle East, and other emerging markets.
## Current Roles & Affiliations
- Founder & Lead Researcher at Teal Insights
- Research Consultant at AidData
- Fellow at Energy for Growth Hub
- Adjunct Lecturer at Johns Hopkins SAIS
## Research Focus Areas
- Sovereign debt sustainability and restructuring
- Chinese lending and development finance
- Renewable energy financing in low-income countries
- Building transparent, reproducible research tools
## Communication Style & Audience
I write for policymakers, economists, and graduate students who are intelligent but may not share my specific domain expertise. I value clarity over complexity and aim to make technical concepts accessible without oversimplification.
4.6.2 Step 2: Test the Difference
Now let’s see how context changes AI responses. Try these two prompts with your chosen AI tool:
Prompt A (Without Context):
What are some important research questions about social protection in developing countries?
Prompt B (With Context):
[Paste your professional context here]
Given my research background and expertise, what are 5 specific research questions about social protection in developing countries that would be valuable and feasible for my work? Focus on areas where my mixed-methods approach and regional expertise would be particularly valuable.
4.6.3 Step 3: Observe and Refine
Compare the two outputs: - Which response is more specific and useful? - Which better reflects your actual research interests? - How might you refine your context or prompt for even better results?
4.7 Common Mistakes and How to Fix Them
4.7.1 Mistake 1: Treating AI Like Google
Problem: Asking factual questions without context Instead: Provide documents and ask for analysis
❌ “What’s the poverty rate in Nigeria?” ✅ “Based on the survey data I’m sharing below, what are the key trends in poverty rates across different regions of Nigeria?”
4.7.2 Mistake 2: Vague Requests
Problem: “Tell me about X” or “Help me with Y” Instead: Be specific about the task and output format
❌ “Help me with my literature review” ✅ “Summarize the main arguments from these 5 papers about microfinance, focusing on conflicting findings about impact on women’s empowerment. Format as a comparison table.”
4.7.3 Mistake 3: No Quality Control
Problem: Accepting AI output without verification Instead: Ask for sources, evidence, or reasoning
❌ Just using whatever the AI produces ✅ “Show me the specific quotes from the papers that support each of these conclusions”
4.7.4 Mistake 4: Overwhelming the AI
Problem: Asking for too much at once Instead: Break complex tasks into steps
❌ “Analyze this dataset, create visualizations, write a report, and suggest policy recommendations” ✅ “First, help me identify the key patterns in this dataset. Then we’ll work on visualizations.”
4.8 Templates for Common Research Tasks
Here are some proven prompt templates you can adapt:
4.8.1 Complex Email Thread Analysis
[Your professional context]
I need to respond to this complex email thread. Please help me by:1. Summarizing the key issues being discussed
2. Identifying what questions or decisions need my input
3. Noting any deadlines or urgent items
4. Flagging any potential conflicts or sensitive topics
5. Suggesting 2-3 key points for my response
Upload the entire email thread below. Include any relevant background context about the project, relationships, or institutional dynamics that might help me craft an appropriate response.
Please ask me clarifying questions if anything is unclear, and tell me when you're unsure about something rather than guessing.
[upload the full thread]
Email thread: [describe the project, your role, any politics or sensitivities] Additional context:
Follow-up prompt for drafting:
Based on your analysis above, please draft a professional response email that:- Addresses the key points requiring my input
- Maintains an appropriate tone for the relationships involved
- Includes any necessary next steps or commitments
- Is structured for busy people to read and respond to quickly (clear subject line, key points upfront, specific asks)
- Keeps the response concise but comprehensive
I'll review and edit this draft carefully before sending.
4.8.2 Research Question Brainstorming
[Your professional context]
I want to brainstorm new research directions building on my existing work. Please upload 2-3 of my recent papers or abstracts that represent my current research focus.
Based on my previous work and the additional context below, generate 6 research questions that would be:- Natural extensions or new directions from my existing research
- Feasible given my established methodological expertise
- Policy-relevant for [specific context/region where you work]
- Novel enough to contribute meaningfully to the literature
Additional context about my interests for new research:- [Describe any new areas you're curious about]
- [Mention any gaps you've noticed in your field]
- [Note any new data sources or methods you'd like to explore]
- [Describe any policy questions that keep coming up in your work]
Please ask me clarifying questions if you need more information about my specific interests or constraints, and tell me when you're unsure about something.
Format as a numbered list with brief explanation for each, including how it builds on my existing work.
4.8.3 Writing Enhancement
[Your professional context]
Please review this draft paragraph from my paper and suggest improvements for:- Clarity and flow
- Academic tone appropriate for [specific journal/audience]
- Strength of argument
- Any unclear or weak statements
To help you provide better feedback, please upload:- A sample article previously published in this outlet (so you understand the style)
- Any submission guidelines or style guidelines I should follow
- The draft text I want you to review
[paste or upload your text] Draft:
4.9 Building Your Prompt Library
As you use AI tools more, you’ll develop a personal collection of effective prompts. Consider:
- Saving successful prompts - Keep a document with templates that work well
- Iterating and improving - Note what works and what doesn’t
- Sharing with colleagues - Good prompts are valuable resources to share
- Staying organized - Group prompts by task type (analysis, writing, brainstorming)
4.10 What You Can Do Now
- Create your professional context using the template above
- Test the difference context makes with a real research question
- Try one literature review prompt with a paper you’re currently reading
- Save your best prompts for future use
4.11 Going Deeper
For more advanced prompt engineering techniques, see:
- Anthropic’s Prompt Engineering Guide
- Chapter 2.2 on creating reusable “Gems” for repeated tasks
Remember: Good prompting is a skill that improves with practice. Start with these basics, then gradually experiment with more sophisticated techniques as you become comfortable with the fundamentals.
Up next: Chapter 2.2 - Building Research Projects and Creating Your First Gem