Using ChatGPT to Screen and Shortlist Job Applicant Resumes

Tested prompts for how to use chatgpt to screen resumes compared across 5 leading AI models.

BEST BY JUDGE SCORE Claude Opus 4.7 9/10

The prompt we tested

You are an expert technical recruiter and hiring manager assistant. Screen the following job applicant resume against the job requirements provided and produce a structured shortlisting decision.

Follow these instructions exactly:
Output a structured evaluation with these sections: (1) Match Score (0-100), (2) Must-Have Requirements Check (table or bullet list marking each as Met/Partial/Missing with evidence from the resume), (3) Key Strengths (3-5 bullets), (4) Gaps or Red Flags (3-5 bullets), (5) Suggested Interview Questions (3 targeted questions), and (6) Final Recommendation (Shortlist / Maybe / Reject with one-sentence justification). Only cite facts explicitly stated in the resume—never invent credentials—and keep the total response under 400 words.

Job requirements and resume to evaluate:
Job: Mid-level Backend Engineer. Must-haves: 3+ years Python, experience with PostgreSQL, REST API design, AWS. Nice-to-have: Kubernetes, fintech background.

Resume: Jane Doe — Software Engineer at FinPay (2021–2024). Built Python/Django microservices handling 2M daily transactions, designed REST APIs, managed PostgreSQL databases, deployed services on AWS ECS. Previously Junior Developer at ShopLite (2019–2021) working on Node.js. BS Computer Science, UT Austin 2019. Certifications: AWS Solutions Architect Associate.

Return your screening analysis now.

Model comparison

ModelQualityCostLatencyTokens
Claude Opus 4.7 9 $0.0806 19.6s 526 / 970
Claude Haiku 4.5 8 $0.0038 8.1s 336 / 699
GPT-5.4 8 $0.0090 8.3s 294 / 552
Gemini 2.5 Pro 8 $0.0024 12.0s 313 / 409
Grok 4.1 Fast Reasoning 8 $0.0003 8.5s 443 / 342

Outputs

Claude Opus 4.7 9/10
# Candidate Screening: Jane Doe

## 1. Match Score: **92/100**

## 2. Must-Have Requirements Check

| Requirement | Status | Evidence |
|---|---|---|
| 3+ years Python | ✅ Met | Python/Django at FinPay, 2021–2024 (~3 years) |
| PostgreSQL experience | ✅ Met | "Managed PostgreSQL databases" at FinPay |
| REST API design | ✅ Met | "Designed REST APIs" at FinPay |
| AWS | ✅ Met | Deployed on AWS ECS; AWS Solutions Architect Associate cert |
| **Nice-to-have:** Kubernetes | ❌ Missing | Not mentioned (ECS used instead) |
| **Nice-to-have:** Fintech | ✅ Met | FinPay — transaction processing |

## 3. Key Strengths
- **Relevant fintech domain experience** building systems handling 2M daily transactions at FinPay.
- **Full must-have coverage**: Python, PostgreSQL, REST APIs, and AWS all demonstrated in a single role.
- **AWS credentialing**: Solutions Architect Associate certification validates cloud proficiency beyond hands-on use.
- **Microservices architecture exposure** directly applicable to modern backend roles.
- **Solid educational foundation**: BS Computer Science from UT Austin.

## 4. Gaps or Red Flags
- **No Kubernetes experience stated** — deployment experience is ECS-based; may require ramp-up if K8s is part of the stack.
- **Resume lacks depth on scale/performance metrics** beyond the single 2M transactions figure (e.g., latency, availability targets).
- **No mention of testing, CI/CD, or observability practices** — common expectations for a mid-level backend engineer.
- **Limited breadth of languages** post-2021 (Python only); Node.js experience is older (2019–2021).
- **No indication of leadership, mentorship, or cross-team collaboration** — worth probing for mid-level fit.

## 5. Suggested Interview Questions
1. Walk me through the design of a REST API you built at FinPay that handled high-volume transactions — how did you approach schema design, idempotency, and error handling with PostgreSQL?
2. You deployed on AWS ECS; have you evaluated or worked alongside Kubernetes? How would you approach migrating a containerized service from ECS to EKS?
3. Describe a production incident involving your Django microservices or PostgreSQL — how did you diagnose it, and what changes did you make to prevent recurrence?

## 6. Final Recommendation: **Shortlist**

Jane meets every must-have requirement with directly relevant fintech experience at scale; the only gap (Kubernetes) is a nice-to-have and easily addressable.
Judge notes: Virtually production-ready with precise, evidence-grounded analysis; the only minor nitpick is that the 92/100 match score feels slightly high given the noted gaps in CI/CD, observability, and leadership that a strict mid-level assessment would penalize more.
Claude Haiku 4.5 8/10
# Shortlisting Decision: Jane Doe – Mid-level Backend Engineer

## 1. Match Score
**82/100**

---

## 2. Must-Have Requirements Check

| Requirement | Status | Evidence |
|---|---|---|
| 3+ years Python | **Partial** | 3 years at FinPay (2021–2024) + likely exposure at ShopLite; meets threshold but limited breadth shown |
| PostgreSQL experience | **Met** | "managed PostgreSQL databases" at FinPay |
| REST API design | **Met** | "designed REST APIs" at FinPay |
| AWS | **Met** | "deployed services on AWS ECS" + AWS Solutions Architect Associate certification |
| Kubernetes | **Nice-to-have** | Not mentioned; *Missing* |
| Fintech background | **Nice-to-have** | FinPay role (2021–2024) demonstrates fintech exposure; *Met* |

---

## 3. Key Strengths

- **Production-scale experience**: Demonstrated ability to architect and maintain systems handling 2M daily transactions—strong signal of reliability and understanding of performance/scalability concerns.
- **Full-stack backend competency**: Solid coverage of core requirements (Python, PostgreSQL, REST APIs, AWS); no critical skill gaps.
- **Fintech domain knowledge**: FinPay background aligns with nice-to-have and suggests familiarity with regulatory/compliance considerations common in backend roles.
- **AWS certification**: Formal qualification (Solutions Architect Associate) validates cloud infrastructure depth beyond job description.

---

## 4. Gaps or Red Flags

- **Kubernetes absence**: No mention of container orchestration; may require ramp-up if role demands it.
- **Limited Python breadth**: 3 years focused on Django/microservices; unclear exposure to async frameworks, testing practices, or other Python ecosystems.
- **Node.js detour unexplained**: Previous role in Node.js may signal lack of Python focus early-career; motivation for switch not stated.
- **Microservices-specific**: Strong in service-oriented architecture but no mention of monolith refactoring, system design depth, or cross-service patterns beyond basic REST APIs.

---

## 5. Suggested Interview Questions

1. **Python depth**: "Beyond Django microservices, what other Python frameworks or async libraries have you used, and how do you approach testing and CI/CD in your Python projects?"
2. **Architecture decision-making**: "Walk us through a design decision you made when building one of your REST APIs—what trade-offs did you consider?"
3. **Kubernetes/DevOps gaps**: "You've deployed on AWS ECS; what's your familiarity with Kubernetes, and how quickly could you ramp up if the role requires it?"

---

## 6. Final Recommendation

**SHORTLIST**

Jane meets all must-haves with relevant fintech domain experience and production-scale proof points; Kubernetes gap is learnable and listed as nice-to-have rather than critical.
Judge notes: The output is polished and production-ready, but the "Partial" rating for Python (3+ years) is slightly misleading since FinPay alone covers the full requirement, and the response edges past 400 words, violating the explicit constraint.
GPT-5.4 8/10
**1) Match Score (0-100)**  
**88/100**

**2) Must-Have Requirements Check**

- **3+ years Python — Met**  
  - Evidence: Software Engineer at **FinPay (2021–2024)**; “Built **Python/Django** microservices.”  
- **Experience with PostgreSQL — Met**  
  - Evidence: “**Managed PostgreSQL databases**.”  
- **REST API design — Met**  
  - Evidence: “**Designed REST APIs**.”  
- **AWS — Met**  
  - Evidence: “**Deployed services on AWS ECS**”; certification: **AWS Solutions Architect Associate**.  
- **Nice-to-have: Kubernetes — Missing**  
  - Evidence: No Kubernetes experience stated.  
- **Nice-to-have: fintech background — Met**  
  - Evidence: Worked at **FinPay (2021–2024)** handling “**2M daily transactions**.”

**3) Key Strengths**

- Strong direct alignment with backend stack: **Python/Django, PostgreSQL, REST APIs, AWS**.  
- Relevant production-scale experience: built microservices handling **2M daily transactions**.  
- Fintech domain exposure through **FinPay**, which is valuable for transaction-heavy systems.  
- AWS credibility strengthened by **hands-on ECS deployment** plus **AWS Solutions Architect Associate** certification.  
- Solid total software engineering experience since **2019**, including prior development role at ShopLite.

**4) Gaps or Red Flags**

- Python experience appears to be **about 3 years (2021–2024)**, which meets the bar but is not significantly above it.  
- No explicit mention of **Kubernetes**, a stated nice-to-have.  
- Resume does not specify depth of ownership in areas like **system design, testing, CI/CD, observability, or security**.  
- Prior role at ShopLite was in **Node.js**, so backend depth is somewhat split across stacks rather than exclusively Python.

**5) Suggested Interview Questions**

1. At FinPay, what parts of the **REST API design** did you personally own, and how did you handle versioning, authentication, and error handling?  
2. Can you describe how you **managed PostgreSQL** in production—schema design, indexing, query optimization, or transaction handling?  
3. How were your services deployed on **AWS ECS**, and what was your role in architecture, scaling, monitoring, and incident response?

**6) Final Recommendation**  
**Shortlist** — Strong match on all core must-haves with relevant fintech and AWS production experience; only clear gap is lack of stated Kubernetes exposure.
Judge notes: The output is production-ready and well-structured, but the Python experience note ("about 3 years") slightly undersells the case—FinPay alone is 3 years and prior ShopLite work may have included some Python, making this a minor analytical imprecision worth correcting before use.
Gemini 2.5 Pro 8/10
**1. Match Score**
95/100

**2. Must-Have Requirements Check**
*   **3+ years Python:** Met (Software Engineer at FinPay from 2021–2024 using Python).
*   **Experience with PostgreSQL:** Met (Resume states she "managed PostgreSQL databases").
*   **REST API design:** Met (Resume states she "designed REST APIs").
*   **AWS:** Met (Resume notes deployment to "AWS ECS" and an "AWS Solutions Architect Associate" certification).

**3. Key Strengths**
*   Meets all must-have technical requirements with three years of direct, relevant experience.
*   Possesses a fintech background from FinPay, which is a specified nice-to-have.
*   Demonstrates strong AWS proficiency with both hands-on deployment experience (ECS) and a relevant certification.
*   Experience in a high-volume environment, building microservices "handling 2M daily transactions."

**4. Gaps or Red Flags**
*   No experience listed with Kubernetes, which is a nice-to-have.
*   Resume is concise; lacks specific details on the complexity or scale of individual projects.
*   Primary backend experience is with the Django framework; depth in pure Python outside of Django is unclear.

**5. Suggested Interview Questions**
1.  Can you describe the architecture of a REST API you designed at FinPay and a key decision you made to ensure its scalability or security?
2.  Walk me through your experience managing PostgreSQL. What was the most significant database challenge you faced related to performance or data integrity?
3.  Your resume mentions deploying to AWS ECS. Can you elaborate on the deployment pipeline and your role in infrastructure management?

**6. Final Recommendation**
**Shortlist.** The candidate meets all must-have requirements and brings relevant fintech domain experience, making her a very strong match for the role.
Judge notes: The output is clean and production-ready, but the Match Score of 95/100 is slightly inflated given only 3 years Python experience (the minimum threshold) and a missing Kubernetes nice-to-have, and the "Gaps" section is thin with only 3 minor points that feel somewhat stretched.
Grok 4.1 Fast Reasoning 8/10
### 1. Match Score
92

### 2. Must-Have Requirements Check
- **3+ years Python**: Met (Built Python/Django microservices at FinPay, 2021–2024).
- **PostgreSQL**: Met (Managed PostgreSQL databases at FinPay).
- **REST API design**: Met (Designed REST APIs at FinPay).
- **AWS**: Met (Deployed services on AWS ECS at FinPay; AWS Solutions Architect Associate certification).

### 3. Key Strengths
- 3 years Python/Django experience building microservices handling 2M daily transactions at fintech firm FinPay.
- Hands-on with PostgreSQL management and REST API design in production environment.
- AWS deployment expertise via ECS and holds AWS Solutions Architect Associate certification.
- Relevant BS Computer Science from UT Austin (2019); total 5 years engineering experience.

### 4. Gaps or Red Flags
- No experience with Kubernetes mentioned.
- Prior role (2019–2021 at ShopLite) focused on Node.js, not Python or backend must-haves.
- No details on scale or complexity beyond transaction volume at FinPay.
- Lacks explicit mention of other cloud services or advanced AWS features beyond ECS.

### 5. Suggested Interview Questions
- Describe a challenging REST API design decision you made at FinPay and its impact on the 2M daily transactions.
- How have you optimized PostgreSQL databases for high-volume fintech workloads?
- Walk through your AWS ECS deployment process and how your Solutions Architect certification influenced it.

### 6. Final Recommendation
**Shortlist** - Excellent match on all must-haves with proven fintech Python backend experience. 

(248 words)
Judge notes: The output is clean and accurate but the "Gaps or Red Flags" section is weak—two of the four bullets are minor observations rather than genuine red flags, and the 92 match score feels slightly inflated given Kubernetes and ShopLite's Node.js focus are noted concerns.

Related queries