Prompt Engineer (143873)
Job Summary
Our client, a leading communication services provider, is seeking a hands-on Prompt Engineer to support its QA Framework, which uses LLMs/SLMs (Large/Small Language Models) to analyze customer service call transcripts and identify specific agent behaviors.
Contract Details
- Location: Greenwood Village, CO
- Contract Length: 12 months
- Work Model: Hybrid
Core Responsibilities
- The team is taking existing agent behaviors that were previously identified through Nexidia/phonetic queries and figuring out how to recreate those behaviors using an LLM/SLM
- The goal is to recreate or improve that functionality using AI by translating those existing behaviors into well-structured prompts and questions that the model can accurately answer based on call transcripts
- Needs someone who really understands how to structure prompts, provide the right context, troubleshoot inaccurate outputs, and continually refine questions until the model identifies the intended behavior
- Interpret existing QA requirements and agent behaviors
- Translate those behaviors into clear question-and-answer formats that an AI model can evaluate
- Determine what context and examples need to be provided to the model
- Structure prompts to help the model identify the correct behavior within a transcript
- Test outputs, identify false positives/false negatives, and refine prompts to improve accuracy
- Work with large datasets and SQL to investigate results and validate model performance
Required Skills/Experience (Must-Haves)
- Hands-on LLM/SLM and Prompt Engineering experience: Has worked directly with language models and knows how to build, structure, test, and refine prompts. Must understand how to provide context and ask questions in a way that gets accurate, specific responses
- Strong SQL skills: Comfortable querying, manipulating, and analyzing large datasets
- Technical/coding ability: Comfortable working with existing code and technical frameworks. This person won't necessarily be building applications from scratch, but needs to be able to work on the technical side
- Strong analytical/problem-solving skills: Someone who naturally approaches problems like puzzles, can work through ambiguity, and figures out solutions independently
- Experience analyzing unstructured or conversational data: Ideally has worked with call transcripts, conversational data, speech analytics, or NLP
Preferred Skills/Experience (Nice-to-Haves)
- Nexidia experience
- Phonetic query development
- Contact center/customer service analytics
- ETL/data pipelines
- Experience working with Claude or other LLM platforms
Key Competencies & Behaviors
- Prompt Engineering Expertise
- AI Model Optimization
- Analytical Problem Solving
- Data-Driven Decision Making
- SQL & Data Investigation
- Conversational Data Analysis
- Critical Thinking & Accuracy Focus
- Pattern Recognition Skills
- Technical Learning Agility
Work Environment
- Location: Greenwood Village, CO
- Work Model: 4 days onsite
Compensation & Benefits
- Pay Range: The approximate pay range for this position is between $66,000 and $95,000. Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.
- Medical, Dental, & Vision Insurance Plans
- Employee-Owned Profit Sharing (ESOP)
- 401K offered
About KellyMitchell
At KellyMitchell, our culture is world class. We’re movers and shakers! We don’t mind a bit of friendly competition, and we reward hard work with unlimited potential for growth. This is an exciting opportunity to join a company known for innovative solutions and unsurpassed customer service. We're passionate about helping companies solve their biggest IT staffing & project solutions challenges. As an employee-owned, women-led organization serving Fortune 500 companies nationwide, we deliver expert service at a moment's notice.
Marketing Disclosure
By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from KellyMitchell and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at https://www.careers.kellymitchell.com/privacy-policy.
[143873]