CrawlJobs Logo

AI Engineer (Prompt Engineering & Evaluation)

satalia.com Logo

Satalia

Location Icon

Location:
United Kingdom; Greece , London

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are investing massively in developing next-generation AI tools for multimodal datasets and a wide range of applications. We are building large scale, enterprise grade solutions and serving these innovations to our clients and WPP agency partners. As a member of our team, you will work alongside world-class talent in an environment that not only fosters innovation but also personal growth. You will be responsible for shaping how our AI models understand and interpret complex creative content. Your work will bridge the gap between raw AI capabilities and the delivery of accurate, reliable, and valuable insights for our FTSE 100 clients. You will be at the forefront of applied AI, ensuring our products are not just powerful, but also precise and trustworthy.

Job Responsibility:

  • Collaboration: Work closely with product managers, data scientists, and architects to translate business needs into technical requirements for AI evaluation and application
  • Prompt Engineering & LLM Application: Design, develop, and iteratively refine sophisticated prompts for Large Language Models (LLMs)
  • AI Output Evaluation & Governance: Design and implement evaluation frameworks to ensure our LLM-based services deliver accurate, reliable outputs. Establish metrics for prompt performance, iterative improvement processes, and drift monitoring. Evaluate and recommend best-in-class evaluation tools and methodologies to enhance our capabilities
  • Evaluation Dataset Engineering: Build and maintain the infrastructure for high-quality evaluation datasets representing diverse industry verticals and creative types. This involves designing data pipelines, annotation workflows, quality control systems, and version control. You'll develop intelligent sampling strategies to ensure balanced positive/negative examples across questions about creative elements that drive advertising performance
  • Applied AI Research & Integration: Build a production-ready evaluation system for our LLM-based services, which extract structured insights from advertising creatives. In your first 6 months, you'll develop an automated evaluation system using LLM-as-judge approaches with human-in-the-loop validation, creating a robust, scalable solution for FTSE 100 clients
  • Documentation & Knowledge Sharing: Document the AI evaluation process and results to track product quality and maintain user-facing product and API documentation

Requirements:

  • Proficiency in Python
  • Hands-on experience in advanced prompt engineering for major LLMs
  • Proven experience in designing and implementing evaluation methodologies and quality frameworks for AI/ML model outputs
  • Familiarity with modern AI/LLM frameworks (e.g., LangChain, Google GenAI)
  • Experience working with both structured and unstructured data, particularly in a cloud environment (GCP, AWS, or Azure)
  • Strong analytical and problem-solving skills

Nice to have:

  • Experience with Computer Vision APIs or models
  • Experience building and deploying scalable API services (e.g., FastAPI, Flask)
  • Experience working in a product-driven environment and following MLOps best practice
  • Experience implementing and optimizing data transformations and ETL/ELT processes
What we offer:
  • enhanced pension
  • life assurance
  • income protection
  • private Healthcare
  • Remote working
  • Truly flexible working hours
  • Generous Leave - holiday plus bank holidays and enhanced family leave
  • Annual bonus
  • Impactful projects
  • People oriented culture
  • Transparent and open culture
  • Development

Additional Information:

Job Posted:
February 13, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Satalia - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Engineer (Prompt Engineering & Evaluation)

AI Engineer

AI Engineer position at Inetum, a European leader in digital services, focusing ...
Location
Location
Romania , Bucharest
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3 to 5 years of experience in AI solutions deployment in enterprise environments
  • Understanding of how LLMs (GPT-4, Gemini, Claude, Llama, Mistral AI) work, their capabilities, and limitations
  • Familiarity with model architecture, tokenization, context windows, and prompt formatting
  • Crafting effective prompts for various tasks (text generation, summarization, Q&A, code generation, images and sound manipulations)
  • Techniques for prompt chaining, few-shot and zero-shot learning, and multi-turn conversations
  • Knowledge of prompt templates, system instructions, and role-based prompting
  • Understanding the concept of AI agents: autonomous entities that perceive, reason, and act to achieve goals
  • Familiarity with multi-agent systems, agent orchestration, and agentic workflows (e.g., using frameworks like Lang Chain, Crew AI, Auto Gen)
  • Ability to design, prompt, and coordinate groups of AI agents for collaborative or competitive tasks
  • Knowledge of agent communication, delegation, and task decomposition
Job Responsibility
Job Responsibility
  • Develop, refine, and optimize prompts for LLMs (GPT-4, Gemini, Claude, Llama, Mistral) to support a variety of tasks such as text generation, summarization, Q&A, and code generation
  • Design and implement prompt strategies for multi-turn conversations, prompt chaining, and role-based instructions
  • Build and coordinate groups of AI agents (multi-agent systems) for collaborative or competitive tasks using frameworks such as Lang Chain, Crew AI, or Auto Gen
  • Upgrade existing prompts while releases and solutions set evolve
  • Evaluate and improve the effectiveness of prompts and agent workflows through iterative testing, A/B experimentation, and performance analysis
  • Collaborate with cross-functional teams (developers, data scientists, product managers) to integrate prompt engineering and agentic workflows into enterprise solutions
  • Ensure compliance with data privacy, security, and regulatory standards (GDPR, NIS2) in all prompt and agent designs
  • Document prompt strategies, agent architectures, and best practices for internal knowledge sharing and training
  • Ensure provided solutions are ready for production, documented and monitored ensuring consistent delivery and quality
What we offer
What we offer
  • Full access to foreign language learning platform
  • Personalized access to tech learning platforms
  • Tailored workshops and trainings to sustain your growth
  • Medical Insurance
  • Meal tickets
  • Monthly budget to allocate on flexible benefit platform
  • Access to 7 Card services
  • Wellbeing activities and gatherings
  • Fulltime
Read More
Arrow Right

AI Engineer

AI Engineer position at Inetum, a European leader in digital services, focusing ...
Location
Location
Romania , Bucharest
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3 to 5 years of experience in AI solutions deployment in enterprise environments
  • Understanding of how LLMs (GPT-4, Gemini, Claude, Llama, Mistral AI) work, their capabilities, and limitations
  • Familiarity with model architecture, tokenization, context windows, and prompt formatting
  • Crafting effective prompts for various tasks (text generation, summarization, Q&A, code generation, images and sound manipulations)
  • Techniques for prompt chaining, few-shot and zero-shot learning, and multi-turn conversations
  • Knowledge of prompt templates, system instructions, and role-based prompting
  • Understanding the concept of AI agents: autonomous entities that perceive, reason, and act to achieve goals
  • Familiarity with multi-agent systems, agent orchestration, and agentic workflows (e.g., using frameworks like Lang Chain, Crew AI, Auto Gen)
  • Ability to design, prompt, and coordinate groups of AI agents for collaborative or competitive tasks
  • Knowledge of agent communication, delegation, and task decomposition
Job Responsibility
Job Responsibility
  • Develop, refine, and optimize prompts for LLMs (GPT-4, Gemini, Claude, Llama, Mistral) to support a variety of tasks such as text generation, summarization, Q&A, and code generation
  • Design and implement prompt strategies for multi-turn conversations, prompt chaining, and role-based instructions
  • Build and coordinate groups of AI agents (multi-agent systems) for collaborative or competitive tasks using frameworks such as Lang Chain, Crew AI, or Auto Gen
  • Upgrade existing prompts while releases and solutions set evolve
  • Evaluate and improve the effectiveness of prompts and agent workflows through iterative testing, A/B experimentation, and performance analysis
  • Collaborate with cross-functional teams (developers, data scientists, product managers) to integrate prompt engineering and agentic workflows into enterprise solutions
  • Ensure compliance with data privacy, security, and regulatory standards (GDPR, NIS2) in all prompt and agent designs
  • Document prompt strategies, agent architectures, and best practices for internal knowledge sharing and training
  • Ensure provided solutions are ready for production, documented and monitored ensuring consistent delivery and quality
What we offer
What we offer
  • Full access to foreign language learning platform
  • Personalized access to tech learning platforms
  • Tailored workshops and trainings to sustain your growth
  • Medical Insurance
  • Meal tickets
  • Monthly budget to allocate on flexible benefit platform
  • Access to 7 Card services
  • Wellbeing activities and gatherings
  • Fulltime
Read More
Arrow Right

Applied AI Engineer - AI Solutions

As an Applied AI Engineer, you’ll research and utilize state-of-the-art Gen AI a...
Location
Location
United States , Redwood City; San Francisco
Salary
Salary:
172000.00 - 300000.00 USD / Year
snorkel.ai Logo
Snorkel AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S. degree in a quantitative field such as Computer Science, Engineering, Mathematics, Statistics, or comparable degree/experience
  • 3+ years of customer-facing experience in the design and implementation of AI/ML solutions
  • Proficiency in Python, including strong grounding in software engineering fundamentals (e.g., modular design, testing, profiling, packaging) and experience with modern Python constructs and libraries for type validation and typed data modeling (e.g., pydantic), building type-safe systems (e.g., mypy), testing (e.g., pytest), packaging and environment configuration (e.g., poetry), API and service frameworks (e.g., FastAPI), serialization and structured data handling (e.g., msgspec), and orchestration tooling relevant to ML deployment (e.g., Ray, Airflow)
  • Expertise across the Applied AI stack, spanning classical ML libraries (e.g., scikit-learn), deep learning frameworks (e.g., PyTorch), foundation-model ecosystems (e.g., Hugging Face Transformers), vector/embedding tooling (e.g., FAISS), data processing frameworks (e.g., pandas, Spark), retrieval/RAG tooling (e.g., Chroma, Weaviate), synthetic dataset curation, evaluation workflows, and LLM orchestration, workflow, agent authoring tools (e.g., LlamaIndex, LangGraph, CrewAI)
  • Experience leading strategic, customer-facing initiatives and collaborating with business stakeholders to ensure ML solutions drive successful business outcomes, with a strong focus on teaching and enablement
  • Outstanding presentation skills to technical and executive audiences, whether impromptu on a whiteboard or using presentations and demos
  • Ability to work in a fast-paced environment and balance priorities across multiple projects at once
Job Responsibility
Job Responsibility
  • Partner with customers to build and deploy impactful Gen AI and machine learning solutions, from use case scoping and data exploration to model development and deployment. This may involve leveraging Snorkel Flow or designing custom approaches using state-of-the-art tools, with the goal of delivering real business value and informing the evolution of the Snorkel platform
  • Develop and implement state of the art AI systems such as retrieval-augmented generation (RAG), fine-tuning pipelines, prompt engineering recipes and agentic workflows
  • Create augmented real-world datasets and comprehensive evaluation workflows to ensure model reliability, transparency, and stakeholder trust. A data- and evaluation-first mindset is essential for success in this role
  • Forge and manage relationships with our customers’ leadership and stakeholders to ensure successful development and deployment of AI projects with Snorkel Flow
  • Collaborate closely with pre-sales Solutions and Product teams to map customer needs to existing capabilities, prioritize roadmap gaps, and guide successful project setup
  • Work with other Applied AI Engineers to standardize solutions and contribute to internal tooling and best practices
  • Lead stakeholder education on quantitative capabilities, helping them to understand the strengths and weaknesses of different approaches and what problems are best-suited for Snorkel AI
  • Serve as the voice of our customers for new AI paradigms, data science workflows, and share customer feedback to product teams
  • Conduct one-to-few and one-to-many enablement workshops to transfer knowledge to customers considering or already using Snorkel AI
  • Annual travel up to 25%
What we offer
What we offer
  • equity in the form of employee stock options
  • Fulltime
Read More
Arrow Right

Associate Prompt Engineer

Job Title: Associate Prompt Engineer/Prompt Engineer. Creating High-Quality Cont...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
February 13, 2026
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Business Administration, Management, Economics, or a related field
  • Minor in English, Communications, Journalism, or a related writing-intensive discipline is highly preferred
  • Exceptional written English proficiency with a demonstrated capability equivalent to a High B2 (CEFR) or better
  • Superior reading comprehension skills
  • Excellent communication
  • Specific own equipment (2GHz+ processor, 8GB RAM, Licensed Windows 10, 100MBPS internet)
  • Recent mobile operating system (Android 15 or iOS 16)
Job Responsibility
Job Responsibility
  • Create conversational prompts and responses
  • Create generative prompts and responses
  • Write description prompts
  • Provide detailed descriptions of videos with or without audio
  • Summarize video content
  • Generate image captions
  • Create video event captions
  • Score prompt-response pairs on multiple parameters and categories
  • Provide constructive feedback and suggest improvements where applicable
  • Evaluate and score prompt-response pairs based on various parameters
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...
Location
Location
Canada; United States
Salary
Salary:
160000.00 - 260000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience with a focus on production systems
  • 1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
  • Production LLM Applications: Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
  • Agent Development: Experience building multi-step AI agents, LLM chaining, and complex workflow automation
  • Prompt Engineering Expertise: Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
  • Python Proficiency: Expert-level Python skills for production AI systems
  • Backend Engineering: Strong experience building scalable backend systems, APIs, and distributed architectures
  • LangChain or Similar Frameworks: Experience with LangChain, LlamaIndex, or other LLM application frameworks
  • API Integration: Proven ability to integrate multiple APIs and services to create advanced AI capabilities
  • Production Deployment: Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
  • Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
  • Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
  • System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
  • Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
  • Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
  • Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year, flex PTO, and parental leave
  • employee assistance program and wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • FSA/HSA and medical, dental, and vision benefits
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...
Location
Location
India
Salary
Salary:
Not provided
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of software engineering experience with a focus on production systems
  • 1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
  • Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
  • Experience building multi-step AI agents, LLM chaining, and complex workflow automation
  • Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
  • Expert-level Python skills for production AI systems
  • Strong experience building scalable backend systems, APIs, and distributed architectures
  • Experience with LangChain, LlamaIndex, or other LLM application frameworks
  • Proven ability to integrate multiple APIs and services to create advanced AI capabilities
  • Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
  • Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
  • Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
  • System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
  • Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
  • Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
  • Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions
What we offer
What we offer
  • Invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact
  • Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed
  • We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins
Read More
Arrow Right

Director of AI Engineering

We are entering a hyper-growth phase of AI innovation and are hiring a Director ...
Location
Location
Canada; United States
Salary
Salary:
300000.00 - 450000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10–15+ years in software engineering, with significant leadership experience owning AI/ML or applied LLM systems at scale
  • Proven history shipping LLM-powered features, agentic workflows, or AI assistants used by real customers in production
  • Deep understanding of LLM orchestration frameworks (LangChain, LlamaIndex), RAG pipelines, vector search, embeddings, and prompt engineering
  • Expert in backend & distributed systems (Python strongly preferred) and cloud infrastructure (AWS/GCP)
  • Strong experience with telemetry, observability, and cost-aware real-time inference optimizations
  • Demonstrated ability to lead senior engineers, define technical roadmaps, and deliver outcomes aligned to business metrics
  • Experience building or scaling teams working on experimentation, optimization, personalization, or ML-powered growth systems
  • Exceptional ability to simplify complex problems, set clear standards, and drive alignment across Product, Data, Design, and Engineering
  • Strong product sense, ability to weigh novelty vs. impact, focus on user value, and prioritize speed with guardrails
  • Fluent in integrating AI tools into engineering workflows for code generation, debugging, delivery velocity, and operational efficiency
Job Responsibility
Job Responsibility
  • Define the multi-year technical vision for Apollo’s AI stack, spanning agents, orchestration, inference, retrieval, and platformization
  • Prioritize high-impact AI investments by partnering with Product, Design, Research, and Data leaders to align engineering outcomes with business goals
  • Establish technical standards, evaluation criteria, and success metrics for every AI-powered feature shipped
  • Lead the architecture and deployment of long-horizon autonomous agents, multi-agent workflows, and API-driven orchestration frameworks
  • Build reusable, scalable agentic components that power GTM workflows like research, enrichment, sequencing, lead scoring, routing, and personalization
  • Own the evolution of Apollo’s internal LLM platform for high-scale, low-latency, cost-optimized inference
  • Oversee model-driven experiences for natural-language interfaces, RAG pipelines, semantic search, personalized recommendations, and email intelligence
  • Partner with Product & Design to build intuitive conversational UX that hides underlying complexity while elevating user productivity
  • Implement rigorous evaluation frameworks, including offline benchmarking, human-in-the-loop review, and online A/B experimentation
  • Ensure robust observability, monitoring, and safety guardrails for all AI systems in production
What we offer
What we offer
  • Equity
  • Company bonus or sales commissions/bonuses
  • 401(k) plan
  • At least 10 paid holidays per year
  • Flex PTO
  • Parental leave
  • Employee assistance program and wellbeing benefits
  • Global travel coverage
  • Life/AD&D/STD/LTD insurance
  • FSA/HSA
  • Fulltime
Read More
Arrow Right

Staff AI Engineer

As a Staff AI Engineer on our AI Engineering team, you will be responsible for b...
Location
Location
India
Salary
Salary:
Not provided
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience with a focus on production systems
  • 1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
  • Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage
  • Experience building multi-step AI agents, LLM chaining, and complex workflow automation
  • Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
  • Expert-level Python skills for production AI systems
  • Strong experience building scalable backend systems, APIs, and distributed architectures
  • Experience with LangChain, LlamaIndex, or other LLM application frameworks
  • Proven ability to integrate multiple APIs and services to create advanced AI capabilities
  • Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design and Deploy Production LLM Systems
  • Agent Development
  • Prompt Engineering Excellence
  • System Integration
  • Evaluation & Quality Assurance
  • Performance Optimization
  • Cross-functional Collaboration
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy