Role at a glance
- Job function
-
Software Engineering & IT DevOps & Site Reliability Engineering
- Salary
- Not Disclosed
- Location
- Greece-Thessaloniki Chortiatis
- Work arrangement
- Hybrid
- Employment
- Full-time
- Experience
- 4 years+ in software, data or ML/AI engineering
- Education
- Bachelor's degree in a technical field or equivalent practical experience.
Spotted an issue?
We’ll check it against the original posting.
Role Summary
The Manager, AI Ops Site Reliability Engineer will lead the design and evaluation of AI operations agents within Hosting SRE Operations in the CISO Infrastructure & Cloud Services organization. The role partners with domain experts and operational teams to convert operational knowledge into measurable, trustworthy agent-assisted workflows that improve service operations.
What You'll Do
- Design agent workflows for incident intake and investigation, including prompts, context, retrieval, tool selection, and decision logic.
- Build and own evaluation harnesses using historical incidents, accuracy metrics, regression tests, and hallucination and error detection.
- Define reasoning guardrails for agent conclusions, proposals, confidence levels, and human escalation.
- Convert runbooks and past investigations into retrievable knowledge the agent can cite.
- Redesign operational processes as agent-assisted workflows, pilot them, and measure toil and MTTR reduction.
- Continuously tune agent quality against production results and collaborate with SRE, Ops, Platform, and AI Ops teams.
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Hands-on delivery of LLM or agent-based applications in production; prompt and context engineering; structured evaluations for AI systems; agent frameworks and tooling; RAG / knowledge-base design; strong Python; IT operations literacy; strong analytical and communication skills.
Required
- Hands-on delivery of LLM or agent-based applications in production
- Prompt and context engineering
- Structured evaluations for AI systems, including ground-truth sets, metrics, and regression testing
- Working knowledge of agent frameworks and tooling
- RAG / knowledge-base design
- Strong Python
- IT operations literacy
- Strong analytical and communication skills
Preferred
- LLM-as-judge
- Familiarity with ServiceNow, Dynatrace or observability data
Original job description
Content provided by the employer
Original job description
Content provided by the employer
ROLE SUMMARY
The CISO Infrastructure & Cloud Services organization delivers excellence in the pursuit of breakthroughs that change patients' lives through industry-leading infrastructure operations performance. We ensure optimal performance of global application hosting and network services that power Pfizer's business processes. We strive to revolutionize service dependability by applying advanced analytics to drive predictive detection, identifying potential issues with our services and intervening before they disrupt our business. We place data at the heart of what we do and apply a relentless focus on continuous improvement to enable Pfizer's business processes and patient outcomes.
We are seeking an Manager, AI Ops Site Reliability Engineer to own how our operations agents think and how well they perform, within Hosting SRE Operations, based in Greece. In this role, you design the agent workflows, prompts and context, build the evaluation harness that proves accuracy against our own estate, and partner with our existing domain experts to convert their operational know-how into reliable, measurable agent behavior. You bring depth in AI and evaluation; our domain specialists bring the deep OS, Storage, Data Protection, Database and HCI knowledge - together you turn classic operations into trustworthy AI operations.
ROLE RESPONSIBILITIES
Design agent workflows for intake and investigation: the prompts, context and retrieval, tool selection and decision logic that determine how the agent classifies, enriches and reasons about incidents.
Build and own the evaluation harness: ground-truth datasets drawn from historical incidents, accuracy, precision and recall metrics, regression tests, and hallucination and error detection - so every change to an agent is measured before it ships.
Define the reasoning guardrails: what an agent may conclude and propose, how confident it must be, and when it must defer to a human - the quality side of the approval gate.
Turn tacit operational knowledge into machine-usable context: work with the existing domain experts to convert their runbooks and past investigations into retrievable knowledge the agent can cite.
Run the transformation on Operational workflows: take a classic operational process, redesign it with the domain owner as an agent-assisted flow, pilot it, and measure toil and MTTR reduction.
Continuously tune agent quality against production results, feeding misses back into prompts, context and the evaluation sets.
Collaborate with SRE, Ops, Platform teams, AI Ops Platform Engineers, AI Ops Site Reliability Engineers, and other stakeholders to align operational requirements, platform capabilities, automation strategies, and execution priorities
QUALIFICATIONS
Bachelor's degree in a technical field or equivalent practical experience.
4 years+ in software, data or ML/AI engineering, including hands-on delivery of LLM or agent-based applications in production.
Demonstrated prompt and context engineering, and experience building structured evaluations for AI systems (ground-truth sets, metrics, regression testing; LLM-as-judge a plus).
Working knowledge of agent frameworks and tooling (for example Amazon Bedrock AgentCore or LangGraph) and RAG / knowledge-base design, with strong Python.
IT operations literacy to design realistic operational workflows and judge the plausibility of agent output. You do not need to be a domain administrator - you will partner with domain experts who are.
Strong analytical and communication skills to work with SREs, extract knowledge and present accuracy results credibly. Familiarity with ServiceNow, Dynatrace or observability data is a plus.
Demonstrated experience in an agile work environment possessing qualities such as a collaborative mindset, adaptability to change, and a proactive problem-solving approach.
NON-STANDARD WORK SCHEDULE, TRAVEL OR ENVIRONMENT REQUIREMENTS
Periodic international and domestic travel required (less than 10%)
Please apply by sending your CV in English.
Work Location Assignment: Hybrid
Purpose
Breakthroughs that change patients' lives... At Pfizer we are a patient centric company, guided by our four values: courage, joy, equity and excellence. Our breakthrough culture lends itself to our dedication to transforming millions of lives.
Digital Transformation Strategy
One bold way we are achieving our purpose is through our company wide digital transformation strategy. We are leading the way in adopting new data, modelling and automated solutions to further digitize and accelerate drug discovery and development with the aim of enhancing health outcomes and the patient experience.
Flexibility
We aim to create a trusting, flexible workplace culture which encourages employees to achieve work life harmony, attracts talent and enables everyone to be their best working self. Let’s start the conversation!
Equal Employment Opportunity
We believe that a diverse and inclusive workforce is crucial to building a successful business. As an employer, Pfizer is committed to celebrating this, in all its forms – allowing for us to be as diverse as the patients and communities we serve. Together, we continue to build a culture that encourages, supports and empowers our employees.
Disability Inclusion
Our mission is unleashing the power of all our people and we are proud to be a disability inclusive employer, ensuring equal employment opportunities for all candidates. We encourage you to put your best self forward with the knowledge and trust that we will make any reasonable adjustments to support your application and future career. Your journey with Pfizer starts here!
To learn more about acceptable and prohibited uses of AI during the recruitment process, please review our candidate AI-use guidelines available on Pfizer Careers.
Information & Business Tech
About the company
Pfizer
Large Enterprise
Pfizer is a global biopharmaceutical company dedicated to the discovery, development, and manufacturing of innovative healthcare solutions. With a strong focus on improving lives through medications and vaccines, Pfizer has played a significant role in addressing various health challenges, including infectious diseases, chronic illnesses, and rare conditions. The company emphasizes research-driven approaches and collaborative efforts in its mission to enhance global health and empower patients through cutting-edge science and technology. Through its commitment to high standards of safety and efficacy, Pfizer continues to shape the future of medicine.