Agentic AI Engineer in Test

Santander is a global leader and innovator in the financial services industry and is evolving from a high-impact brand into a technology-driven organization. Our people are at the heart of this journey and together, we are driving a customer-centric transformation that values bold thinking, innovation, and the courage to challenge what’s possible.  This is more than a strategic shift.  It’s a chance for driven professionals to grow, learn, and make a real difference.

If you are interested in exploring the possibilities We Want to Talk to You!

The Difference You Make:
The Agentic AI Engineer designs, builds, and deploys autonomous AI agents powered by large language models (LLMs) capable of reasoning, planning, using tools, and executing multi-step tasks. This role combines software engineering, machine learning, LLM integration, and workflow orchestration to create intelligent systems capable of taking multi-step actions with minimal human supervision. This role blends software engineering, AI/ML integration, orchestration, and secure tool-access protocols (such as MCP) to deliver safe, reliable, and scalable agentic systems for enterprise environments.

The engineer collaborates with data, platform, security, product, and SDET teams to transform business workflows into intelligent, AI-driven processes, to deliver reliable, safe, and scalable agentic solutions.

• Design and implement agentic systems with planning, reasoning, memory, tool use, and multi-step workflows.
• Build LLM-powered pipelines using frameworks such as LangChain, AutoGen, Llama Index, or custom runtimes.
• Implement MCP (Model Context Protocol) or similar protocols for secure and governed tool/API access.
• Integrate agents with APIs, microservices, workflows, distributed systems, and enterprise platforms.
• Develop retrieval pipelines (RAG), embeddings, memory stores, and prompt strategies, frameworks so as LLM/RAG test automation solutions.
• Implement observability, telemetry, and monitoring for agent decisions and tool interactions.
• Build CI/CD, automation, and MLOps practices for agent deployment.

What You Bring:
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

• Bachelor's Degree or equivalent work experience: Computer Science, Software Engineering or equivalent field. - Required.
• 0+ Years Experience with test strategies, test plans, and test cases. - Required.
• Experience in writing SQLs to query the backend during the test execution. Expertise in testing web based applications and web services based systems with minimal to no user interface.
• Experience building test automation frameworks for AI/ML or distributed systems.
• Understanding of LLM evaluation techniques (BLEU, factuality checks, grounding scores, custom metrics).
• Ability to debug agent reasoning errors, hallucinations, planning failures, and tool misuse.
• Knowledge of testing RAG systems (retrieval correctness, latency, vector search quality).
• Experience with structured testing for tool calls, MCP tools, API integrations, and orchestration chains.
• Strong skills in observability, log analysis, and test data management.
• Ability to apply responsible AI and safety testing practices.
• Experience integrating AI with internal tools, data sources, and enterprise services.
• Cloud engineering experience (AWS/Azure/GCP) and containerization (Docker, Kubernetes).
• Understanding of AI governance, responsible AI, and compliance requirements.
• Experience with JIRA/ALM/Xray or similar tools.
• Strong analytical, communication, documentation, and problem-solving skills.
• Ability to manage workload, collaborate in Agile teams, effectively, and work independently.

Certifications:

• No Certifications listed for this job.

It Would Be Nice For You To Have:

• Established work history or equivalent demonstrated through a combination of work experience, training, military service, or education.
• Experience in Microsoft Office products.

What Else You Need To Know:

The base pay range for this position is posted below and represents the annualized salary range. For hourly positions (non-exempt), the annual range is based on a 40-hour work week. The exact compensation may vary based on skills, experience, training, licensure and certifications and location.

Base Pay Range:

Minimum:

We Value Your Impact:

Your contribution matters and it’s recognized.  You can expect a fair and competitive rewards package that reflects the impact you create and the value you deliver. We know rewards go beyond numbers.  Offering more than just a paycheck our benefits are designed to support you, your family and your well-being, now and into the future.Santander Benefits - 2026 Santander OnGoing/NH eGuide (foleon.com) 

Risk Culture:

We embrace a strong risk culture and all of our professionals at all levels are expected to take a proactive and responsible approach toward risk management.

EEO Statement:

At Santander, we value and respect differences in our workforce. We actively encourage everyone to apply. Santander is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, genetics, disability, age, veteran status or any other characteristic protected by law.

Working Conditions:

Frequent minimal physical effort such as sitting, standing and walking is required for this role. Depending on location, occasional moving and lifting light equipment and/or furniture may be required.

Employer Rights:

This job description does not list all of the job duties of the job. You may be asked by your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this job description. The employer has the right to revise this job description at any time. This job description is not a contract for employment and either you or the employer may terminate your employment at any time for any reason.

What To Do Next:

If this sounds like a role you are interested in, then please apply.

We are committed to providing an inclusive and accessible application process for all candidates. If you require any assistance or accommodation due to a disability or any other reason, please contact us at TAOps@santander.us to discuss your needs.