Job Description:

Job Title: Principal AI Systems Architect

Corporate Title: Director

Location: Cary, NC

Who we are:

In short – an essential part of Deutsche Bank’s technology solution, developing applications for key business areas.

Our Technologists drive Cloud, Cyber and business technology strategy while transforming it within a robust, hands-on engineering culture. Learning is a key element of our people strategy, and we have a variety of options for you to develop professionally. Our approach to the future of work champions flexibility and is rooted in the understanding that there have been dramatic shifts in the ways we work.

Having first established a presence in the Americas in the 19th century, Deutsche Bank opened its US technology center in Cary, North Carolina in 2009. Learn more about us here.

Overview

As a Principal AI Systems Architect, you will be a pivotal leader in shaping the future of our AI platforms. You will drive the architectural integrity and long-term technical roadmap, specializing in hands-on RAG (Retrieval-Augmented Generation) architecture, large-scale repository ingestion, and deep LLM system design. Your expertise will be crucial in optimizing retrieval, building robust embeddings pipelines, and integrating knowledge graphs, all while ensuring cost-aware AI architecture and scalability across distributed systems. You will lead the design and implementation of AI Gateway and orchestration, including multimodal system designs. This role demands a very deep understanding of AI/ML/LLM domains and exceptional engineering and systems design capabilities, with a focus on delivering impactful product features and robust MLOps practices.

What We Offer You

• A diverse and inclusive environment that embraces change, innovation, and collaboration
• A hybrid working model, allowing for in-office / work from home flexibility, generous vacation, personal and volunteer days
• Employee Resource Groups support an inclusive workplace for everyone and promote community engagement
• Competitive compensation packages including health and wellbeing benefits, retirement savings plans, parental leave, and family building benefits

• Educational resources, matching gift and volunteer programs

What You’ll Do

• Drive the architectural integrity and long-term technical roadmap for AI platforms.
• Design and implement Vector DB, Graph DB (e.g., Neo4j), and RDBMS (e.g., PostgreSQL + pgvector) solutions, and MCP Architectures.
• Leverage Google ADK/Vertex AI for AI solutions and ensure retrieval optimization and robust embeddings pipelines.
• Integrate knowledge graphs, and develop AI Gateway and orchestration frameworks.
• Architect multimodal system designs, focusing on rapid toolset evaluation and cost-aware AI architecture.
• Apply principles from the theory of compilers/programming languages/AST/parsers to scale distributed AI systems effectively.

How You’ll Lead

• Lead hands-on RAG architecture, large-scale repository ingestion, and deep LLM system design.
• Contribute to major AI frameworks, demonstrate deep expertise in agentic frameworks, and potentially publish viral GitHub repositories or achieve top-tier competitor status in data challenges.

Skills You’ll Need

• Very deep AI/ML/LLM domain expertise.
• Deep engineering/systems design knowledge.
• Proven experience in product/feature delivery and ML Ops.
• Proficiency with Vector DB, Graph DB, RDBMS (e.g., PostgreSQL + pgvector, Neo4j), and MCP Architectures.
• Experience with Google ADK/Vertex AI, retrieval optimization, embeddings pipelines, knowledge graph integration, AI Gateway, and orchestration.
• Knowledge of multimodal system design, rapid toolset evaluation, and cost-aware AI architecture.

Skills That Will Help You Excel

• Understanding of compiler theory/programming languages/AST/parsers and scaling distributed systems.
• Demonstrated achievements such as contributions to foundational AI libraries (e.g., LangChain, LlamaIndex, AutoGen) or significant open-source projects.

Expectations

It is the Bank’s expectation that employees hired into this role will work in the Cary office in accordance with the Bank’s hybrid working model.

Deutsche Bank provides reasonable accommodations to candidates and employees with a substantiated need based on disability and/or religion.

The salary range for this position in Cary is $170,000 to 225,000. Actual salaries may be based on a number of factors including, but not limited to, a candidate’s skill set, experience, education, work location and other qualifications. Posted salary ranges do not include incentive compensation or any other type of remuneration.

Deutsche Bank Benefits

At Deutsche Bank, we recognize that our benefit programs have a profound impact on our colleagues. That’s why we are focused on providing benefits and perks that enable our colleagues to live authenti­cally and be their whole selves, at every stage of life. We provide access to physical, emotional, and financial wellness benefits that allow our colleagues to stay financially secure and strike balance between work and home. Click here to learn more!

Learn more about your life at Deutsche Bank through the eyes of our current employees: https://careers.db.com/life

The California Consumer Privacy Act outlines how companies can use personal information. If you are interested in receiving a copy of Deutsche Bank’s California Privacy Notice please email HR.Direct@DB.com.

#LI-HYBRID

We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.

Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.

We welcome applications from all people and promote a positive, fair and inclusive work environment.

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status or other characteristics protected by law. Click these links to view Deutsche Bank’s Equal Opportunity Policy Statement and the following notices: EEOC Know Your Rights; Employee Rights and Responsibilities under the Family and Medical Leave Act; and Employee Polygraph Protection Act.