AI Systems Architect - Senior Manager

Software Engineering | T&I
Same job available in 34 locations

Position Summary

Deloitte is hiring to scale up and the next generation of its AI infrastructure. Deloitte recently launched the Deloitte Center of AI Computing, a first-of-its-kind center designed to accelerate the development of innovative AI solutions at Deloitte. This position will help harness the value of NVIDIA DGX and industry-leading software and GPU technologies used in AI workloads and high performance computing.

This is an opportunity to join the team and be fully hands-on to help drive technical strategy, cluster management, AI workload design, and make such resources available to a broad base of engineering and consulting groups. Work within the Deloitte Center for AI Computing to deliver and optimize the accelerated platform that allows Deloitte to co-innovate with clients and expedite the development of new AI applications. The candidate will help define solution integration practices and represent emerging technology needs inside the company with emphasis on the latest GPU technologies for high performance computing.

Work you’ll do

  • Work within the Deloitte data center group to design and optimize architecture and technical specifications for the NVIDIA hardware-enabled data center
  • Collaborate with internal stakeholders to understand future NVIDIA deployments and data center requirements to support their project exigencies and improve DGX mini-pod efficiency
  • Utilize your capabilities in DevOps, DataOps, and IT architecture design to streamline infrastructure processes and optimize scheduling and performance
  • Understand business priorities and future goals and translate to optimized infrastructure tools and improved service delivery
  • Coordinate with data science and business teams to identify future AI needs and requirements
  • Manage system operations for data processing and AI workloads
  • Provide technical architecture leadership with the responsibility to ensure the efficient use of resources, the selection of appropriate technology, and the use of appropriate design methodologies
  • Provide leadership and prioritization for business/product stakeholders in understanding requirements and translating them to engineering requirements
  • Analyze current data designs to optimize and provide structural improvements to handle the growth of workloads
  • Support and enhance data architecture, data instrumentation, define database schemas, create ETL pipe­lining as required to internal customer needs
  • Work in DataOps/DevOps/DevSecOps to bring up new data systems and supporting existing orchestration and data services
  • Influence domain-driven design and architecture principles of data lineage, data security, data privacy, data uptime, and reliability
  • Define and grow HPC/AI infrastructure and best practices
  • Set-up alerting, reports, and dashboard for monitoring overall system health
  • Provide reports and updates on usage, maintenance, and debugging in an agile environment


  • Bachelors in Computer Science (CS), Computer Engineering (CSEE), or related STEM field or equivalent experience
  • Expert with GPU computing (CUDA, OpenCL) and HPC system software stack
  • Expert programming skills in Linux Shell/CLI, Python, Powershell (bash/[t]csh, grep/ sed/cut, vim/nano, nvidia-smi etc)
  • Strong knowledge and understanding of CI/CD processes and deployment tools, including Kubernetes, Jenkins, Docker
  • Experience with resource management systems and job scheduling, including parallel programming experience
  • Experience developing large-scale data management systems (PB+) and serving dozens of users/data scientists
  • Experience with provisioning and configuration management tools; Puppet, Ansible, Chef, Terraform, etc
  • Excellent critical thinking, verbal communication, and problem-solving skills
  • Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future

Preferred Qualifications

  • MS/Ph.D. in Computer Science (CS), Computer Engineering (CSEE), Electrical Engineering (EE), or related/relevant STEM degree.
  • Experience in a private cloud, hybrid cloud, and HPC in cloud managed services
  • Experience with enabling modern deep learning software architectures and frameworks including Tensorflow, PyTorch or other frameworks
  • Ability to engage executive audiences to lead AI engineering and data science engagements
  • AWS/Azure Certifications a plus

The Team

Information Technology Services (ITS) helps power Deloitte’s success. ITS is the engine that drives Deloitte, which serves many of the world’s largest, most respected organizations. We develop and deploy cutting-edge internal and go-to-market solutions that help Deloitte operate effectively and lead in the market. Our reputation is built on a tradition of delivering with excellence.

The ~2,200 professionals in ITS deliver services including:

  • Security, risk & compliance
  • Technology support
  • Infrastructure
  • Applications
  • Relationship management
  • Strategy
  • Deployment
  • PMO
  • Financials
  • Communications

Technology & Infrastructure
The Technology and Infrastructure Organization works together to transform how ITS deploys technologies and services that meet the dynamic needs of Deloitte professionals and help increase their productivity.

Service lines:

  • Unified Communications
  • Infrastructure Operations
  • Office of Technology and Infrastructure
  • Service Management
  • Solutions Delivery
  • Technology Support Services
  • Visual Technology and Solutions
  • Cloud Solutions Center

Our people and culture

Our diverse, equitable, and inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ideas and perspectives, and bring more creativity and innovation to help solve our client most complex challenges. This makes Deloitte one of the most rewarding places to work. Learn more about our inclusive culture.

Professional development

From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities to build new skills, take on leadership opportunities and connect and grow through mentorship. From on-the-job learning experiences to formal development programs, our professionals have a variety of opportunities to continue to grow throughout their career. Learn more about our commitment to developing our people.

As used in this posting, "Deloitte" means Deloitte Services LP, a subsidiary of Deloitte LLP. Please see for a detailed description of the legal structure of Deloitte LLP and its subsidiaries.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.

Requisition code: 29271


Caution against fraudulent job offers!

We have been informed of instances where jobseekers are led to believe of fictitious job opportunities with Deloitte US (“Deloitte”). In one or more such cases, false promises of actual or potential selection, or initiation or completion of the recruitment formalities appear to have been or are being made. Some jobseekers appear to have been asked to pay money to specified bank accounts of individuals or entities as a condition of their selection for a ‘job’ with Deloitte. These individuals or entities are in no way connected with Deloitte and do not represent or otherwise act on behalf of Deloitte.

We would like to clarify that:

  • At Deloitte, ethics and integrity are fundamental and not negotiable.
  • We are against corruption and neither offer bribes nor accept them, nor induce or permit any other party to make or receive bribes on our behalf.
  • We have not authorized any party or person to collect any money from jobseekers in any form whatsoever for promises of getting jobs in Deloitte.
  • We consider candidates on merit and that we provide an equal opportunity to eligible applicants.
  • No one other than designated Deloitte personnel (e.g., a Deloitte recruiter or Deloitte hiring partner) is permitted to extend any job offer from Deloitte.

Anyone who at any time has made or makes any payment to any party in exchange for promises of job or selection for a job with Deloitte or any matter related to this (including those for ‘registration’, ‘verification’ or ‘security deposit’) or otherwise engages with any such person who has made or makes fraudulent promises or offers, does so (or has done so) entirely at their own risk. Deloitte takes no responsibility or liability for any such unauthorized or fraudulent actions or engagements. We encourage jobseekers to exercise caution.