Position Summary

We are seeking an experienced AI Platform / Gateway Architect to lead the design, governance, security, and scalability of our enterprise AI ecosystem. This role will be responsible for architecting the foundational AI platform that enables secure consumption of Large Language Models (LLMs), AI agents, copilots, and machine learning services across the organization.

The ideal candidate possesses deep expertise in cloud architecture, API management, AI governance, security controls, model orchestration, and enterprise-scale AI platform engineering. The architect will partner with engineering, security, infrastructure, data, and business stakeholders to establish a secure and scalable AI foundation that accelerates innovation while maintaining compliance and operational excellence.

Key Responsibilities

• AI Platform Architecture
• Design and implement enterprise AI platform architecture supporting Generative AI, Agentic AI, RAG, and machine learning workloads.
• Establish standards, patterns, and governance for AI adoption across the organization.
• Create reusable AI infrastructure components and platform services.
• Define AI platform roadmaps, reference architectures, and technical standards.

AI Gateway & Model Management

• Architect and manage AI Gateway solutions for centralized model access and governance.
• Develop multi-model strategies supporting Azure OpenAI, OpenAI, Anthropic Claude, Gemini, and other AI providers.
• Implement model routing, failover, load balancing, and intelligent traffic management capabilities.
• Establish token usage monitoring, cost optimization, and consumption controls.
• Define AI service catalog and self-service consumption models.

Security & Governance

• Implement enterprise AI security frameworks and governance policies.
• Design controls for data protection, PII masking, content filtering, and AI risk management.
• Ensure compliance with regulatory, privacy, and responsible AI requirements.
• Establish auditing, monitoring, and observability standards for AI services.
• Partner with cybersecurity and compliance teams to assess and mitigate AI-related risks.

Cloud & Infrastructure

• Architect cloud-native AI platforms within Azure, AWS, or GCP environments.
• Design scalable infrastructure supporting AI workloads and agentic systems.
• Implement Infrastructure-as-Code (IaC) practices utilizing Terraform, Bicep, ARM, or CloudFormation.
• Collaborate with DevOps and Platform Engineering teams on deployment automation and operational readiness.

Agentic AI & Copilot Enablement

• Enable enterprise AI agents and copilot solutions through secure platform capabilities.
• Establish standards for agent orchestration, tool integration, memory management, and model access.
• Support integration with Microsoft Copilot, Copilot Studio, Azure AI Foundry, and enterprise applications.
• Develop reference architectures for Agentic AI and enterprise workflow automation.

Enterprise Integration

• Design integrations with enterprise systems including ERP, CRM, collaboration, and data platforms.
• Enable secure API exposure and consumption patterns.
• Partner with application development teams to onboard AI capabilities into business solutions.

Required Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 10+ years of experience in Cloud, Platform, Infrastructure, or Enterprise Architecture.
• 5+ years of experience designing enterprise cloud solutions.
• 3+ years of experience implementing AI, ML, or Generative AI platforms.
• Extensive experience with API Management platforms such as:
• Azure API Management
• Kong
• Apigee
• MuleSoft
• AWS API Gateway
• Strong understanding of LLM architectures, RAG, Agentic AI, and model serving.

Experience with:

• Azure OpenAI
• Azure AI Foundry
• OpenAI
• Anthropic Claude
• Google Gemini
• Deep knowledge of authentication and security protocols:
• OAuth 2.0
• OIDC
• SAML
• RBAC
• Zero Trust architectures
• Experience with containerization and orchestration technologies:
• Kubernetes
• Docker
• AKS / EKS / GKE

Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively “Judge”) to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.