Senior AI Development Platform Engineer – Vice President – Software Engineering

Key Responsibilities

This is a hands-on technical Environment Manager (VP lead) position that develops and maintains software solutions that support business needs

• Develop tooling and self-service capabilities for deploying AI solutions for the firm. Collaborate with other developers to enhance the developer experience when building and deploying AI applications.
• Have a platform mindset and build common, reusable solutions to scale Generative AI use cases using pre-trained models as well as fine-tuned models.
• Collaborate with product manager, other tech leads, junior staff and other stakeholders to analyze requirements, translate them into technical specification and architecture documentation.
• Design scalable, robust, secure, and flexible architecture of components of the AI development platform.
• Leverage Kubernetes/OpenShift to develop modern containerized workloads.
• Leverage container registries like JFrog artifactory, container packaging/configuration management technologies like Helm & Kustomize, and GitOps deployment methods to orchestrate, manage and deploy these workloads.
• Integrate with capabilities such as large-scale vector stores for embeddings.
• Author best practices on the Generative AI ecosystem, when to use which tools, available models such as GPT, Llama, Hugging Face etc. and libraries such as Langchain.
• Analyze, investigate, and implement GenAI solutions focusing on Agentic Orchestration and Agent Builder frameworks.
• Contribute to major design decisions and product selection for building Generative AI solutions. Inclusive of app authentication, service communication, state externalization, container layering strategy and immutability.
• Ensure AI platform are reliable, scalable, and operational; (e.g. blueprints for upgrade/release strategies (E.g. Blue/Green); logging/monitoring/metrics; automation of system management tasks)
• Participate in all team’s Agile/ Scrum ceremonies.

Qualification & Requirements

Required Skills

• Strong understanding and experience designing and building software following cloud-native architecture with microservices, Kubernetes, docker, kafka, etc.
• Good knowledge of Microservice based architecture, industry standards, for both public and private cloud.
• Good understanding of modern Application configuration techniques.
• Hands on experience with Cloud Application Deployment patterns like Blue/Green.
• Good understanding of State sharing between scalable cloud components (Kafka, dynamic distributed caching).
• Good knowledge of various DB engines (SQL, Redis, Kafka, etc) for cloud app storage.
• Experience building AI applications, preferably Generative AI and LLM based apps.
• Deep understanding of AI agents, Agentic Orchestration, Multi-Agent Workflow Automation, along with hands-on experience in Agent Builder frameworks such Lang Chain and Lang Graph.
• Experience working with Generative AI development, embeddings, fine tuning of Generative AI models.
• Understanding of ModelOps/ ML Ops/ LLM Op.
• Understanding of SRE techniques.
• Understanding of Responsible AI, AI Ethics.
• Understanding of Information Security, Secure coding practices.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field, or equivalent job experience
• 10+ years of experience in software engineering, design, and development
• 5+ years of experience architecting distributed systems.
• 1+ year of experience building AI applications, preferably Generative AI and LLM based apps.

Benefits

At Morgan Stanley, our employees are our most valued asset. And we invest in them by offering some of the most attractive and comprehensive benefits and perks in the industry to support their and their family’s physical, mental and financial wellbeing.

If you join us, your benefits will start with the essentials like top-notch health care, a retirement plan with a competitive company match, as well as a robust mental health benefit.

Family Support. Whether you’re welcoming a new child, helping your children grow and develop, or caring for aging parents, we have programs to help. We offer generous parental leave (16 weeks for all new parents and an additional 6-8 weeks for employees who give birth), as well as caregiver leave when you need to care for a seriously ill family member (4 weeks annually).

Our family support programs include a $75,000 family building benefit to offset the cost of fertility treatments (IVF, egg- and sperm-freezing), adoption and surrogacy. Additionally, expert care is available round-the-clock, at no charge, from OB-GYNs, midwives, doulas, lactation, sleep and potty training consultants, speech therapists and child psychologists to name a few.

Mental Health. Employees and their dependents each have 16 annual sessions with skilled coaches and therapists at no cost, and access to mental health doctors. You can also take advantage of free access to a leading mindfulness app and five guest accounts for household members.

Onsite Services. Employees based in our NYC locations have access to health centers, mental health counseling, fitness centers, physical therapy and restorative suites at the office. Many services are free or subsidized.

Perks. And we can’t forget the fun stuff. You’ll enjoy hundreds of perks and discounts on automobiles, electronics, retail merchants, travel, entertainment, museums and more.