Talent.com
Principal - Security Architect - Artificial Intelligence (AI/LLM)
Principal - Security Architect - Artificial Intelligence (AI/LLM)Ally • 601 S. Tryon Street, NC, United States
Principal - Security Architect - Artificial Intelligence (AI/LLM)

Principal - Security Architect - Artificial Intelligence (AI/LLM)

Ally • 601 S. Tryon Street, NC, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [job_card.part_time]
[job_card.job_description]

The Opportunity

At Ally, you get a startup feel, but experience the benefits of a company that has worked out the kinks and is fulfilling its purpose. We are always evolving and see that as a good thing. From owning our work to seeing its impact in the real world, our team is relentless in finding new ways technology can help make experiences better and help people. We are problem solvers, we value diverse thinking, we support one another, and we challenge ourselves to think bigger in the journey to deliver customer-obsessed tech solutions. To read more about what our tech team does, be sure to visit our tech blog at ally.tech

As the Principal - Security Architect - Artificial Intelligence (AI/LLM), you will lead the design, implementation, and governance of security architectures for AI-driven systems and platforms. You will ensure that AI solutions are secure by design, compliant with regulatory requirements, and resilient against evolving threats. Your expertise will guide cross-functional teams in adopting best practices, developing secure patterns, and shaping the technology strategy and roadmap for AI security across the organization. This is a mid-level to senior-level highly technical role that will serve as a mentor to more junior architects and will report to Head of Security Architecture.

At this time, Ally will not sponsor a new applicant for employment authorization for this position.

The Work Itself

  • Lead comprehensive security reviews of AI systems, applications, and infrastructure to identify and mitigate risks.
  • Conduct threat modeling for AI and machine learning solutions, ensuring robust protection against adversarial attacks and data breaches.
  • Evaluate vendors and emerging technologies for security posture, integration capabilities, and alignment with organizational standards.
  • Develop and maintain technology strategy and security roadmaps for AI initiatives, ensuring alignment with business objectives and regulatory requirements.
  • Establish and promote secure architecture patterns, frameworks, and guidelines for AI development and deployment.
  • Collaborate with engineering, data science, product, and compliance teams to embed security throughout the AI lifecycle.
  • Provide expert guidance on network security, data security, cloud security, and identity & access management (IAM) in the context of AI systems.
  • Present complex security concepts and recommendations to technical and non-technical stakeholders, including executive leadership.
  • Build and nurture relationships with internal and external partners to advance the organization’s AI security posture.
  • Stay abreast of emerging threats, technologies, and regulatory changes impacting AI security.

The Skills You Bring

Minimum Qualifications:

  • 7+ years of relevant experience or equivalent combination of education and experience
  • High School Diploma or GED equivalent

Preferred Qualifications

  • 5+ years of experience in security architecture, with significant exposure to AI/ML systems and cloud environments.
  • Experience with Model Context Protocol (MCP) and securing the infrastructure that supports it.
  • Ability to mentor and coach a technical team, leading by example.
  • Deep knowledge of network security, data security, cloud security (AWS, Azure, GCP), and IAM principles.
  • Proven experience conducting security reviews, threat modeling, and vendor/technology evaluations.
  • Demonstrated ability to develop technology strategies, roadmaps, and secure architecture patterns based on evolving security threats and industry trends.
  • Strong understanding of financial industry regulatory frameworks (such as is FFIEC, PCI DSS, and SOX) and cybersecurity frameworks (such as NIST and CIS)
  • Excellent communication and presentation skills, with the ability to convey complex concepts to diverse audiences.
  • Exceptional relationship-building and collaboration skills across technical and business teams.
  • Relevant certifications (e.g., CISSP, CCSP, AWS/Azure Security, TOGAF) are highly desirable.
  • Bachelor’s or equivalent experience in Computer Science, Information Security, or related field.

#LI-Hybrid

How We'll Have Your Back

Ally's compensation program offers market-competitive base pay and pay-for-performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry-leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including:

  • Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).
  • Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.
  • Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.
  • Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.
  • Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs.
  • Other compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.
[job_alerts.create_a_job]

Principal - Security Architect - Artificial Intelligence (AI/LLM) • 601 S. Tryon Street, NC, United States

[internal_linking.similar_jobs]

Principle Enterprise Security Architect - Director

SMBC GroupCharlotte, NC, United States
[job_card.full_time]

Principle Enterprise Security Architect - Director.Join to apply for the Principle Enterprise Security Architect - Director role at SMBC Group.SMBC Group is a top-tier global financial group, headq...[internal_linking.show_more]

 • [job_card.promoted]

Enterprise AI Architect

E-SolutionsFort Mill, SC, United States
[job_card.full_time]

Proven expertise in AI strategy, operating models, and capability building.Strong solution design, implementation understanding of Machine Learning, Generative AI, and Agentic AI (strategic view an...[internal_linking.show_more]

 • [job_card.promoted]

IAM/Security Infrastructure Architect

Open Systems TechnologiesCharlotte, NC, US
[job_card.full_time]

A financial firm is looking for an IAM/Security Infrastructure Architect to join their team in Charlotte, NC.Compensation: $150-195k US Citizen/GC Holders Only; No visa sponsorship Candidates must ...[internal_linking.show_more]

 • [job_card.promoted]

IAM Architect

United IT SolutionsCharlotte, NC, United States
[job_card.full_time]

Location : Charlotte, NC / Dallas, TX (Hybrid).We are seeking a highly experienced Identity and Access Management (IAM) Architect to lead the design, development, and implementation of enterprise-w...[internal_linking.show_more]

 • [job_card.promoted]

GenAI Solution Architect — Scalable AI Infra & LLMs

Inizio Partners CorpCharlotte, NC, United States
[job_card.full_time]

A technology consulting firm in Charlotte is seeking a highly experienced Solution Architect to lead engineering teams in designing and delivering scalable, enterprise-grade frameworks for analytic...[internal_linking.show_more]

 • [job_card.promoted]

Principle Enterprise Security Architect - Director

SMBCCharlotte, NC, United States
[job_card.full_time]

SMBC Group is a top-tier global financial group.Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, ...[internal_linking.show_more]

 • [job_card.promoted]

AI/ML Engineer

AkkodisCharlotte, NC, United States
[job_card.full_time]

You will automate root cause analysis workflows to reduce incident response times and collaborate with cross-functional teams to identify AI use cases for scalable solutions.The rate may be negotia...[internal_linking.show_more]

 • [job_card.promoted]

Lead Identity Access Management Architect

CliftonLarsonAllenCharlotte, NC, United States
[job_card.full_time]

CLA is a top 10 national professional services firm where.Even with more than 8,500 people, 130 U.CLA is dedicated to building a culture that invites different beliefs and perspectives to the table...[internal_linking.show_more]

 • [job_card.promoted]

Senior AI Architect - HR Systems & Technology

Charter CommunicationsCharlotte, NC, United States
[job_card.full_time]

This role requires the ability to work lawfully in the U.This position is not eligible for immigration sponsorship.Curious about how advanced AI can transform HR operations and employee experience?...[internal_linking.show_more]

 • [job_card.promoted]

AVP, Product Security Architect

Synchrony FinancialCHARLOTTE, North Carolina, United States
[job_card.full_time]

AVP, Product Security Architect.Synchrony’s application and SaaS ecosystem.This role operates at L11 scope—.The AVP will lead the definition of an.Application Security Blueprint.Set product securit...[internal_linking.show_more]

 • [job_card.promoted]

Director, Google Cloud Security, Solution Architect

KPMGCharlotte, NC, United States
[job_card.full_time]

KPMG Advisory practice is currently our fastest growing practice.We are seeing tremendous client demand, and looking forward we do not anticipate that slowing down.In this ever-changing market envi...[internal_linking.show_more]

 • [job_card.promoted]

Senior AI Architect – HR Systems & Technology

SPECTRUMCHARLOTTE, North Carolina, United States
[job_card.full_time]

This role requires the ability to work lawfully in the U.This position is not eligible for immigration sponsorship.Curious about how advanced AI can transform HR operations and employee experience?...[internal_linking.show_more]

 • [job_card.promoted]

Sr. Security Research Engineer

ProofpointCharlotte, NC, United States
[job_card.full_time]

Proofpoint is a global leader in human- and agent-centric cybersecurity.We protect how people, data, and AI agents connect across email, cloud, and collaboration tools.Over 80 of the Fortune 100, 1...[internal_linking.show_more]

 • [job_card.promoted]

Lead AI Architect, HR Technology Solutions

SpectrumCharlotte, NC, United States
[job_card.full_time]

This role requires the ability to work lawfully in the U.This position is not eligible for immigration sponsorship.Do you thrive at the intersection of AI technology and HR transformation? Spectrum...[internal_linking.show_more]

 • [job_card.promoted]

AI / ML Engineer

Datum Technologies LLCCharlotte, NC, United States
[job_card.full_time]

Job Description: AI Engineer - Conversational AI / IVR.Design, develop, and maintain AI solutions for IVR and conversational AI platforms.Implement LLM-based workflows, including prompt engineering...[internal_linking.show_more]

 • [job_card.promoted]

Principle Enterprise Security Architect - Director

Sumitomo Mitsui Financial Group, Inc.Charlotte, NC, United States
[job_card.full_time]

SMBC Group is a top-tier global financial group.Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, ...[internal_linking.show_more]

 • [job_card.promoted]

Lead Artificial Intelligence Engineer

CoforgeFort Mill, SC, United States
[job_card.full_time]

Skills: AI Architect, Model Context Protocol (MCP), AWS Terraform, Amazon Bedrock (Claude), SageMaker, and Kendra, Agentic framework.Location: Fort mill, SC (Onsite 3 days).We at Coforge are hiring...[internal_linking.show_more]

 • [job_card.promoted]

Associate Principal - Architecture

Futran Tech Solutions Pvt. Ltd.Charlotte, NC, United States
[job_card.full_time]

A Data Architect is responsible for designing creating deploying and managing an organizations data architecture Play a crucial role in helping organizations to store retrieve and analyze data effe...[internal_linking.show_more]