Talent.com
Cybersecurity Ethics and LLM Evaluation Specialist
Cybersecurity Ethics and LLM Evaluation SpecialistTetrad Digital Integrity LLC • MD, US
Cybersecurity Ethics and LLM Evaluation Specialist

Cybersecurity Ethics and LLM Evaluation Specialist

Tetrad Digital Integrity LLC • MD, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.permanent]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age.

We are seeking a highly skilled and experienced Cybersecurity Ethics & LLM Evaluation Specialist to contribute to a cutting-edge project.

The core focus of this role is to test and evaluate a Large Language Model's (LLM) ability to make sound ethical decisions within the context of penetration testing and ethical hacking scenarios.

RESPONSIBILITIES :

  • Crafting complex ethical dilemmas encountered in real-world cybersecurity practices to meticulously evaluate an model's capability against industry best practices, legal frameworks, and established ethical guidelines.  Design and write nuanced, realistic ethical dilemma questions and scenarios specifically tailored to penetration testing and ethical hacking.
  • These scenarios should probe the LLM's understanding of reasoning through complex cyber constraints and ethical quandaries.
  • Develop effective prompts and responses based on the developed scenarios to elicit detailed responses from the LLM while adhering to relevant cybersecurity industry standards (e.g., NIST, ISO 27001).
  • Establish ethical guidelines and codes of conduct for cybersecurity professionals (e.g., from SANS, (ISC)², CREST, EC-Council).

QUALIFICAITONS :

  • Bachelor's degree in Cybersecurity, Computer Science, or a related field. 5+ years in penetration testing, ethical hacking, or security consulting.
  • Certifications :

  • Certified Ethical Hacker (CEH), Offensive Security Certified Professional (OSCP) Strong understanding of ethical hacking methodologies, experience with vulnerability assessment tools, and knowledge of legal and ethical considerations in cybersecurity.
  • Demonstrable, in-depth understanding and practical experience with :

  • industry standards (e.g., NIST Cybersecurity Framework, OWASP Top 10, PTES).
  • Relevant laws and regulations pertaining to cybercrime, data privacy, and computer misuse.  Ethical guidelines and codes of conduct for cybersecurity professionals.
  • Proven ability to conceptualize and articulate complex technical and ethical scenarios in a clear and understandable manner.
  • Ability to write clear, concise, and well-structured prompts, evaluations, and reports.
  • Familiarity with a range of historical and contemporary cyber incidents and the ethical dilemmas they presented.
  • Foundational understanding of what Large Language Models are, how they generate responses, and their general capabilities and limitations.
  • You do not need to be an AI developer, but you should understand how to interact with an LLM.
  • TDI does business with the federal government, which restricts employment to individuals who are either US citizens or lawful permanent residents of the United States. “TDI is an Equal Opportunity Employer.
  • Employment decisions are made based on individual qualifications, merit, and business needs.
  • We do not discriminate in employment opportunities or practices based on race, color, religion, sex, or national origin, in accordance with applicable federal laws.” Powered by JazzHR
  • [job_alerts.create_a_job]

    Cybersecurity Specialist • MD, US

    [internal_linking.related_jobs]
    Content Evaluation Specialist (Remote)

    Content Evaluation Specialist (Remote)

    Scale AI • Baltimore, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Identity Access Management (IAM) Manager - Cyber Security - Bowie, MD

    Identity Access Management (IAM) Manager - Cyber Security - Bowie, MD

    WesBanco Bank Inc. • Bowie, MD, United States
    [job_card.full_time] +1
    Identity Access Management (IAM) Manager - Cyber Security.Bowie, Maryland, United States.This position is 100% remote within the Bank's footprint. Employee will work full time remote outside of a We...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Systems Engineer / Team Lead

    Senior Systems Engineer / Team Lead

    TSymmetry • Cheltenham, MD, United States
    [job_card.full_time]
    Senior Systems Engineer / Team Lead.Tsymmetry is an IT professional services company dedicated to delivering flexible, scalable solutions to our customers around the globe when and where their miss...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Part-Time Faculty- Cybersecurity, Networking and Digital Forensics

    Part-Time Faculty- Cybersecurity, Networking and Digital Forensics

    InsideHigherEd • Arnold, Maryland, United States
    [job_card.full_time] +1
    Part-Time Faculty- Cybersecurity, Networking and Digital Forensics.Cybersecurity, Network & Dig Forensics.This position requires regular in-person presence on campus and at alternative locations, d...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AVP, Health Economics and Outcomes Research

    AVP, Health Economics and Outcomes Research

    Inovalon, Inc. • Bowie, MD, United States
    [job_card.full_time]
    Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and ec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cryptologic Operations Advisor

    Cryptologic Operations Advisor

    Leidos Inc • Odenton, MD, United States
    [job_card.full_time]
    Are you ready to make an impact and join a small, tight-knit group of professionals? We're looking for innovative minds with experience in Space operations to help the nation's youngest military se...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Legal and Compliance Specialist

    Legal and Compliance Specialist

    Inovalon, Inc. • Bowie, MD, United States
    [job_card.full_time]
    Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and ec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    VP - Global CIO Advisory - Gartner Research Board

    VP - Global CIO Advisory - Gartner Research Board

    Gartner • Baltimore, MD, United States
    [job_card.full_time]
    VP - Program Director - CIO Advisory - Research Board.The Gartner Research Board (GRB) is Gartner's dedicated service for the senior-most technology and digital leaders and their functional direct ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Finance Buzz • North Beach, Maryland, US
    [filters.remote]
    [job_card.temporary]
    Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Security Engineer - Cyber Security

    Lead Security Engineer - Cyber Security

    Relativity • Baltimore, MD, United States
    [job_card.full_time]
    As a Lead Cyber Security Engineer, you will ensure the security of Relativity's network and infrastructure.In this role, the main responsibilities will be to investigate and analyze emerging threat...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Internal Audit - SOX Senior Manager

    Internal Audit - SOX Senior Manager

    Coinbase • Baltimore, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Specialist, Technical Evaluations & Proposals

    Senior Specialist, Technical Evaluations & Proposals

    Resilience • Baltimore, MD, United States
    [job_card.full_time]
    A career at Resilience is more than just a job - it's an opportunity to change the future.Resilience is a technology-focused biomanufacturing company that's. We're building a sustainable network of ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Cybersecurity Analyst (Remote)

    Cybersecurity Analyst (Remote)

    Scale AI • Baltimore, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Engineering Analyst, Strategic / Reliability

    Engineering Analyst, Strategic / Reliability

    Constellation Energy • Benedict, MD, US
    [job_card.full_time]
    As the nation's largest producer of clean, carbon-free energy, Constellation is focused on our purpose : accelerating the transition to a carbon-free future. We have been the leader in clean ener...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Principal, IT Governance, Risk and Compliance (GRC)

    Senior Principal, IT Governance, Risk and Compliance (GRC)

    American Red Cross • Baltimore, MD, United States
    [job_card.full_time]
    Please use Google Chrome or Mozilla Firefox when accessing Candidate Home.By joining the American Red Cross you will touch millions of lives every year and experience the greatness of the human spi...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Remote Text Quality Evaluator

    Remote Text Quality Evaluator

    Outlier • Baltimore, MD, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI / ML Compliance Engineer

    AI / ML Compliance Engineer

    C2 Labs • Baltimore, Maryland, United States
    [job_card.full_time]
    IT transformation journey via data-driven IT strategic planning, application rationalization and redevelopment, and innovative research and development of new industry standards and technologies.C2...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Enterprise Resource Planning Specialist

    Enterprise Resource Planning Specialist

    Whole Foods Market • North Beach, MD, US
    [job_card.full_time]
    A career at Whole Foods Market is more than just the work you do- it's about your personal growth and creating meaningful change. Our purpose is to nourish people and the planet.That means improving...[show_more]
    [last_updated.last_updated_1_hour] • [promoted] • [new]