Talent.com
Cybersecurity Ethics and LLM Evaluation Specialist
Cybersecurity Ethics and LLM Evaluation SpecialistTetrad Digital Integrity LLC • MD, US
Cybersecurity Ethics and LLM Evaluation Specialist

Cybersecurity Ethics and LLM Evaluation Specialist

Tetrad Digital Integrity LLC • MD, US
[job_card.variable_days_ago]
[job_preview.job_type]
  • [job_card.permanent]
  • [filters_job_card.quick_apply]
[job_card.job_description]

Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age.

We are seeking a highly skilled and experienced Cybersecurity Ethics & LLM Evaluation Specialist to contribute to a cutting-edge project.

The core focus of this role is to test and evaluate a Large Language Model's (LLM) ability to make sound ethical decisions within the context of penetration testing and ethical hacking scenarios.

RESPONSIBILITIES :

  • Crafting complex ethical dilemmas encountered in real-world cybersecurity practices to meticulously evaluate an model's capability against industry best practices, legal frameworks, and established ethical guidelines.  Design and write nuanced, realistic ethical dilemma questions and scenarios specifically tailored to penetration testing and ethical hacking.
  • These scenarios should probe the LLM's understanding of reasoning through complex cyber constraints and ethical quandaries.
  • Develop effective prompts and responses based on the developed scenarios to elicit detailed responses from the LLM while adhering to relevant cybersecurity industry standards (e.g., NIST, ISO 27001).
  • Establish ethical guidelines and codes of conduct for cybersecurity professionals (e.g., from SANS, (ISC)², CREST, EC-Council).

QUALIFICAITONS :

  • Bachelor's degree in Cybersecurity, Computer Science, or a related field. 5+ years in penetration testing, ethical hacking, or security consulting.
  • Certifications :

  • Certified Ethical Hacker (CEH), Offensive Security Certified Professional (OSCP) Strong understanding of ethical hacking methodologies, experience with vulnerability assessment tools, and knowledge of legal and ethical considerations in cybersecurity.
  • Demonstrable, in-depth understanding and practical experience with :

  • industry standards (e.g., NIST Cybersecurity Framework, OWASP Top 10, PTES).
  • Relevant laws and regulations pertaining to cybercrime, data privacy, and computer misuse.  Ethical guidelines and codes of conduct for cybersecurity professionals.
  • Proven ability to conceptualize and articulate complex technical and ethical scenarios in a clear and understandable manner.
  • Ability to write clear, concise, and well-structured prompts, evaluations, and reports.
  • Familiarity with a range of historical and contemporary cyber incidents and the ethical dilemmas they presented.
  • Foundational understanding of what Large Language Models are, how they generate responses, and their general capabilities and limitations.
  • You do not need to be an AI developer, but you should understand how to interact with an LLM.
  • TDI does business with the federal government, which restricts employment to individuals who are either US citizens or lawful permanent residents of the United States. “TDI is an Equal Opportunity Employer.
  • Employment decisions are made based on individual qualifications, merit, and business needs.
  • We do not discriminate in employment opportunities or practices based on race, color, religion, sex, or national origin, in accordance with applicable federal laws.” Powered by JazzHR
  • [job_alerts.create_a_job]

    Cybersecurity Specialist • MD, US

    [internal_linking.related_jobs]
    Identity Access Management (IAM) Manager - Cyber Security - Bowie, MD

    Identity Access Management (IAM) Manager - Cyber Security - Bowie, MD

    WesBanco Bank Inc. • Bowie, MD, United States
    [job_card.full_time] +1
    Identity Access Management (IAM) Manager - Cyber Security.Bowie, Maryland, United States.This position is 100% remote within the Bank's footprint. Employee will work full time remote outside of a We...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Systems Engineer / Team Lead

    Senior Systems Engineer / Team Lead

    TSymmetry • Cheltenham, MD, United States
    [job_card.full_time]
    Senior Systems Engineer / Team Lead.Tsymmetry is an IT professional services company dedicated to delivering flexible, scalable solutions to our customers around the globe when and where their miss...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Part-Time Faculty- Cybersecurity, Networking and Digital Forensics

    Part-Time Faculty- Cybersecurity, Networking and Digital Forensics

    InsideHigherEd • Arnold, Maryland, United States
    [job_card.full_time] +1
    Part-Time Faculty- Cybersecurity, Networking and Digital Forensics.Cybersecurity, Network & Dig Forensics.This position requires regular in-person presence on campus and at alternative locations, d...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AVP, Health Economics and Outcomes Research

    AVP, Health Economics and Outcomes Research

    Inovalon, Inc. • Bowie, MD, United States
    [job_card.full_time]
    Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and ec...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Release of Information Specialist

    Release of Information Specialist

    Greater Baltimore Medical Center (GBMC) • Baltimore, MD, United States
    [job_card.full_time]
    Under limited supervision collects, processes, analyzes, compiles and secures accurate health information.Ensures the hospital health information is consistent with ethical, legal and regulatory re...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cryptologic Operations Advisor

    Cryptologic Operations Advisor

    Leidos Inc • Odenton, MD, United States
    [job_card.full_time]
    Are you ready to make an impact and join a small, tight-knit group of professionals? We're looking for innovative minds with experience in Space operations to help the nation's youngest military se...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Field Reimbursement Specialist

    Field Reimbursement Specialist

    AmerisourceBergen Corporation (Cencora) • Baltimore, MD, United States
    [job_card.full_time]
    Our team members are at the heart of everything we do.At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Project Quotations Specialist

    Project Quotations Specialist

    Sonepar USA • Upper Marlboro, MD, United States
    [job_card.full_time]
    There's a Place for You at Capital.A career at Capital Electric is more than a job.You're investing in a brighter, more sustainable future together and joining a team that makes a real difference f...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Evaluation Consultant (Remote)

    Evaluation Consultant (Remote)

    Scale AI • Baltimore, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    Join a global community of talented professionals to shape the future of AI.Earn up to $15 USD / hr and additional rewards based on quality of submission. Outlier is committed to improving the intelli...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Lead Security Engineer - Cyber Security

    Lead Security Engineer - Cyber Security

    Relativity • Baltimore, MD, United States
    [job_card.full_time]
    As a Lead Cyber Security Engineer, you will ensure the security of Relativity's network and infrastructure.In this role, the main responsibilities will be to investigate and analyze emerging threat...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Internal Audit - SOX Senior Manager

    Internal Audit - SOX Senior Manager

    Coinbase • Baltimore, Maryland, United States
    [filters.remote]
    [job_card.full_time]
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Engineering Analyst, Strategic / Reliability

    Engineering Analyst, Strategic / Reliability

    Constellation Energy • Huntingtown, MD, US
    [job_card.full_time]
    As the nation's largest producer of clean, carbon-free energy, Constellation is focused on our purpose : accelerating the transition to a carbon-free future. We have been the leader in clean ener...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Principal, IT Governance, Risk and Compliance (GRC)

    Senior Principal, IT Governance, Risk and Compliance (GRC)

    American Red Cross • Baltimore, MD, United States
    [job_card.full_time]
    Please use Google Chrome or Mozilla Firefox when accessing Candidate Home.By joining the American Red Cross you will touch millions of lives every year and experience the greatness of the human spi...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Remote Text Quality Evaluator

    Remote Text Quality Evaluator

    Outlier • Baltimore, MD, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Partner- Forensic, Litigation & Valuation Services

    Partner- Forensic, Litigation & Valuation Services

    EisnerAmper • Owings Mills, MD, United States
    [job_card.full_time]
    At EisnerAmper, we look for individuals who welcome new ideas, encourage innovation, and are eager to make an impact.Whether you're starting out in your career or taking your next step as a seasone...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI / ML Compliance Engineer

    AI / ML Compliance Engineer

    C2 Labs • Baltimore, Maryland, United States
    [job_card.full_time]
    IT transformation journey via data-driven IT strategic planning, application rationalization and redevelopment, and innovative research and development of new industry standards and technologies.C2...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Finance Buzz • Hughesville, Maryland, US
    [filters.remote]
    [job_card.temporary]
    Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Geopolitics Forecaster - AI Trainer ($105-$125 per hour)

    Remote Geopolitics Forecaster - AI Trainer ($105-$125 per hour)

    Mercor • Baltimore, Maryland, US
    [filters.remote]
    [job_card.full_time]
    Role Overview Mercor is collaborating with a leading AI lab on a cutting-edge research initiative involving top superforecasters from around the world. We’re seeking geopolitical experts to contribu...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]