Big data engineer Jobs in Columbia, SC

POSITION TITLE:Protocol Data Engineer LOCATION:Remote CLEARANCE:Must be able to obtain aHigh-RiskPublic Trust COMPANY OVERVIEW At APV,weremore than a technology company werea mission-driven powerhouse transforming organizations through advanced technology and human ingenuity. Ourexpertisespans AI/ML, data architecture, low-code/no-code development, AgileDevSecOps, and cloud services, delivering scalable and meaningful solutions. In our Emerging Technology Lab, innovation drives progress. Our teams create intelligent chatbots, AI-powered assistants, robotic process automation (RPA), essay graders, and data analytics platforms. Ifyourepassionate about solving complex challenges and shaping the future, APV is the place for you. Since 2007,wevepartnered with federal and state agencies to deliver IT, training, and consulting solutions that achieve mission-critical outcomes. Built on accountability, integrity, and quality, we go beyond expectations.With 70+ prime contracts and a proven record of client success, APV continues to grow andwerelooking for exceptional talent to grow with us. At APV, we Always Provide Value POSITION SUMMARY Provides hands-on data engineering and database implementation expertise to operationalize structured protocol data models and support the FDA proof of concept for AI-assisted clinical trial protocol review. The role translates approved clinical, standards, and technical models into scalable data structures, transformations, retrieval workflows, and traceable outputs within FDA-approved environments. DUTIES Implement protocol data structures and physical schemas that support extraction, normalization, storage, retrieval, comparison, and reviewer-facing use of both ICH M11-aligned and historical protocols.Translate approved ICH M11, CDISC USDM, ontology, metadata, and terminology models into practical database structures and data-engineering components for the POC.Develop and support ETL/ELT pipelines and data transformations for protocol content and structured outputs, preserving source provenance, metadata, assumptions, validation status, and reviewer feedback.Support retrieval-augmented generation (RAG), semantic retrieval, indexing, evidence caching, and protocol comparison components in collaboration with AI/prompt engineering and standards SMEs.Support integration with FDA-furnished Elsa/HALO capabilities and FDA-approved data services, including PostgreSQL and/or HALO/Databricks, for protocol evidence caching, retrieval, analytics, and dashboard-ready outputs.Develop advanced SQL and data-access logic supporting protocol extraction, historical retrieval and comparison, reviewer dashboards, and traceability to source evidence.Execute data-focused quality assurance, reconciliation, validation, and regression testing, including checks for completeness, mapping consistency, retrieval quality, unsupported values, ambiguity, and reproducibility.Document data models, interfaces, transformations, mappings, implementation decisions, technical limitations, and operational considerations to support FDA review, knowledge transfer, and future expansion. Works closely with clinical protocol, data standards, architecture, interoperability, and AI/prompt engineering SMEs.Participates in FDA technical working sessions, POC demonstrations, validation activities, and iterative refinement based on reviewer feedback. Supports implementation within FDA-provided platforms and approved data environments; the base effort is a POC and does not require a separate production platform. Contributes practical database engineering and data-quality expertise while relying on designated SMEs for clinical interpretation and standards governance. EDUCATION BS degree in Computer Science, Mathematics, Data Science or relevant technical field. REQUIRED QUALIFICATIONS Extensive experience in database engineering, data architecture, information modeling, and analytics in complex enterprise environments. Strong expertise in relational and dimensional data modeling, metadata management, ETL/ELT design, data warehousing, and data quality. Advanced SQL skills, including PostgreSQL/PLpgSQL and/or Oracle PL/SQL; SQL Server experience is beneficial. Experience with AWS data services and cloud database platforms such as Aurora PostgreSQL, Redshift, S3, Glue, Lambda, and DMS. Experience integrating JSON/XML data and RESTful APIs; working knowledge of Python and CI/CD practices is beneficial. Federal health, clinical research, or regulated-environment experience is preferred; familiarity with FISMA/NIST controls is beneficial. ABOUT APV APV is an Equal Employment Opportunity employer. All qualified applicants are considered without regard to race, color, religion, sex, national origin, age, disability, genetic information, sexual orientation, gender identity, veteran status, or marital status.