Talent.com
Senior Cloud & Big Data Engineer
Senior Cloud & Big Data EngineerSystemtec • Columbia, SC, United States
[error_messages.no_longer_accepting]
Senior Cloud & Big Data Engineer

Senior Cloud & Big Data Engineer

Systemtec • Columbia, SC, United States
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Senior Cloud & Big Data Engineer

SYSTEMTEC is seeking a Senior Cloud & Big Data Engineer for a hybrid opportunity in the Columbia, SC area. This candidate will be responsible for designing, building, and optimizing data-driven solutions using modern cloud technologies. This role focuses on AWS-based data architecture, big data processing, and scalable systems design.

Required Qualifications of the Senior Cloud & Big Data Engineer :

  • Applicants must be authorized to work for any employer in the U.S. We are unable to provide sponsorship or work with Third-Party agencies.
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
  • Required Technologies :

7+ years of technical experience with at least 3 years managing Databricks environments in production at enterprise scale

  • Deep expertise with Databricks Unity Catalog, Delta Lake, Delta Live Tables, SQL Warehouses, and medallion architecture implementations
  • Hands-on experience administering Databricks workspaces, metastores, cluster policies, jobs, and serverless compute
  • Proven ability to design and maintain Infrastructure-as-Code solutions (AWS CloudFormation, CDK, Github Actions, or Similar) for Databricks and AWS resource provisioning.
  • Experience integrating Databricks with Azure AD / Entra for identity and access governance
  • Strong Understanding of FinOps practices, including tagging standards, cost analysis, and optimization for cloud compute
  • Working knowledge of data ingestion patterns (batch, streaming, CDC) to support data engineering enablements.
  • Nice to have Technologies :

    • R R Studio / Posit Workbench R Shiny / Posit Connect Posit Package Manager Amazon Bedrock

    Responsibilities of the Senior Cloud & Big Data Engineer :

  • Serve as a technical expert for the business unit's implementation of the corporate Databricks platform .
  • Contribute to the setup, configuration, and governance of Databricks, including Unity Catalog, medallion architecture, and secure data-sharing capabilities.
  • Participate in defining and executing the technical strategy to deliver reliable, secure, and high-performing analytics solutions.
  • Support the organization's Data & Analytics platform , ensuring stability, scalability, and compliance.
  • Collaborate with cross-functional technology teams to solve business problems and deliver innovative solutions.
  • Enable and monitor observability, lineage, and governance features at the platform level.
  • Define and enforce secure data access patterns, logical data controls, and Unity Catalog policies for compliant reporting and visualization.
  • Manage Unity Catalog administration , workspace binding, and metastore configuration while enforcing catalog-level RBAC .
  • Oversee cluster policy enforcement , compute governance , and FinOps optimization to maintain cost-effective and secure operations across environments

    • Work Location : Columbia, SC (Hybrid in office Tuesday - Thursday)

    Compensation / Benefits :

    Full-Time Employment with SYSTEMTEC means competitive compensation, access to health, dental, disability, and life coverage, 401K +

  • Please note : We are not currently able to hire candidates who reside or work in California, New York, or New Jersey.
    • [job_alerts.create_a_job]

    Cloud Data Engineer • Columbia, SC, United States

    [internal_linking.related_jobs]
    Sr. Data Engineer

    Sr. Data Engineer

    Contact Government Services, Llc • Columbia, South Carolina, United States
    [job_card.full_time]
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data Analyst III

    Data Analyst III

    US Tech Solutions • Columbia, SC, US
    [job_card.temporary]
    Duration : 12+ Months Contract (Possible temp to hire).Hours / Schedule : Schedule : 8 : 30am to 5pm with a 30-minute lunch or 8 to 5 with an hour lunch - Potential OT. Day to day : There is a development a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Lead Data Engineer

    Lead Data Engineer

    Omega Solutions • Columbia, South Carolina, United States
    [filters.remote]
    [job_card.full_time]
    Oracle or PostgreSQL) and ETL Pipelines and Big Data and AWS.Uses structured tools for analysis and presentation of concepts and models to enhance the BRD. Develop, maintain and deliver training mat...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Transmission Sales Engineer (Northeast) - Remote

    Transmission Sales Engineer (Northeast) - Remote

    Hubbell Incorporated • Columbia, SC, United States
    [filters.remote]
    [job_card.full_time]
    The Transmission Sales Engineer position is responsible for growing HPS sales through knowledge of the HPS Products, planning & tracking the opportunities within the area, and growing the HPS custo...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Developer

    Senior Developer

    Spectraforce Technologies • Columbia, SC, United States
    [job_card.full_time]
    Duration : 6 Months (possibility of extension / conversion).Responsible for analysis, design, programming, and implementation of the most complex applications tasks and projects in the area.Devise fea...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Financial Analyst - Global Tech Cloud

    Senior Financial Analyst - Global Tech Cloud

    Oracle • Columbia, SC, United States
    [job_card.full_time]
    As a member of the Global Tech Central Finance organization, you will be responsible for managing and analyzing the entire Tech Cloud consumption-to-revenue lifecycle. This includes forecasting, bud...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    DataInformation Architect Advanced

    DataInformation Architect Advanced

    vTech Solution • Blythewood, South Carolina, USA
    [job_card.full_time]
    The Data / Information Architect - Advanced will be responsible for data modeling in support of a system data modernization project. This role requires strong data modeling experience using ERWIN or a...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Network Engineer

    Senior Network Engineer

    BuzzClan • Columbia, South Carolina Metropolitan Area, United States
    [job_card.full_time]
    Candidate should demonstrate expert level skills for monitoring, maintaining, and troubleshooting a statewide network (WAN, LAN and wireless), primarily with CISCO and Meraki technology.CISCO firew...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Cybersecurity Engineer

    Senior Cybersecurity Engineer

    The Nuclear Company • Columbia, SC, US
    [job_card.full_time]
    The Nuclear Company is the fastest growing startup in the nuclear and energy space creating a never before seen fleet-scale approach to building nuclear reactors. Through its design-once, build-many...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Ewin Engineer

    Ewin Engineer

    United Global Technologies • Columbia, SC, US
    [job_card.full_time]
    Candidate Location : Candidate MUST be a SC resident or willing to relocate to SC prior to starting the role at their own expense. ERWIN data or similar data modeling tool.Oracle 18 / 19 DBA and / or SQL...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Analytics and Data Manager

    Analytics and Data Manager

    InsideHigherEd • Columbia, South Carolina, United States
    [job_card.full_time]
    Business Title (Internal Title) : .Division of Academic Affairs and Provost.PROV Graduation and Retention Network.Salary commensurate with qualifications. AM to 5 : 00 PM, Monday through Friday.About Un...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Governance Manager

    Data Governance Manager

    InsideHigherEd • Columbia, South Carolina, United States
    [job_card.full_time]
    Business Title (Internal Title) : .Division of Information Technology.Salary is commensurate with experience.Standard working schedule : Monday – Friday 8 : 30am – 5 : 00pm, with 1 hour for lunch.Must be ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Network Cloud Engineer

    Sr. Network Cloud Engineer

    ExecRecruitment • Columbia, SC, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    ExecRecruitment is a global professional services provider and contingency staffing company.Our main objective is to source top talent and support professional growth. One of our direct clients is a...[show_more]
    [last_updated.last_updated_30]
    Data Architect

    Data Architect

    InsideHigherEd • Columbia, South Carolina, United States
    [job_card.full_time]
    From the Upstate to the Lowcountry, the University of South Carolina system is transforming the lives of South Carolinians through the impact of our eight institutions and 20 locations throughout t...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Developer (Columbia)

    Senior Developer (Columbia)

    SSi People • Columbia, South Carolina Metropolitan Area, US
    [job_card.part_time]
    Senior Developer Databricks Engineer.This hybrid role (3 days onsite per week) will focus on building and managing Databricks solutions at enterprise scale. Youll play a critical role in shaping th...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Senior Network Engineer (Columbia)

    Senior Network Engineer (Columbia)

    BuzzClan • Columbia, South Carolina Metropolitan Area, US
    [job_card.part_time]
    Candidate should demonstrate expert level skills for monitoring, maintaining, and troubleshooting a statewide network (WAN, LAN and wireless), primarily with CISCO and Meraki technology.CISCO firew...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Senior Developer

    Senior Developer

    SSi People • Columbia, South Carolina Metropolitan Area, United States
    [job_card.full_time]
    Senior Developer – Databricks Engineer.This hybrid role (3 days onsite per week) will focus on building and managing Databricks solutions at enterprise scale. You’ll play a critical role in shaping ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted]
    Data Analyst III (Columbia)

    Data Analyst III (Columbia)

    US Tech Solutions • Columbia, SC, US
    [job_card.part_time] +1
    Duration : 12+ Months Contract (Possible temp to hire).Hours / Schedule : Schedule : 8 : 30am to 5pm with a 30-minute lunch or 8 to 5 with an hour lunch - Potential OT. Day to day : There is a development a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]