Data Bricks Data Engineer

For over 17 years, Trilyon has been a leader in global workforce solutions, specializing in Cloud Technology, AI/ML, Software Development, Technical Writing, and Digital Transformation. We partner with top companies to deliver high-quality talent in engineering, IT, and emerging technologies. For additional information or to view all of our job opportunities, please visit our website https://trilyonservices.com/careers/

We are seeking a Data Bricks Data Engineer to join our team. This role will involve designing and building scalable data pipelines, managing Azure Databricks environments, and enabling data-driven decision-making across the organization. The ideal candidate will have experience in Python, PySpark, Azure cloud services, and data engineering best practices, along with a passion for building modern data platforms.

Job Title: Data Bricks Data Engineer

Location: Seattle, WA (On-site)
(Also open to on-site in St. Louis, Dallas/Plano, Charleston SC, Ridley Park PA)

Duration: 6 months (can extend)

Job Description:

We are looking for a highly skilled Data Bricks Data Engineer to support enterprise data initiatives. The Data Bricks Data Engineer will be responsible for building robust data pipelines, optimizing large-scale data processing, and ensuring secure and efficient data workflows in Azure.

The Data Bricks Data Engineer will collaborate with cross-functional teams to translate business needs into scalable technical solutions. This role requires deep expertise in Azure Databricks, strong programming capabilities, and hands-on experience with cloud-native data architectures.

Additionally, the Data Bricks Data Engineer will play a key role in implementing data governance, monitoring, and CI/CD processes. The ideal Data Bricks Data Engineer will thrive in Agile environments and demonstrate strong problem-solving and communication skills.

Responsibilities:

• Design, develop, and maintain end-to-end data pipelines using Python and PySpark (5+ years experience)
• Build and optimize ETL/ELT workflows for large-scale data processing (5+ years experience)
• Manage Azure Databricks clusters, job scheduling, and workspace governance (4+ years experience)
• Develop and maintain data integration solutions using Azure services (4+ years experience)
• Collaborate with stakeholders to gather requirements and translate them into technical designs (3+ years experience)
• Implement secure data access using Azure Active Directory, Managed Identities, and service principals (3+ years experience)
• Develop Infrastructure-as-Code using ARM templates (3+ years experience)
• Configure and manage Azure services such as Storage Accounts, Synapse, Key Vault, VMSS, Function Apps, Web Apps, and Log Analytics (4+ years experience)
• Work with container services (Azure Container Apps, container instances) (2+ years experience)
• Design secure Azure networking solutions for data platforms (3+ years experience)
• Implement monitoring, alerting, and cost optimization strategies (3+ years experience)
• Use GitLab and Azure DevOps for CI/CD pipelines and source control (3+ years experience)
• Participate in Agile/Scrum ceremonies including sprint planning and retrospectives (3+ years experience)
• Ensure compliance with data governance and lineage requirements (3+ years experience)
• Provide production support, on-call support, and deployment assistance (2+ years experience)
• Collaborate with legacy and modernization teams across the organization

Required Skills:

• Strong programming skills in Python and PySpark (5+ years)
• Advanced SQL for analytics and ETL processes (5+ years)
• Experience building data pipelines in Azure cloud environments (4+ years)
• Hands-on expertise with Azure Databricks (4+ years)
• Knowledge of Azure services: Storage, Synapse, Key Vault, VMSS, Function Apps, Web Apps, Log Analytics (4+ years)
• Experience with containerized workloads and services (2+ years)
• Familiarity with Azure networking and security concepts (3+ years)
• Experience with ARM templates and Infrastructure-as-Code (3+ years)
• Proficiency in GitLab and Azure DevOps (3+ years)
• Strong analytical, problem-solving, and communication skills (5+ years)
• Experience working in Agile environments and data governance frameworks (3+ years)

Why Join Us?

Trilyon, Inc., offers a comprehensive benefits package.
Opportunities for growth and professional development.
Collaborative and inclusive company culture

Equal Employment Opportunity (EEO) Statement:

Trilyon, Inc., is an Equal Opportunity Employer committed to diversity, equity, and inclusion. We do not discriminate based on race, color, religion, gender, gender identity, sexual orientation, national origin, age, disability, veteran status, or any other protected status under applicable laws. Our diverse team drives innovation, competitiveness, and creativity, enhancing our ability to effectively serve our clients and communities. This commitment to diversity makes us stronger and more adaptable.