Sr. Data Engineer

Please Note: This is a Utah-based hybrid position which will require some regular in-office days each week. Additionally, employment with BambooHR is contingent on passing both a background and credit check.

AI at BambooHR
At BambooHR, we're all about setting people free to do great work, and we believe AI is a powerful partner in that mission. We're leaning into intelligent tools to streamline our workflows, giving us more time for high-impact innovation. We look for curious, forward-thinking people who are ready to explore how AI can elevate their work and help us reimagine the future of HR.

Essential Job Duties

As a Senior Data Platform Engineer, we'll rely on your expertise across multiple disciplines to develop, deploy and support data systems, data pipelines, data lakes, and lakehouses. Your ability to automate, performance tune, and scale the data platform will be key to your success.

You will:

• Collaborate with stakeholders to make effective use of core data assets
• Development and maintenance of data integrations written in Python
• Load both streaming and batched data in Spark with Pyspark and lakehouse libraries
• Engineer lakehouse models to support defined data patterns and use cases
• Build unit, integration, quality, and performance tests
• Participate in peer code reviews, code approvals, and pull requests
• Monitor, operate, and optimize data integrations, pipelines, and distributed applications
• Documentation of data pipelines, cloud infrastructure, and standard operating procedures
• Work within an IT managed AWS account and VPC to stand up and maintain data platform development, staging, and production environments
• Express data platform cloud infrastructure, services, and configuration as code
• Automate continuous upgrades and testing of data platform infrastructure and services
• Help ensure appropriate data privacy and security
• Identify, recommend, and implement opportunities for improvement in efficiency, resilience, scale, security, and performance

What You Need to Get the Job Done

• Python development abilities, skills, and experience
• Expert level SQL coding abilities and experience
• Ability to quickly learn new development frameworks
• Ability to develop, scale, and tune Spark and PySpark applications
• Understanding of data lake, lakehouse, and data warehouse systems, and related technologies
• Knowledge and understanding of data formats, data patterns, models, and methodologies
• Ability to work with cloud infrastructure including resource scaling, S3, RDS, IAM, security groups, AMIs, cloudwatch, cloudtrail, and secrets manager
• Experience with CI/CD in a data engineering environment
• Experience managing access controls in a data engineering environment
• Git-based team coding workflows

Beyond the technical skills, we're looking for individuals who are:

• Clear communicators with team members and stakeholders
• Analytical and perceptive of patterns
• Creative in coding
• Detail-oriented and persistent
• Productive in a dynamic setting

If you love to learn, you'll be in good company. You'll likely have a Bachelor's degree in computer science, information systems, or equivalent working experience.

What You'll Love About Us

• A Great Company Culture that has been recognized by multiple organizations like Inc, and Salt Lake Tribune
• Comprehensive health, life, and disability insurance
• Generous leave policies that include 4 weeks of vacation, 12 company holidays, parental leave, and volunteer time off so you can enjoy quality of life
• 401k plans with up to 6% company match
• $2000 Paid-Paid Vacation bonus
• EAP through Headspace
• Check out all our benefits that benefit you