Senior Data Engineer – Real-Time Data & Visualization Focus

Description

JOB SUMMARY

• CANDIDATE MUST BE US Citizen (due to contractual / access requirements)

This is a remote position available within the U.S.

In this role, you will be a key contributor to our data infrastructure, responsible for the design, development, and maintenance of efficient, reliable, and high-quality data flow and storage. Your expertise will drive real-time data ingestion and transformation processes, structuring data from diverse sources using Cloud platforms (Azure, GCP, AWS), Databases (BigQuery, Azure Data Explorer), and streaming technologies like Cribl, Kafka, and Azure Event Hubs. A primary responsibility will be creating impactful visualizations and dashboards for internal and enterprise reporting, leveraging tools like Power BI and Tableau to translate business needs into actionable insights. This role requires strong proficiency in scripting / query languages (KQL, SQL, Python, JavaScript) and strong skills in building and optimizing data pipelines, ensuring data quality and integrity throughout the data lifecycle.

ESSENTIAL RESPONSIBILITIES

Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems

Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs

Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs

Monitor work against production schedule,provide progress updates, and report any issues or technical difficulties to lead developers regularly

Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations.

Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking

Mentor other associate and intermediate data engineers as needed

Perform data analysis and provide insights to support decision-making across various departments

Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed

Other duties as assigned or requested.

EXPERIENCE

Required

5 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems

5 years of experience in a data engineering, ETL development, or data management role.

5 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB).

5 years of experience in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery)

Preferred

7 years of experience with data pipeline and workflow management tools (e.g., Apache Airflow, AWS Glue, Azure Data Factory).

7 years of experience defining system architectures and exploring technical feasibility trade-offs for optimizing short term execution while planning for long term technical capabilities

7 years of experience working with a variety of technology systems, designing solutions or developing data solutions in healthcare

7 years of experience with cloud platforms (AWS, Azure, GCP) and their respective data services

7 years of experience in data governance, data quality, and data security best practices

7 years of experience translating requirements, design mockups, prototypes or user stories into technical designs

7 years of experience in producing data-related code that is fault-tolerant, efficient, and maintainable

SKILLS

Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment

Adaptability : Strong ability to take on diverse tasks and projects, adapting to the evolving needs of the organization

Analytical Thinking : Strong analytical skills with a focus on detail and accuracy

Interest and ability to learn other data development technologies / languages as needed

Technical Proficiency : Comfortable with a range of data tools and technologies, with a willingness to learn new skills as needed

Strong track record in designing and implementing large-scale data sources

Strong sense of ownership, urgency, and drive

Demonstrated passion for user experience and improving usability

Team Collaboration : A team player who can work effectively in cross-functional environments

Experience and willingness to mentor junior data engineers and help develop their skills and leadership

EDUCATION

Required

Bachelor’s degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field

Preferred

Master's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field

LICENSES or CERTIFICATIONS

Required

None

Preferred

None

Language (Other than English) :

None

Travel Requirement : 0% - 25%

PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS

Position Type

Office- or Remote-based

Teaches / trains others

Occasionally

Travel from the office to various work sites or from site-to-site

Rarely

Works primarily out-of-the office selling products / services (sales employees)

Never

Physical work site required

No

Lifting : up to 10 pounds

Constantly

Lifting : 10 to 25 pounds

Occasionally

Lifting : 25 to 50 pounds

Rarely

Pay Range Minimum : $78,900.00

Pay Range Maximum : $147,500.00

Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.

We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below.

For accommodation requests, please contact HR Services Online at