Data Engineer

Job Description

Job Description

Salary : $52 hourly

Position : Data Engineer

Location : Boston, MA(Hybrid 3x in office)

Employment Type : Contract-to-hire

Contract Duration : 6months-1year

The data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. The data engineerwill work with a multidisciplinary Agile team to build high-quality data pipelines, generate insights from connected data, and advance the company's data-driven decision- makingcapabilities.

Responsibilities :

Designs, develops, optimizes, and maintains data architectureand pipelines that adhere to ELT principles and business goals.

Solves complex data problems to delivers insights that helpsbusiness achieve its goals.

Creates data products for engineer, analyst, and data scientistteam members to accelerate their productivity.

Engineer effective features for modelling in close collaborationwith data scientists and businesses.

Leads the evaluation, implementation and deployment ofemerging tools and process for analytics data engineering inorder to improve productivity as a team and quality.

Partners with machine learning engineers, BI, and solutionsarchitects to develop technical architectures for strategicenterprise projects and initiatives.

Fosters a culture of sharing, re-use, design for scale stability,and operational efficiency of data and analytical solutions.

Advises, consults, mentors, and coach other data and analyticprofessionals on data standards and practices.

Develops and delivers communication and education plans onanalytic data engineering capabilities, standards, andprocesses.

Learns about machine learning, data science, computer vision,artificial intelligence, statistics, and / or applied mathematics asnecessary to carry out role effectively.

Key Skills :

• Experience in building data pipelines and deploying / maintaining them following modern DE best practices -target tech stack : Python OSS Data Ecosystem (PySpark, pandas, Dash); knowledge of SQL, DBT is a plus
• Heavy experience with Azure Data Factory is a must.
• Experience with designing and maintaining data warehouses and / or data lakes with big data technologies suchas Spark / Databricks, or distributed databases, like Redshift and Snowflake, and experience with housing,accessing, and transforming data in a variety of relational databases
• Strong understanding of agile methodologies and experience as a Data Engineer on a cross-functional agile

team preferred

with the Linux operating system and the Bash / Z shell

services and infrastructure in the data and analytics space

Qualifications &Technical Skills

Interpersonal Mindset & Behaviors