NC FAST Data Engineer

DHHS-ITD is seeking a Data Engineer for development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics and Power BI for the Child Welfare Program.

The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Data Engineer for the development and optimization of data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.

Key Responsibilities :

• Synapse
• Design, Develop and maintain data models in Synapse to support reporting and analytics
• Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
• Analyze the source system and design the ETL data load.
• Ability to create and configure Azure Synapse Analytics workspace.
• Create pipelines in Azure Synapse using Linked Services / Datasets / Pipeline to Extract, Transform and Load data from different sources like Salesforce.
• Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
• Power BI Tools
• Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.

Required / Desired Skills

Skill

Required / Desired

Amount

of Experience

Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows

Required

Years

Programming Languages : Strong proficiency in Python or Scala for data processing.

Required

Years

SQL Mastery : Advanced query writing, performance tuning, and optimization.

Required

Years

Hands-on experience in developing efficient PL / SQL procedures

Required

Years

Experience with Programming and Scripting (SQL, T-SQL, and data query optimization)

Required

Years

Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database)

Highly desired

Years

Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage

Highly desired

Years

Experience with Power BI

Nice to have

Years

Questions

No.

Question

Question1

Absences greater than two weeks MUST be approved by CAI management in advance, and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you accept this requirement?

Question2

Please list candidate's email address HERE that will be used when submitting E-RTR.

Question3

Please indicate how soon this candidate is available to start work. Vendors are encouraged to submit candidates that are available for the duration of the assignment.

Question4

Will the candidate be subcontracted at the time of submission (Yes or No)?

Question5

Vendor must notify the agency if any portion of the requirements listed in this task order are to be outsourced to other countries. Do you accept this requirement?

Question6

Please provide candidate's current location (City and state), NOT a Yes or No response.

Question7

Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked by the engaged resource. It is the responsibility of the supplier to adhere to any applicable compensation laws including payment for overtime hours. Do you accept this requirement?

Question8

Please confirm you have thoroughly validated, and attest to the accuracy of, the credentials listed throughout this candidate s VectorVMS profile and resume pursuant to Section 5.2.5 of ITS-009440. Do you confirm?

Question9

Candidates submitted above the rate of $$$$$ may not be considered. Do you accept this requirement?

Question10

The client is requesting that candidates to provide 2 references prior to final selection. The references must be recent from a Sr Manager / Director overseeing the candidate's work. Do you accept this requirement?

Question11

Please provide a brief description of recent hands-on development work in building data pipeline using Azure Synapse Analytics or Databricks or Snowflake.