Big Data Platform Engineer

Job Summary

Job Title : Big Data Platform Engineer

Duration : 12 Months

Location : Charlotte, NC - Hybrid Role

We are seeking a highly skilled and motivated Tools Administration & Engineering Specialist to join our data private cloud. This role involves working closely with other technical staff to manage, support, and engineer platform tools across various big data and cloud environments including Cloudera Data Platform (CDP), Hortonworks, and OpenShift Container Platform (OCP).

Key Responsibilities

• Administer and support tools on the Data private cloud, including CDP, HWX, and MapR.
• Install, configure, and maintain data analytics and virtualization tools such as Dremio, JupyterHub, and AtScale across multiple clusters.
• Develop proof?of?concept solutions leveraging CDP and OCP technologies.
• Deploy tools, troubleshoot issues, perform root?cause analysis, and remediate vulnerabilities.
• Act as a technical subject?matter expert, supporting programming staff during development, testing, and implementation phases.
• Develop automation scripts for configuration and maintenance of data virtualization tools.
• Lead complex platform design, coding, and testing efforts.
• Drive advanced modeling, simulation, and analysis initiatives.
• Maintain comprehensive documentation of Hadoop cluster configurations, processes, and procedures.
• Generate reports on cluster usage, performance metrics, and capacity utilization.
• Work closely with data engineers, data scientists, and other stakeholders to understand requirements and provide necessary support.
• Collaborate with IT infrastructure teams to integrate Dremio, Hadoop clusters with existing systems and services.

Required Skills & Experience

Preferred Qualifications

Seniority Level

Mid?Senior level

Employment Type

Full?time

Job Function

Other

Industry

IT Services and IT Consulting

#J-18808-Ljbffr