Benefits:
Big Data Engineer
Location: Chicago, IL (Day 1 Onsite) Hybrid
Job Type: Contract / Full Time
Experience: 8+ yrs
Duration: Long Term
We are seeking an experienced Big Data Engineer to design, develop, and optimize enterprise-scale big data solutions. The ideal candidate will have strong hands-on expertise in the Hadoop ecosystem, Spark, Scala, Hive, Apache NiFi, and Kafka, along with experience building scalable data pipelines and supporting modern CI/CD practices. Candidates should have worked directly with clients, participated in requirement gathering sessions, and delivered end-to-end Big Data implementations.
Key Responsibilities
* Design, develop, and optimize large-scale data processing pipelines using Spark, Scala, and Hive.
* Build and maintain data ingestion workflows using Apache NiFi.
* Develop and support real-time data streaming solutions using Apache Kafka.
* Monitor application logs and system health using Kibana, Elasticsearch, and Logstash.
* Implement and support CI/CD pipelines using Git, Jenkins, and Nexus.
* Ensure data quality, integrity, and governance across Big Data platforms.
* Participate in architecture discussions and recommend scalable design solutions.
* Troubleshoot and resolve complex production issues across the Big Data stack.
* Collaborate with cross-functional teams in an Agile environment.
* Mentor junior engineers and contribute to technical best practices.
Required Qualifications
* 8+ years of experience in Big Data technologies.
* Strong hands-on experience with Spark, Scala, Hive (HQL), and the Hadoop ecosystem.
* Experience implementing Apache NiFi and Apache Kafka.
* Proficiency in Shell Scripting or Python.
* Experience with PostgreSQL.
* Familiarity with scheduling tools such as Oozie and Control-M.
* Working knowledge of Git, Jenkins, Nexus, Maven, Ansible, and SonarQube.
* Strong understanding of CI/CD practices.
* Experience in client-facing roles, including requirement gathering workshops.
* Minimum of two end-to-end Big Data implementation projects.
* Ability to work independently and contribute effectively within Agile teams.
Flexible work from home options available.
Big Data Engineer • Lansing, MI, US
Client Location: Lansing MI 48901.Job Summary: We are seeking a highly skilled Hyperconverged Infrastructure Engineer to support customers with new PowerFlex deployments.The ideal candidate will ha... Show more
Thank you for considering this exciting opportunity! This remote position is ideal for individuals looking for flexible work options, whether part-time or full-time.We invite candidates from all pr... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Job DescriptionThe primary focus of this role is to support Star Ratings projection modeling and analytics for Medicare Advantage.The Data Analyst will work with large datasets to generate insights... Show more
Location:Remote, United StatesEmployment Type:FullTimeLocation Type:RemoteDepartmentBusiness TechnologyCompensation:$322.K - $387K - Offers EquityAt Confluent, we are committed to providing competi... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
As a General Manager, you will be the leader of your restaurant's success! You will lead your Restaurant Management Team and Team Members through performance, engagement, and training initiatives.G... Show more
At Dollar General, our mission is Serving Others! We value each and every one of our employees.Whether you are looking to launch a new career in one of our many convenient store locations, distribu... Show more
Make banking a Fifth Third better We connect great people to great opportunities.Are you ready to take the next step? Discover a career in banking at Fifth Third Bank.Selected candidates are intend... Show more
Job TitleNumber of Resources :2 Total Work Experience :8years Relevant Technology-Specific Experience :3years Azure Data Factory / Fabric, 5years SQL / ETL Pipelines Responsibilities. Show more
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Data Engineer 6 Lansing, MI On-site:Hybrid position - Onsite 2 days per week Duration:1 year with possible extension.Job Description: Lead the design and development of scalable and high-performanc... Show more
Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more
Hunt has CDL-A owner operator jobs available! Stay moving and stay profitable with access to one of America’s largest freight bases.Up to 100% fuel surcharge pass through.Expanded load board & ... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Lansing, MI - IT - DTMB - Agency Services - Treasury - Business Analyst 5.Location: Lansing, MI (Candidates MUST be local within a commutable distance.Manager is not interested in candidates who ne... Show more
Location: Dimondale, MI (Hybrid Local Candidates Only) Duration: Long Term contract Interview Process: In-Person.We are seeking a highly experienced Business Analyst 5 to lead complex application ... Show more
Project timeframe: The project is anticipated to run October 30, 2023 - January 12, 2024.Location: Treasury Operations Center - 7285 Parsons Drive, Dimondale, MI 48821.Hours: Full time; 7:00a - 3:3... Show more
