10+ years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws.
The ideal candidate will possess deep expertise in both on-premises Hadoop ecosystems and modern cloud-native big data solutions on AWS.
Hands-on experience with Cloudera Hadoop stack (HDFS, Hive, Spark, Oozie, Python)
Proficiency in writing, maintaining, and troubleshooting shell scripts (Bash or similar) for automation and operational support.
Migration to AWS will need -
Analyze existing Cloudera Hadoop architecture, workflows, and data pipelines.
Develop a comprehensive migration strategy to transfer data, processing logic, and applications to AWS services.
Design target architecture using AWS big data services such as Amazon EMR, Airflow, Glue, Lambda.
Evaluate and select appropriate AWS tools for data ingestion, storage, processing, and analytics.
Oversee the migration process, including data transfer, application re-platforming, and validation.
Ensure the new architecture meets performance, scalability, reliability, and security requirements.
Collaborate with developers, data engineers, DevOps, and stakeholders to ensure a seamless migration.
Create detailed technical documentation and migration runbooks.
Mentor team members on AWS big data best practices.
Strong understanding of data security, compliance, and governance in the cloud.
Proven track record of migrating or modernizing big data workloads to AWS.
Experience with cloud automation and Infrastructure as Code (e.g. Terraform).
AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Big Data - Specialty) are highly desirable.
10+ years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws.
The ideal candidate will possess deep expertise in both on-premises Hadoop ecosystems and modern cloud-native big data solutions on AWS.
Hands-on experience with Cloudera Hadoop stack (HDFS, Hive, Spark, Oozie, Python)
Proficiency in writing, maintaining, and troubleshooting shell scripts (Bash or similar) for automation and operational support.
Migration to AWS will need -
Analyze existing Cloudera Hadoop architecture, workflows, and data pipelines.
Develop a comprehensive migration strategy to transfer data, processing logic, and applications to AWS services.
Design target architecture using AWS big data services such as Amazon EMR, Airflow, Glue, Lambda.
Evaluate and select appropriate AWS tools for data ingestion, storage, processing, and analytics.
Oversee the migration process, including data transfer, application re-platforming, and validation.
Ensure the new architecture meets performance, scalability, reliability, and security requirements.
Collaborate with developers, data engineers, DevOps, and stakeholders to ensure a seamless migration.
Create detailed technical documentation and migration runbooks.
Mentor team members on AWS big data best practices.
Strong understanding of data security, compliance, and governance in the cloud.
Proven track record of migrating or modernizing big data workloads to AWS.
Experience with cloud automation and Infrastructure as Code (e.g. Terraform).
AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Big Data - Specialty) are highly desirable.
Bigdata Tech Lead • Chicago, IL, Illinois, USA
AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Technical Product Manager (Data).NT is implementing self service data platform and other data analytics projects.NT is looking for a technical product manager who can bring in program management sk... Show more
A global management consulting firm is seeking a Lead Data Scientist in Chicago, responsible for managing technical projects involving data engineering and model deployment.The ideal candidate will... Show more
Atlas MedStaff is seeking an experienced CT Tech for an exciting Travel Allied job in Munster, IN.Shift: Inquire Start Date: ASAP Duration: 13 weeks Pay: $2415.Atlas Medstaff is currently seeking c... Show more
Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Senior Director, Data Platform.This role can be based in any of our US office locations and is a hybrid role with the flexibility to work remotely 2 days a week.Ideal candidates should be local to ... Show more
Old National Bank has been serving clients and communities since 1834.With over $70 billion in total assets, we are a regional powerhouse deeply rooted in the communities we serve.As a trusted part... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Bonus Amount: $10,000 Bonus Information: Sign-On Bonus Available for Qualified Candidates.Eligibility and payout terms apply.Details discussed during the interview process.Full-Time Days (4x10 Sche... Show more
We're currently seeking motivated individuals to participate in online surveys and paid gaming opportunities for well-known national brands.If you're looking for a flexible way to earn extra cash f... Show more
Job Title: Senior Developer / Tech Lead Location: Houston, TX or Chicago, IL (Hybrid) Duration: Temp - 5 months Pay Range: $58/hr to $64/hr (W2) Job ID: 406744 About BCforward BCforward is a leadin... Show more
Excellent opportunity to join a leading, national credit card processing company that has over a decade of industry experience.Slice Merchant Services offers innovative payment processing solutions... Show more
Maverick Currencies is a proprietary trading firm that has been funding and developing traders since 1997.We provide capital, structured training, and ongoing mentorship — so you trade our mo... Show more
Data Center Divisional Product Lead.JLL empowers you to shape a brighter way.Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory a... Show more
