Talent.com
Remote DevOps Engineer (Kafka/Kong)
Remote DevOps Engineer (Kafka/Kong)Pennant Solutions Group • Richmond, VA, US
Remote DevOps Engineer (Kafka / Kong)

Remote DevOps Engineer (Kafka / Kong)

Pennant Solutions Group • Richmond, VA, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
  • [filters.remote]
[job_card.job_description]

Job Description

Job Description

Senior Kafka Administrator / Kong Administrator with DevOps Experience

Remote-Contract to Hire

Our client is seeking a skilled and experienced Senior Kafka / Kong Administrator to join our client's IT operations team. As a Kafka / Kong Administrator, you will be responsible for the deployment, configuration, maintenance, and monitoring of our Kafka clusters and Kong gateways, ensuring the high availability, reliability, and optimal performance of our real-time platforms. Your role will be crucial in supporting our data engineering and application teams to deliver seamless data integration and processing.

Responsibilities : Kafka Administration

1. Cluster Deployment and Configuration :

  • Deploy and configure Kafka clusters following best practices for scalability, security, and performance.
  • Collaborate with cross-functional teams to gather requirements and design Kafka infrastructure to meet data streaming needs.
  • Manage topics, partitions, replication factors, and broker configurations to ensure efficient data distribution and fault tolerance.

2. Monitoring and Performance Optimization :

  • Implement monitoring and alerting solutions to proactively identify and address performance bottlenecks, resource constraints, and anomalies.
  • Conduct regular performance testing, load testing, and capacity planning to ensure clusters can handle anticipated workloads.

    • 3. High Availability and Disaster Recovery :

  • Design and implement high-availability strategies, including failover mechanisms and data replication across multiple data centers or cloud regions.
  • Develop and maintain disaster recovery plans and procedures to minimize data loss and downtime in the event of failures.

    • 4. Security and Compliance :

  • Implement and manage security measures such as encryption, authentication, and authorization to ensure data privacy and compliance with industry standards.
  • Stay updated on security vulnerabilities and patches, applying necessary updates to maintain a secure Kafka environment.

    • 5. Troubleshooting and Issue Resolution :

  • Diagnose and resolve Kafka-related issues, including performance degradation, data loss, and connectivity problems.
  • Collaborate with development and data engineering teams to troubleshoot consumer / producer application integration with Kafka.

    • 6. Documentation and Knowledge Sharing :

  • Maintain thorough documentation of Kafka configurations, deployment processes, and troubleshooting procedures.
  • Provide training and knowledge sharing sessions to junior team members and other stakeholders.

    • 7. Collaboration and Communication :

  • Collaborate with cross-functional teams, including data engineers, developers, and system administrators, to ensure smooth integration of Kafka into our data ecosystem.
  • Communicate effectively with stakeholders to provide updates on Kafka performance, maintenance, and improvements.

    • 8. Certification as a Confluent Certified Administrator for Apache Kafka (CCAAK) preferred.

    Responsibilities : Kong Administration

  • Hands on experience installing and configuring Kong API Gateway as well as integration with existing API frameworks.
  • Describe and configure dataplane security using RBAC, Roles, Workspaces and Teams
  • Configure upstreams and load balancing
  • Create Services, Routes, and Consumers

    • 2. Experienced in the Kubernetes platform

  • Working knowledge of Kong Ingress with Kubernetes\Dockers

    • 3. Excellent knowledge of API design standards, patterns, and best practices especially with OpenAPI 2.0, REST, JSON, XML.

    4. Troubleshoot problems on Kong Gateway

  • Distinguish between downstream and upstream networking issues
  • Collecting troubleshooting / debug information
  • Using log files and health and traffic metrics

    • 5. Deep understanding of JWTs and their usage.

    6. Preferred certification in Kong Gateway Certified Associate (KGCA)

    7. 5+ years of experience with monitoring and troubleshooting. Should be able to monitor and debug platform or application issues.

  • Use Kong Vitals to monitor Kong Gateway’s health and performance
  • Pull metrics using Vitals API

    • Qualifications :

  • Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience).
  • 5+ years of hands-on experience in administering Apache Kafka clusters in production environments.
  • 5+ years proficiency in Kafka / Kong architecture, installation, configuration, and tuning.
  • Strong understanding of Kafka internals, including topics, partitions, replication, and consumer / producer APIs.
  • 5+ years of experience with Kafka ecosystem tools such as Kafka Connect, Kafka Streams, and Schema Registry.
  • Knowledge of Linux systems and shell scripting.
  • Strong DevOps background.
  • 5+ years of familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization (e.g., Docker, Kubernetes)
  • Excellent problem-solving skills and the ability to troubleshoot complex issues efficiently.
  • Strong communication skills and the ability to work collaboratively in a team environment.
    • [job_alerts.create_a_job]

    Engineer • Richmond, VA, US

    [internal_linking.similar_jobs]
    DevOps Engineer

    DevOps Engineer

    VirtualVocations • Richmond, Virginia, United States
    [job_card.full_time]
    A company is looking for a DevOps Engineer to enhance development infrastructure and streamline developer workflow.Key Responsibilities Design, implement, and maintain scalable cloud infrastructu...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Devops Engineer

    Senior Devops Engineer

    Ssg • Richmond, Virginia, United States
    [job_card.full_time]
    Military Veterans are highly encouraged to apply!.Essential Duties and Responsibilities.Drive the automation, deployment, and optimization of the Windows Server and Internet Information Services (I...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Cloud Engineer

    Cloud Engineer

    Quantaleap • Richmond, VA, US
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Cloud Engineer Location : Richmond, VA(Remote) Need only Locals Job ID : 752288 Interview...[show_more]
    [last_updated.last_updated_30]
    M-2.25-Systems / Network Engineer (758322)

    M-2.25-Systems / Network Engineer (758322)

    Focused HR Solutions • Richmond, Virginia, United States
    [job_card.full_time]
    [filters_job_card.quick_apply]
    Role requires 2 days a week ON SITE in Richmond, VA.With the days selected by the employee).Our client has an opening for a Systems / Network Engineer (758322). This position is up to 16 months with t...[show_more]
    [last_updated.last_updated_30]
    Only Richmond, VA locals - Cloud Developer 4 - Richmond, VA (Hybrid)

    Only Richmond, VA locals - Cloud Developer 4 - Richmond, VA (Hybrid)

    My3Tech Inc • Richmond, VA, United States
    [job_card.temporary]
    Location : Richmond, VA 23219 (Hybrid).Does candidate acknowledge the requirement to work after-hours and weekend hours, based on workload, and to participate in on-call rotation?.To drive the succe...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Nurse - RN - Endoscopy - $1975.8 / Week

    Travel Nurse - RN - Endoscopy - $1975.8 / Week

    TRS Healthcare • Hopewell, VA, US
    [job_card.full_time]
    TRS Healthcare is seeking an experienced Endoscopy Registered Nurse for an exciting Travel Nursing job in Hopewell, VA.Shift : 5x8 hr days Start Date : ASAP Duration : 13 weeks Pay : $1975.TRS Healthca...[show_more]
    [last_updated.last_updated_30] • [promoted]
    DevSecOps Engineer I

    DevSecOps Engineer I

    Truist Inc • Richmond, VA, United States
    [job_card.full_time] +3
    The position is described below.If you want to apply, click the Apply Now button at the top or bottom of this page.After you click Apply Now and complete your application, you'll be invited to crea...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Travel Nurse - RN - Endoscopy - $1941 / Week

    Travel Nurse - RN - Endoscopy - $1941 / Week

    Fusion Medical Staffing • Hopewell, VA, US
    [job_card.full_time]
    Fusion Medical Staffing is seeking an experienced Endoscopy Registered Nurse for an exciting Travel Nursing job in Hopewell, VA. Shift : Inquire Start Date : ASAP Duration : 13 weeks Pay : $1941 / Week....[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    AI-Driven DevOps Automation Engineer - Oracle Health

    AI-Driven DevOps Automation Engineer - Oracle Health

    Oracle • Richmond, VA, United States
    [job_card.full_time]
    Automation and standardization are crucial for scaling cloud-based SaaS offerings to meet growing customer needs.The Cloud Infrastructure Automation Enablement team's Infrastructure-as-Code platfor...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior IAM Operations Engineer - REMOTE (Initial 6 Month)

    Senior IAM Operations Engineer - REMOTE (Initial 6 Month)

    Simple Solutions • Richmond, VA, United States
    [job_card.temporary]
    Senior IAM Operations Engineer.Location : Remote - Once converted, work onsite at any corporate office Tuesday-Thursday (Those locations are Reno, NV. Vegas, NV; Portland, OR; Salt Lake City, UT; De...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Systems Engineer - REMOTE

    Systems Engineer - REMOTE

    TekSynap • Richmond, VA, United States
    [job_card.full_time]
    Responsibilities & Qualifications.Provision, operate, install / configure, and maintain systems hardware, software, and related infrastructure, with a focus on cloud computing technologies and soluti...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Cloud AWS Engineer

    Senior Cloud AWS Engineer

    Delphi-US • Richmond, VA, United States
    [job_card.full_time]
    Job Title : Senior Cloud Engineer (Contract) - Job#5877.The Senior Cloud Engineer is responsible for developing conceptual, logical, and physical IT engineering designs that support complex infrastr...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Cloud AWS Engineer

    Cloud AWS Engineer

    Ampcus • Richmond, VA, United States
    [job_card.full_time]
    Technology and Business consulting services.We are in search of a highly motivated candidate to join our talented Team.Develops conceptual, logical, and physical IT engineering designs that support...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Global Systems Engineer

    Global Systems Engineer

    META • Richmond, VA, United States
    [job_card.full_time]
    Meta is seeking a forward thinking, experienced Data Center Systems Engineer to join the Data Center Site Operations team. Our data centers, and the tens of thousands of servers installed in them, a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    DevSecOps Engineer

    DevSecOps Engineer

    ASM Research, An Accenture Federal Services Company • Richmond, VA, United States
    [job_card.full_time]
    Responsible for the deployment, provisioning, hardening, and optimization of devsecops and cloud infrastructure and related cloud services. Utilizes scripting and infrastructure technologies for env...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Devops Engineer

    Devops Engineer

    Pyramid Consulting • Richmond, VA, US
    [job_card.temporary]
    Immediate need for a talented DevOps Engineer.This is a 12 months contract opportunity with long-term potential and is located in Richmond, VA (Onsite). Employee benefits include, but are not limite...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior DevOps Engineer - AWS / Java / Linux / Ansible / Git / Python

    Senior DevOps Engineer - AWS / Java / Linux / Ansible / Git / Python

    Captivation Software • Ashland, Virginia, United States
    [job_card.full_time]
    Build to something to be proud of.Captivation has built a reputation on providing customers exactly what is needed in a timely manner. Our team of engineers take pride in what they develop and const...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior Systems Engineer

    Senior Systems Engineer

    Syms Strategic Group, LLC (SSG) • Richmond, VA, United States
    [job_card.full_time]
    Military Veterans are highly encouraged to apply!.Essential Duties and Responsibilities.Develop solutions to routine technical problems of limited scope. Follow standard practices and procedures in ...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]