Java Server Engineer
TradeJobsWorkForce75214 Dallas, TX, USJava Server Engineer Job Duties: Evaluates Web applications by studying systems flow, data usage, and ... Show more
Backend Engineer_AI Gateway (Korean Required)SBT Global, Inc. • Plano, Texas, United States
Backend Engineer_AI Gateway (Korean Required)
SBT Global, Inc. • Plano, Texas, United States
1 day ago
Job type
- Full-time
Job description
Job Description
We are building an AI Gateway—a high‑performance intermediary that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers. In this role you will own the entire full‑stack lifecycle of the gateway, from core Python API service design and implementation to containerization, deployment, monitoring, and day‑to‑day operations.
While you can consult network and security specialists for architecture reviews, threat modeling, and policy definition, the application code, testing, CI/CD pipeline, and production operations will be developed and maintained solely by you. You’ll have full technical autonomy to design, build, and scale a robust, production‑grade system.
Qualifications
What we are looking for
- Experience: Around 5 years of professional backend development experience, with a solid track record of building and operating production-grade services.
- Async Python & Core Web Frameworks (3+ yrs): Deep understanding of asyncio and hands-on production experience with FastAPI (Pydantic, dependency injection, OpenAPI).
- Network Protocol & Streaming Fundamentals:
- Strong grasp of HTTP/1.1, HTTP/2, and SSE (Server-Sent Events) / Chunked transfer encoding essential for real-time LLM inference streaming.
- Practical understanding of the TCP/IP lifecycle, connection pooling, keep-alive, and managing back-pressure.
- Database & Async Messaging:
- Proficiency in PostgreSQL (query tuning, connection pooling via PgBouncer).
- Experience with message queues or event streams (e.g., Redis Streams, RabbitMQ, or Kafka) for decoupled task processing.
- Containerization & CI/CD:
- Docker, Kubernetes (basic workload management, deployment, HPA), and setting up CI/CD pipelines (GitHub Actions / GitLab CI).
Work experience desired
- Collaborative Security & Infra Awareness: Willingness to work with internal security/network teams on NGINX/Envoy reverse-proxy setup, mTLS, or IAM/SSO (OIDC/SAML) integrations.
- AI/LLM Integration: Experience handling LLM API payloads, managing rate limits, or implementing simple proxy/gateway patterns for AI services.
- Infrastructure as Code: Basic familiarity with Terraform for multi-env infrastructure management.
Additional Information
All your information will be kept confidential according to EEO guidelines.
Create a job alert for this search
Backend Engineer_AI Gateway (Korean Required) • Plano, Texas, United States
Similar jobs
Dashers - Sign Up and Start Earning
DoorDashProsper, TX, United StatesDoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more
Restaurant Delivery - Start Earning Quickly
DoorDashCelina, TX, United StatesDoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more
Remote OneTrust SME (Developer/Engineer)
WaveStrongDallas, TX, United StatesExciting Remote OneTrust SME (Developer/Engineer) contract opportunity.Requirements OneTrust cookie consent integration with Adobe Experience Manager and Adobe Analytics.An ideal candidate with the... Show more
Backend Software Engineer Platform - Remote Friendly (H / F)
Safran.AIAddison, TX, United StatesBackend Software Engineer Platform - Remote Friendly (H / F)Safran.AI (formerly Preligens), is a subsidiary of Safran Electronics & Defense that offers artificial intelligence solutions for ana... Show more
Senior Systems Engineer - Agile Product Owner
RTXMckinney, TX, United StatesSystems Engineer/Agile Product Owner.At Raytheon, the foundation of everything we do is rooted in our values and a higher calling to help our nation and allies defend freedoms and deter aggression... Show more
Technical Manager Cloud Operations and Support
DamcoMckinney, TX, United StatesTechnical Manager Cloud Operations And Support.Primary Skills: Business Analyst, Project Management.Secondary Skills: Cloud Computing Specialization Project Management: Engineer, Cloud Engineering... Show more
AI GPU - SR Staff Software Engineer (CPU, Linux, C++) Remote USA only
Confidential CompanyPlano, TX, United StatesAI GPU Linux Kernal Compute - SR Staff Engineer (Data Center - CPU - IOMMU - C / C++)100% Remote from USA only - Fulltime employee position (No contractors)CONFIDENTIALPublicly traded computer hard... Show more
Mainframe Modernization & CI/CD Transformation Lead-Hybrid
Sierra Systems, An Ntt Data CompanyMckinney, TX, United StatesMainframe Modernization & CI/CD Transformation Lead-Hybrid.NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us.If you want to be part of an... Show more
Technical Manager Cloud Operations and Support
Argyle InfotechMckinney, TX, United StatesTechnical Manager Cloud Operations and Support.Work Location: McKinney, TX Duration: Long term (12 months).Need to be technically skilled to answer customer queries regarding Cloud technologies.Gu... Show more
Performance Marketing Consultant (Meta Ads, Google Ads & AI-Powered Growth)
Herbal GoodnessMckinney, TX, United StatesAI-Enabled Performance Marketing Consultant.Herbal Goodness is a fast-growing wellness and nutraceutical brand dedicated to empowering wellness and changing lives through premium herbal supplements... Show more
Senior Principal Advanced Tactical Programs Chief Engineer (Onsite)
RTXMckinney, TX, United StatesRaytheon is seeking a Chief Engineer to lead contract research and development programs focused on maturing technology into viable products for the war fighter.This Chief Engineer position is under... Show more
Sofware Engineer
TradeJobsWorkForce75201 Dallas, TX, USAnalyze, design and develop tests and test-automation suites.Design, create and develop a processing platform using various configuration management technologies.Test software development methodolo... Show more
Associate Dean iCollin Virtual Campus
Collin CollegeMckinney, TX, United StatesCollin Higher Education Center.Provide leadership to ensure teaching excellence and student success in online and weekend academic and workforce programs at Collin College.Essential Duties and Resp... Show more
Role: Cortex XSIAM Engineer - Remote Position
smart folks incMc Kinney, TX, United StatesRole :Cortex XSIAM EngineerLocation :RemoteFull Time Position.Role OverviewWe are seeking a skilled Cortex XSIAM Engineer to lead the implementation integration and optimization of Palo Alto Networ... Show more
Software Engineer II - Embedded
RaytheonMc Kinney, TX, United StatesDate Posted:2026-02-05Country:United States of AmericaLocation:US-TX-MCKINNEY-513WC 2501 W University Dr WING C BLDGPosition Role Type:OnsiteU.Person, or Immigration Status Requirements:Active and ... Show more
AWS Cloud Engineer - Data Integration Specialist (REMOTE)
NTTMc Kinney, TX, United StatesJOB DESCRIPTIONWe are currently seeking a AWS Cloud Engineer - Data Integration Specialist (REMOTE) to join our team! This role is fully remote and can be based anywhere in the US.Seeking an experi... Show more
Remote API / Data Engineer
Irvine Tech CorpDallas, TX, United StatesWe are seeking a highly hands-on Senior API Engineer to support both Platform Engineering and API Engineering functions.In this role, you will work on the APIs that power all firmwide data products... Show more