Talent.com
SBT Global, Inc.
Backend Engineer_AI GatewaySBT Global, Inc. • Englewood Cliffs, New Jersey, United States
Backend Engineer_AI Gateway

Backend Engineer_AI Gateway

SBT Global, Inc. • Englewood Cliffs, New Jersey, United States
25 days ago
Job type
  • Full-time
Job description
Job Description

  • Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
  • Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
  • Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
  • FastAPI‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
  • Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
  • Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
  • PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
  • Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
  • IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.

Qualifications

  • Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
  • IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
  • AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
  • API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
  • Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).


Additional Information

All your information will be kept confidential according to EEO guidelines.

Create a job alert for this search

Backend Engineer_AI Gateway • Englewood Cliffs, New Jersey, United States

Similar jobs

Senior Backend Engineer, Blockchain Infrastructure (Remote)

The Resume DatabaseNew York City, NY, United States
Remote
Full-time

A leading blockchain infrastructure company in New York is seeking an experienced Backend Engineer to take ownership of key projects and solve complex problems in blockchain systems.The ideal candi... Show more

 • Promoted

Field Engineer - Data Center Infrastructure

ZonesHackenack, NJ, US
$42.00 hourly
Full-time

When it comes to IT solution providers, there are a lot of choices.But when it comes to providers with innovative and differentiating end-to-end service offerings, there’s really only one: Zones – ... Show more

Java Server Engineer

TradeJobsWorkForce10702 Yonkers, NY, US
Full-time

Java Server Engineer Job Duties: Evaluates Web applications by studying systems flow, data usage, and ... Show more

 • Promoted

Forward Deployed Engineer

Product PulseNew York City, new york, US
Full-time

As an organization, we help enterprises deploy AI systems that are reliable, secure, observable, scalable, and production- ready.As organizations accelerate the adoption of Generative AI, they face... Show more

Earn up to $400 per Day by Playing Games and TakingSurveys

Freecash.comPeekskill, New York, United States
Full-time

Since its launch 6 years ago, over 60MN users have earned and withdrawn over $250MN! The platform is rated 4.TrustPilot with over 230k+ reviews, establishing Freecash as one of the highest-rated op... Show more

 • Promoted

Remote Founding Protocol Engineer - THORChain

Blockchain WorksBronx, NY, United States
Remote
Full-time

THORChain is a settlement layer that facilitates swaps between Bitcoin, Ethereum, BNB Chain, Avalanche, Cosmos Hub, Dogecoin, Bitcoin Cash and Litecoin.THORChain is secured by its native token, RUN... Show more

 • Promoted

Platform Backend Engineer - AI Audio, Remote

Clutch CanadaNew York City, NY, United States
Remote
Full-time

A leading text-to-speech company is looking for a Backend Developer to design and maintain robust APIs.This role involves working in a dynamic, remote environment, requiring expertise in TypeScript... Show more

 • Promoted

Restaurant Delivery - Start Earning Quickly

DoorDashGarnerville, NY, United States

DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more

 • Promoted • New!

Data Engineer / Python Developer / Remote

Apetan Consulting llcNew Milford, NJ, United States
Remote
Full-time

Key ResponsibilitiesDesign, build, and maintain ETL / ELT data pipelinesDevelop Python-based data processing applicationsWork with structured and unstructured data at scaleIntegrate data from multi... Show more

 • Promoted

Staff Backend Engineer - Crypto Custody (Remote)

P2PNew York City, NY, United States
Remote
Full-time

A global blockchain technology firm is seeking a Staff Backend Engineer to innovate and architect secure crypto wallet systems.This role involves collaborating across teams to enhance product offer... Show more

 • Promoted

AI Solutions Engineer - Remote

Finn PartnersMontvale, NJ, United States
Remote
Full-time

The AI Solutions Engineer is the primary builder, architect, and technical steward of the organization's internal AI capabilities.This role is responsible for the design, development, and operation... Show more

 • Promoted

Senior Backend Engineer (Remote)

CadreNew York City, NY, United States
Remote
Full-time

Senior Backend Engineer We're looking for a senior backend engineer with deep experience in Python who can design, build, and scale high-performance APIs and data systems in a fast-moving startup e... Show more

 • Promoted

Backend Engineer, Blockchain Infra (Rust) Remote

Uniswap LabsNew York City, NY, United States
Remote
Full-time

A leading DeFi company is looking for a Backend Engineer to work on blockchain infrastructure.This position involves owning projects from start to finish, ensuring system reliability, and writing c... Show more

 • Promoted

QA Automation / Infrastructure Engineer / Remote

Apetan Consulting llcNew Milford, NJ, United States
Remote
Full-time

Role OverviewA QA Automation & Infrastructure Engineer designs, builds, and maintains automated testing frameworks and the infrastructure that runs them.The role ensures software quality at sca... Show more

 • Promoted

Data Center Surveillance Security Agent

GardaWorldPomona, NY, United States
Full-time +1

Job DescriptionGardaWorld Security Services is Now Hiring a Surveillance Security Officer!Ready to suit up as a Surveillance Security Guard?What matters most about a role like this is your sharp ey... Show more

 • Promoted

Senior Backend Engineer - AI-Driven Risk (Remote)

BitSightNew York City, NY, United States
Remote
Full-time

A technology leader in cyber risk management is seeking a Senior Software Engineer to join their team.This role focuses on backend development, requiring expertise in Python and experience with RES... Show more

 • Promoted

Backend Engineer at Tricura Insurance Group - a US-based healthcare startup specializing in risk

Hire5New York City, NY, United States
Remote
Full-time +1

Tricura Insurance Group is a rapidly growing company redefining the insurance landscape through data-driven insights and innovative technology.Founded by industry experts with backgrounds in clinic... Show more

 • Promoted

Backend Engineer(Multiple Roles, Remote & On-Site)

MLabsNew York City, NY, United States
Remote
Full-time

We're hiring Backend Engineers to join some of the most ambitious startups, including Basis, Conduit AI, Dashly, and Rilla.These teams are building distributed systems, data-heavy products, and rel... Show more

 • Promoted

Senior Backend Engineer (USA)New York, NY. Remote US.

KalepaNew York City, NY, United States
Remote
Full-time

Senior Backend Engineer (USA)Kalepa is upending the trillion-dollar commercial insurance industry.Our AI Copilot platform empowers underwriters to make smarter, faster, and more accurate decisions.... Show more

 • Promoted

Senior Platform Engineer - AWS GenAI - remote

SitusAMCNew York City, NY, United States
Remote
Full-time

SitusAMC is where the best and most passionate people come to transform our client's businesses and their own careers.Whether you're a real estate veteran, a passionate technologist, or looking to ... Show more