Find & Apply For Web Developer Jobs in Englewood Cliffs, New Jersey

Browse jobs from a variety of sources below, sorted with the most recently published, nearest to the top. Click the title to view more information and apply online.

Skip to job details

Now viewing: Backend Engineer_AI Gateway

Apply for this opportunity

To apply for this job, you'll continue to an external website or email application.

Apply Offsite

SBT Global, Inc.

Backend Engineer_AI Gateway

Pay: $10,570/mo

Posted: 6 weeks ago

Location: Englewood Cliffs, NJ (Onsite)

Last Updated: 2 weeks ago

Hours: Full-Time

Expires: 9/26/2026

Job Description

Backend Engineer_AI Gateway SBT Global, Inc.

0 Englewood Cliffs, NJ Job Details Contract $10,570 a month 1 day ago Qualifications Python Full Job Description Company Description 1 yr Contract Full-Time, On Site Relocation Required (Englewood Cliffs, NJ until 9/2026, Plano, TX effective 10/2026)

Pay Rate:

~$10,570/mo DOE We are building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale. Job Description Async Python & Network Programming (3 + yrs)

Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering. Streaming & Large‑Payload Handling
Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference. Protocol Knowledge
Working familiarity with

HTTP/2 & HTTP/3

(multiplexing, HPACK), gRPC, and occasional custom protocol parsers. FastAPI‑Based Backend (3 + yrs)

Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs. Containerization & Kubernetes
Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics. Async Messaging & Event‑Driven Design
Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic. PostgreSQL & Vault
Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management. Cloud Networking & Security
L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let's Encrypt). IaC & CI/CD
Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments. Qualifications Enterprise Security Gateways
Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.

IAM & SSO

Configuring Azure AD/Entra ID, Okta, SAML 2.

0 or

OIDC SSO

flows; managing Conditional Access & SCIM provisioning. AI/LLM Pipelines

Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost. API‑Gateway Operations
Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking. Observability & FinOps
End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).

Additional Information All your information will be kept confidential according to EEO guidelines.