Senior Backend Engineer

Hebbia is seeking a Senior Backend Engineer to architect the infrastructure behind Matrix, our flagship product that allows knowledge workers to collaborate with AI agents over massive datasets. You will build high-performance distributed systems capable of indexing and reasoning across millions of unstructured documents in real-time. This role is pivotal in scaling our 'LLM-orchestration' layer to support the complex research workflows of the world's leading financial institutions and law firms.

- Design and implement robust APIs and backend services that power complex AI agentic workflows. - Optimize our data ingestion pipeline to handle diverse file formats and massive scales with high accuracy. - Architect and maintain low-latency retrieval systems that integrate multiple search modalities. - Collaborate with AI researchers to integrate state-of-the-art LLMs into production-ready features. - Build internal tooling and monitoring to ensure the reliability and observability of our distributed AI systems. - Lead code reviews and mentor junior engineers on backend best practices and system design. - Direct the evolution of our database schema and architectural patterns to support rapid product iteration.

- 6+ years of professional experience building scalable backend systems in Python, Go, or Rust. - Deep expertise in distributed systems, including experience with low-latency data processing and microservices. - Proven track record of deploying Large Language Models (LLMs) into production environments. - Strong proficiency with vector databases (e.g., Pinecone, Weaviate) and advanced RAG architectures. - Experience with cloud-native infrastructure on AWS or GCP, including Kubernetes and Docker. - Ability to work autonomously in a fast-paced startup environment with a high degree of technical ownership. - Excellent communication skills for collaborating with product and frontend teams globally.