Role Summary
TrueFoundry is seeking a high-caliber Backend Engineering Intern to join our core engineering team in India. Backed by Sequoia and Intel Capital, TrueFoundry is building the mission-critical infrastructure layer for production AI and agentic systems—spanning our AI Gateway (model routing, MCP servers, governance, guardrails) and AI Deploy (Kubernetes-native compute abstraction). In this role, you will build performant, distributed backend services in Python, develop low-latency gRPC and REST APIs, interface with modern serialization protocols, and enable Fortune 500 enterprises like Mastercard, Siemens, and Paytm to deploy and orchestrate scalable AI workloads.
Key Responsibilities
- API & Systems Engineering: Architect, implement, and maintain high-performance, concurrent backend services and microservices using Python, gRPC, and REST APIs.
- Serialization & Protocol Development: Design service contracts and efficient data transfer protocols utilizing Protocol Buffers (Protobufs) and Apache Thrift.
- Platform & Ecosystem Integrations: Build robust connectors and integrations with external developer tools, orchestrators, and AI ecosystems (such as LangChain, Vector Databases, and MCP servers).
- Containerized & Cloud Infrastructure: Collaborate on Kubernetes-based workload abstractions, containerizing services via Docker and optimizing distributed compute execution.
- Database & Data Layer: Model schemas, optimize queries, and persist platform state across both relational (PostgreSQL/MySQL) and NoSQL data stores.
Key Qualifications
- Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related engineering discipline (students or recent graduates from premier institutes like IITs/NITs/BITS strongly preferred).
- Experience: 0 to 1 year of hands-on software development experience (internships, personal systems projects, or open-source contributions).
- Core Stack: Strong foundation in Python programming, concurrent systems, data structures, and hands-on exposure to gRPC, REST APIs, and Protocol Buffers.
- Databases & Infrastructure: Hands-on familiarity with at least one relational database and one NoSQL database, plus foundational knowledge of Docker, Kubernetes, or cloud services (AWS).
- Nice to Have: Contributions to open-source software, familiarity with Apache Spark or AWS Lambda, and practical interest in LLMOps, agent orchestration, or Model Context Protocol (MCP).
- Traits: High agency, hustle, first-principles problem-solving, and thriving in fast-paced startup environments with high degrees of ambiguity.
About TrueFoundry
TrueFoundry is a Cloud-native PaaS for machine learning and AI engineering teams to build, deploy, and ship scalable ML/LLM applications on their own cloud or on-premises infrastructure with built-in governance, speeding up enterprise AI time-to-value by up to 90%.