Staff Software Engineer

Overview

• Lead the development of advanced AI/LLM platform capabilities for a technology company, enabling efficient creation of AI-powered features.
• Collaborate with engineering teams to design scalable and compliant AI infrastructure for robust system performance.
• Work with cutting-edge technologies like TypeScript, AWS, and AI frameworks to deliver innovative solutions.
• Contribute to the development of SDKs and APIs simplifying complex AI workflows for engineers.
• Shape the architecture and standards of AI-powered platforms, driving impactful engineering practices.
• Engage with rapidly evolving AI technologies to design stable and adaptable systems.
• Support the implementation of safety and compliance measures in AI systems, ensuring responsible data handling.
• Collaborate with cross-functional teams to align platform capabilities with organizational goals.

Key Responsibilities & Duties

• Design and build core platform primitives, including provider abstraction layers and structured output validation systems.
• Develop safety and compliance infrastructure, including guardrail systems, PII detection, and privacy-first observability.
• Create evaluation infrastructure for systematic quality measurement of LLM outputs, integrating CI/CD workflows.
• Architect prompt lifecycle management systems with version control and deployment pipelines.
• Design and implement Agent-as-a-Service infrastructure for asynchronous tasks using AWS technologies.
• Collaborate with engineering teams to onboard them to the platform and provide technical support.
• Influence architectural decisions and engineering standards across the organization.
• Document systems and create reference implementations to facilitate platform adoption.

Job Requirements

• Bachelor of Science (BS) in a relevant field, with 10+ years of software engineering experience.
• Proven expertise in building platform infrastructure, developer tools, SDKs, or distributed systems.
• Production experience with LLM/AI systems, including OpenAI and Anthropic providers.
• Strong proficiency in TypeScript, designing APIs and abstractions for developer use.
• Experience with event-driven architectures and asynchronous processing patterns.
• Understanding of safety and compliance in AI systems, including PII handling and audit logging.
• Familiarity with cloud infrastructure, preferably AWS, and observability tools.
• Strong communication and technical writing skills for documentation and cross-team collaboration.