Senior Software Engineer for AI Agent platform

As a Senior Software Engineer - Backend (AI Agent Platform), you will play a key role in designing, developing, and deploying the backend systems that power our AI agent platform. You will work on challenging problems related to distributed systems, scalability, real-time processing, and the integration of AI/ML models into production. You will work closely with data scientists, machine learning engineers, frontend engineers, and other stakeholders to build a robust and innovative platform. You will be a hands-on developer, writing high-quality code and contributing to architectural decisions.  Key Responsibilities:Backend System Design & Development: Design, develop, and maintain scalable, reliable, and performant backend services for the AI agent platform. Implement APIs and microservices for interacting with AI models, data pipelines, and other platform components. Write high-quality, well-tested, and maintainable code (primarily in Go, potentially with some Java or Python). AI/ML Integration: Work closely with data scientists and machine learning engineers to deploy and integrate AI/ML models into the platform. Develop and maintain infrastructure for model serving, monitoring, and retraining. Optimize model performance and scalability in a production environment. Experience with deploying LLM and SLM models. Real-time Processing: Design and implement systems for real-time data processing and event handling.  Work with technologies like WebSockets, message queues (Kafka, RabbitMQ), and streaming platforms. Data Pipeline Integration: Collaborate with data engineers to integrate the AI agent platform with data pipelines for training and inference. Work with various data storage technologies (SQL, NoSQL, data warehouses). Scalability and Performance: Design and implement systems that can handle high volumes of data and traffic. Identify and address performance bottlenecks. Optimize system performance for speed, scalability, and cost-effectiveness. Security: Implement secure coding practices and work closely with the security team to ensure the security of the platform. Collaboration: Work effectively in a cross-functional team, collaborating with product managers, designers, frontend engineers, data scientists, and other stakeholders. Communicate technical concepts clearly and concisely. Mentorship: Provide technical guidance and mentorship to junior engineers. Participate in code reviews and contribute to improving engineering best practices.