Senior/Lead Machine Learning Operations Engineer

Job Title:

Senior/Lead Machine Learning Operations Engineer

Company: Upwork

Location: Romania (Remote)

Type: Contract (Long-term)

Role Overview:

Upwork is looking for a skilled Machine Learning Operations Engineer to join their Algorithms and Research team. This role focuses on operationalizing advanced AI technologies such as Generative AI and retrieval-augmented generation (RAG) systems, improving search and recommendation engines at scale. The role involves building, scaling, and monitoring ML and ETL pipelines with a strong emphasis on knowledge graphs and large language models.

Key Responsibilities:

• Deploy, scale, and maintain ML and ETL pipelines for production Generative AI and large language models
• Design and optimize retrieval-augmented generation systems using knowledge graphs to enhance search accuracy and recommendations
• Implement ML monitoring and alerting systems and integrate active learning pipelines for continuous model improvement
• Collaborate cross-functionally to integrate ML solutions across Upwork’s platform
• Continuously analyze and optimize model performance and scalability during peak traffic

Must-Have Skills:

• 6+ years in machine-learning operations and software engineering
• Proven experience deploying and scaling complex ML models in production
• Strong Python skills, especially for data and ML pipelines
• Experience with batch and real-time ETL tools
• Proficient in Java, particularly for building and maintaining high-traffic microservices
• Deep knowledge of graph databases, graph data models, and graph algorithms
• Experience building scalable distributed systems handling 1000+ requests/second at peak
• Proficient in AWS cloud infrastructure; familiarity with GCP and Azure is a plus
• Familiar with Generative AI and large language model technologies
• Strong analytical, problem-solving, and proactive innovation mindset
• Experience thriving in remote-first, collaborative environments
• Comfortable driving solutions from idea to execution in ambiguous, fast-paced settings