LLMOps Engineer (Large Language models operations Engineer

LLMOps Engineer (Large Language models operations Engineer)

Remote

Long term

Key note from Manager-

Candidate should be able to support for LLM models- including incidents management, ongoing model management and maintenance, and user support

Candidate should be able to support Gen AI solutions -monitoring and maintenance, including performance monitoring, user interaction monitoring and efficacy monitoring

Terrafoam for deployment is must to have

Core Skills needed -

• Strong experience in developing, deploying, and managing large language models, specifically on Microsoft Azure.
• Proven expertise in Azure cloud platforms and services, including Azure Machine Learning, Azure Kubernetes Service, and Azure DevOps.
• Strong knowledge of LLMOPS guardrails implementation practices.
• Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders.

Experience with Python/

Job Duties

• Ops support for LLM models including incidents management, ongoing model management and maintenance, and user support
• GenAI solutions monitoring and maintenance, including performance monitoring, user interaction monitoring and efficacy monitoring
• Guardrails review and monitoring including bais audits, and other identified guardrail checks based on implemented GenAI solutions
• Code management support including proactive code optimization beyond breakfixes

LLMs provide context and memory capabilities, while generative AI enables the production of engaging responses