AI Observability Engineer - GenAI & Agentic AI Job at GL Global, Charlotte, NC

  • GL Global
  • Charlotte, NC

Job Description

AI Observability Engineer - GenAI & Agentic AI

We’re looking for an experienced AI Observability Engineer to support the development and production of next-generation GenAI and Agentic AI systems.

This is a great opportunity for someone with a background in Observability, SRE, MLOps, Platform Engineering, AI/ML or Test Automation who wants to work on cutting-edge AI technology.

Key Responsibilities:

  • Build telemetry, monitoring, dashboards, alerts, tracing and SLOs for AI/LLM applications and agents
  • Develop LLM and AI evaluation frameworks covering response quality, prompts, RAG, latency, reliability and safety
  • Analyse production behaviour and identify improvements to AI quality, performance and reliability
  • Automate production readiness, reporting and governance processes
  • Create runbooks and operational documentation for AI releases
  • Work closely with Engineering and Product teams to define monitoring and evaluation requirements

Experience:

  • 4+ years' engineering experience across observability, monitoring, platform engineering, SRE, AI/ML or test automation
  • Strong hands-on Python experience
  • Experience with metrics, logs, traces, dashboards, alerting and SLOs
  • Understanding of LLMs, AI agents, RAG or AI evaluation
  • Experience supporting production systems

If you're an AI Observability Engineer, GenAI Engineer, SRE, MLOps Engineer, Platform Engineer or AI/ML Engineer looking to work on production Agentic AI systems, we'd love to hear from you.

Job Tags

Similar Jobs

CompHealth

Physician (MD/DO) - Neurology - General/Other in Oklahoma City, OK Job at CompHealth

 ...Doctor of Medicine | Neurology - General/Other Location: Oklahoma City, OK Employer: CompHealth Pay: Competitive weekly pay...  ...program eligible Our services are free for you We help negotiate your salary and contract We coordinate interviews and... 

CompHealth APP

Locum Tenens Physician Assistant - Cardiovascular/Cardiothoracic Surgery - $105-138 per hour Job at CompHealth APP

 ...CompHealth APP is seeking a Physician Assistant Cardiovascular/Cardiothoracic Surgery for a locum tenens job in Duluth, Minnesota. Job Description & Requirements Specialty: Cardiovascular/Cardiothoracic Surgery Discipline: Physician Assistant Duration... 

Marriott International, Inc

Maintenance Engineer III Job at Marriott International, Inc

 ...remaining categories: air conditioning and refrigeration, electrical, mechanical, plumbing, pneumatic/electronic systems and controls, carpentry and finish skills, kitchen equipment, vehicles, energy conservation, and/or general building management. Display solid knowledge... 

Synergy Business Consulting, Inc.

Purchasing Manager Job at Synergy Business Consulting, Inc.

 ...Analytical Skills opportunity for someone with a passion for purchasing to grow and have high visibility in the industry Not creating...  ...and negotiating contracts RESPONSIBILITIES: Managing relationships with assigned suppliers. Providing a continuous... 

Manpower

US-Ellisville-Picker/Packer I Job at Manpower

 ...Picker Packer Location: Ellisville, MO Pay: $18.77/hr + $1.00/hr Shift Differential Schedule: 2:30 PM - 11:00 PM Overtime: Required, up to 1:00 AM Join our Warehouse Team We areseeking reliable and motivated Picker Packers to support warehouse and...