Senior Agentic AI Engineer

Customer location: USA

Candidates locations: EU

Working hours - 11.00-20.00 CET (>50% overlap with New York)

Stack: Agentic Systems

Employment Type: Full-time, B2B Contract

Experience Level: Senior

Salary: 4500$-5300$ /mo

English level: Advanced / Native

Vallettasoftware - custom mobile/web software developer in the US and Europe. Our teams implement IT projects of varying complexity, including website and mobile app development, enterprise systems, and solutions based on artificial intelligence and machine learning (AI/ML).

We are proud to be named as one of the Top 10 Software Development Companies in Q2 2026 by 50Pros|Discover top agencies.

Our thorough approach to every project and deep understanding of Client's needs allow us to manage the outstanding quality.

Now we’re looking for a Senior Agentic AI Engineer to boost the client's team.

Project Responsibilities:

Design and ship specialist AI agents that use memory, tools, data and multi-step reasoning.

Build multi-agent orchestration that routes work between specialist agents, manages dependencies and synthesises conflicting outputs.

Develop systems that evaluate confidence, uncertainty and consequence before recommendations reach a practitioner.

Build human-in-the-loop escalation so the system knows when to answer, when to ask for more information and when to defer to a human.

Create workflows that turn sport scientist expertise into validated, versioned and testable agent capabilities.

Build evaluation, observability and regression testing so agent performance can be measured and improved in production.

Work with domain experts to ensure AI outputs are grounded, traceable and actionable.

Must-haves:

Production agentic AI — memory or persistent state, tool use/tool calling, multi-step reasoning or workflows, production deployment and operation. Chatbots, prompt engineering, and RAG alone are not enough.

Multi-agent orchestration — you have built or substantially contributed to a production multi-agent system: agent routing, specialist agent composition, dependency-aware workflows, parallel and sequential execution, handling conflicting agent outputs, response synthesis. Experience with LangGraph, AutoGen, CrewAI or equivalent frameworks is valuable.

Confidence calibration — hands-on experience calibrating probabilistic ML or AI systems: Platt scaling, isotonic regression, Expected Calibration Error (ECE), reliability and calibration curves, confidence and uncertainty estimation.

5+ years of professional experience in applied ML, AI, or software engineering.

Strong Python.

Strong software engineering fundamentals.

Experience building and operating production systems.

Nice-to-have:

Production RAG and reranking.

Foundation-model fine-tuning or domain adaptation (LoRA, PEFT or similar).

LLM observability and drift detection.

Evaluation harnesses and automated regression testing.

Human-in-the-loop architectures, confidence thresholds, and escalation models.

Causal or counterfactual reasoning.

Go/Golang.

AWS, including ECS, EC2, Lambda, SNS, or SQS.

GraphQL, REST, or gRPC.

PostgreSQL or MongoDB.

Experience working with sport scientists, clinicians, or other domain experts is a plus.

🌍 Joining Valletta Software Development means:

A Global, Thriving Team

Join remotely 100+ specialists from 20+ countries, united by a passion for outstanding IT solutions.

<