AI Engineer (LLM) at EPAM

Availability unverified

Develop Python and FastAPI services for retail AI workflows, including retrieval and agent orchestration. The employer asks for LLM API experience, grounded retrieval and evaluation skills.

EPAM

Location: Ho Chi Minh City · Hybrid
Work arrangement: hybrid
Technologies: AI, Python, FastAPI

This opening is not confirmed as active. Check the employer source before applying.

Role overview

Join EPAM Vietnam as an AI Engineer (LLM) and help shape the future of AI-powered retail decision-making. You will design agent workflows, prompt and retrieval logic and production-ready services that turn data into grounded, traceable recommendations for business users. Working with cutting-edge AI technologies, structured business data and real-world retail challenges, you will play a key role in creating impactful, scalable and user-centric GenAI experiences that deliver measurable business value.

Responsibilities

Translate category management needs into LLM and GenAI use cases and workflows.
Design agent orchestration including prompt strategy, retrieval, tool calling and state handling.
Build back-end services and APIs for LLM applications using FastAPI and Python.
Integrate LLM providers such as Azure OpenAI and OpenAI with streaming, retries and cost controls.
Build retrieval patterns with chunking, metadata, citations and relevance tuning.
Define evaluation approaches for relevance, grounding, safety, latency and cost.
Improve quality through testing, observability, feedback loops and iteration.
Partner with product, data, engineering and business stakeholders to ship usable features.

Qualifications

Proven experience in Python back-end development, async patterns and FastAPI.
Hands-on work integrating Large Language Model (LLM) APIs such as Azure OpenAI or OpenAI.
Understanding of LangChain or LangGraph for agent orchestration and tool workflows.
Expertise designing tool or function calling, from schemas to retries, confirmation flows and payload contracts.
Experience implementing Retrieval-Augmented Generation (RAG) with traceable sources and robust evaluation.
Able to manage agent state through checkpointing, resumability and session handling.
Understanding of secure design for LLM applications, from secrets management to access control and prompt leakage prevention.
Clear communication with technical and business partners.

About EPAM

EPAM provides software development and digital platform engineering services for international clients.

How to apply

Check the original posting to confirm the role is still open before applying.

Check employer posting

Source checked: 2026-09-21

Browse job categories

Python