[Remote] Lead Software Engineer – AI/RAG Platform

Note: The job is a remote job and is open to candidates in USA. Floor & Decor is a leading retailer in the home improvement sector, and they are seeking a Lead Software Engineer for their AI/RAG Platform. The role involves providing technical leadership for developing and maintaining solutions on the ServiceNow platform, focusing on AI applications and integrations with retail systems.

Responsibilities

• Architect, develop, and continuously improve a production RAG agent built on Azure OpenAI — including chunking strategies, vector indexing, retrieval ranking, and prompt engineering
• Lead full-stack development across an Angular front end and a Python-based service and LLMOps layer
• Design and maintain MCP (Model Context Protocol) integrations with inventory and merchandising systems to ground AI responses in live operational data
• Own the model evaluation pipeline using Ragas to track faithfulness, answer relevance, and context precision metrics across releases
• Make architectural decisions for reliability, scalability, and observability of all AI services deployed in Azure
• Lead, mentor, and conduct code reviews for a team of software engineers, fostering a culture of quality and continuous learning
• Work closely with product managers and business stakeholders to understand associate pain points, translate them into technical requirements, and prioritize the backlog
• Champion agile practices — participate in sprint planning, retrospectives, and daily stand-ups as a senior voice on the team
• Communicate technical trade-offs and architectural decisions clearly to both technical and non-technical audiences
• Evaluate emerging LLM capabilities, tooling, and Azure OpenAI updates; recommend and prototype improvements to keep the platform current
• Establish and maintain engineering best practices including CI/CD pipelines, code quality standards, and security practices for AI workloads
• Troubleshoot and resolve complex issues in retrieval quality, LLM hallucination, latency, and integration reliability

Skills

• 7–10 years of professional software engineering experience, with increasing scope and ownership
• Hands-on experience designing and deploying 2–5 production RAG agents or AI-powered applications
• Proficiency in Python for backend services and LLM orchestration (LangChain, Semantic Kernel, or similar frameworks)
• Working knowledge of Angular or comparable modern front-end frameworks
• Demonstrated experience with Azure OpenAI services — including LLM APIs, Azure AI Search (vector/index), and associated Azure infrastructure
• Experience with service-based and microservice architectures, RESTful API design, and async service communication
• Familiarity with MCP or other tool-calling/function-calling patterns for LLM-to-system integrations
• Experience with cloud environments (Azure preferred) including compute, storage, networking, and IAM fundamentals
• Practical knowledge of agile/scrum methodologies — sprint ceremonies, story estimation, backlog grooming
• Experience with Ragas or other LLM evaluation frameworks (RAGAS, ROUGE, G-Eval, etc.)
• Familiarity with retail systems — POS, OMS, inventory/merchandising platforms
• Exposure to LLMOps tooling such as MLflow, Weights & Biases, or Azure ML
• Prior experience in a Center of Excellence or innovation-focused team within a larger enterprise

Benefits

• Bonus opportunities & career advancement opportunities at every level
• Programs that help you reach your financial goals: 401k with company match, Employee Stock Purchase Plan, and Referral Bonus Program
• Medical, Dental, Vision, Life, and other Insurance Plans (subject to eligibility criteria)
• Paid vacation and sick time for eligible associates
• Paid holidays plus a personal holiday
• Paid Volunteer Time Off that starts on Day 1

Company Overview