[Remote] UX Engineer, LLM Experimentation Platform

Note: The job is a remote job and is open to candidates in USA. Arize AI is a leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to build high-performing applications. The UX Engineer will focus on refining user experiences for an LLM evaluation and prompt experimentation platform, making complex tools manageable and enjoyable for technical users. Responsibilities • Refine and iterate on UX for existing features - you won't build from scratch, but you'll make things significantly better • Watch real users struggle in Fullstory, identify friction points, and fix them • Prototype interaction alternatives rapidly (in Figma or code) to test different approaches • Work closely with our Senior engineers who own feature architecture - they build the foundation, you perfect the interface • Own the "feel" of the product: transitions, feedback, error handling, progressive disclosure • Build reusable interaction patterns that the team can leverage • Run lightweight usability tests to validate improvements • A typical week might include: • Watching 10 user sessions, identifying 3 common friction points • Prototyping 2 different flows for evaluator configuration in Figma • Implementing the winner with smooth transitions and helpful inline guidance • Pairing with Staff engineers to refactor a complex form into a multi-step wizard • Running a quick usability test with 5 users on the new onboarding flow Skills • You've made products noticeably better through interaction refinement (show us!) • You're comfortable with modern frontend frameworks and animation libraries • You've used session replay tools and incorporated user feedback into designs • You can work in Figma to prototype before committing to code • You think about edge cases, loading states, and empty states automatically • You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters • Bonus: You've built or contributed to design systems • Formal design training (though it's welcome) • Full-stack experience (we have engineers for that) • Experience with our specific tech stack (we care more about your UX sensibility) Benefits • Medical • Dental • Vision • A 401(k) plan • Unlimited paid time off • A generous parental leave plan • Additional support for mental health and wellness Company Overview • Arize is an AI engineering platform focused on evaluation and observability. It helps engineers develop, evaluate, and observe AI agents. It was founded in 2020, and is headquartered in Berkeley, California, USA, with a workforce of 51-200 employees. Its website is https://arize.com. Company H1B Sponsorship • Arize AI has a track record of offering H1B sponsorships, with 1 in 2025, 1 in 2024. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job Apply To this Job