Daria Dumenko

I architect internal tools and dashboards at Duckbill AI, replacing fragmented operations with a Retool/Hex application that got 100% adoption across operational teams. I also build 20+ apps using Retool, Hex, and Airtable to raise QA data accuracy to 95%.

I run LLM evaluation and error detection using LangSmith and SQL, turning model output checks into feedback loops across B2B and B2B2C pipelines. I’ve also designed an RCA framework tied to CSAT feedback loops to guide executive process changes and lift customer satisfaction by 32%.

Before that, as Project Manager, AI Operations, I managed a QA team of 8 and supported HITL data annotation, cleaning, and QA pipelines for AI model training and testing. I led end-to-end A/B testing and experimental work with Product and GTM teams, and used Linear for sprint planning and project tracking.

Earlier, I worked as a Business Analyst at Dalton Wade Real Estate Group, building Power BI and Excel dashboards that cut executive decision-making time by 25%, and helped drive business growth with market and competitor research. I also managed $15M closing operations at a real estate group, tightening documentation controls and reducing compliance errors by 30%.