Published: Fri, 22 Nov 2024 02:50:28 GMT
Position: Senior Software Engineer – Machine Learning Infrastructure
Company: Plaid
Location: Remote or San Francisco
Overview:
Plaid’s Machine Learning Infrastructure (ML Infra) team is seeking an experienced Software Engineer to lead the development and maintenance of foundational systems, tools, and processes for efficient, scalable, reliable, responsible, and secure machine learning workflows. As the Senior Software Engineer, you will be responsible for designing and building the Feature Store platform for Plaid, as well as setting the multi-year technical strategy and roadmap for the team. You will also collaborate with other Data Platform engineers to continuously improve Plaid’s data ecosystem.
Key Responsibilities:
– Design and develop a robust and efficient Feature Store platform customized for Plaid’s use cases to streamline feature engineering for both batch and real-time streaming features.
– Develop and maintain infrastructure and tools for deploying models into production with observability and low latency.
– Utilize vendor-based solutions, like Sagemaker Notebook, and in-house/open-source solutions, like ML-Flow and Trino, to support early model experimentation, version monitoring, and tracking.
– Develop a framework to forecast, monitor, attribute, and track the cost for end-to-end ML development lifecycle.
– Lead and mentor the ML Infra team, providing technical leadership in engineering excellence.
– Collaborate with MLEs and product engineers to support different ML-based product lines.
– Help pioneer the early foundation of Plaid’s LLM AI platform.
Qualifications:
– 8+ years of software engineering experience.
– Extensive hands-on experience in the ML Infrastructure or Platform domain at similar or larger companies.
– Deep understanding of high-quality ML Infrastructure systems, including Feature Stores, Training Infrastructure, Serving Infrastructure, and Model Monitoring.
– Strong experience in developing Feature Store systems.
– Excellent cross-functional collaboration, communication, and project management skills.
– Proven ability to mentor and guide junior engineers.
– [Nice to have] Experience with AWS Sagemaker, Tecton, or LLM training/serving infra/platform.
If you are passionate about ML infrastructure and solving real-world problems, especially in the fintech world, and have a strong track record of delivering successful projects within the ML Infrastructure or Platform domain, then we want to hear from you! Apply now to shape the future of ML at Plaid. Apply link
