We're transforming the grocery industry

At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.

Instacart has become a lifeline for millions of people, and we're building the team to help push our shopping cart forward. If you're ready to do the best work of your life, come join our table.

Instacart is a Flex First team

There's no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work-whether's from home, an office, or your favorite coffee shop-while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.

As a Senior Machine Learning Engineer at Caper, you will shape the core of our carts experience by leveraging our sensor data to create scalable and effortless experiences for our customers. You'll work alongside our computer vision, hardware, and Front End engineers, to bring together our various sensor inputs that create an intuitive experience on our shopping carts.

The AI and CV team at Caper (Instacart) is dedicated to building state of the art solutions to help retailers around the world create seamless shopping experiences via our AI-driven smart cart. Our team of enthusiastic researchers and engineers are spread across different time zones, but collaborate effectively with each other on multiple exciting projects.

In this role, you will:

• Drive end-to-end ML solutions from research to production
• Develop multimodal models to fuse the signals from our various sensors
• Implement sophisticated model architectures, training and evaluation pipelines
• Deploy models at the edge on Nvidia Jetson platform
• Build infrastructure for collecting, processing and storing sensor data
• Influence system design and product vision by making informed decisions

• Master or Ph.D degree in ECE, Computer Science, Applied Maths or related fields.
• 3+ years experience in sensor fusion, transformers, multi-modals, video understanding, and action/activity recognition.
• Strong communication and presentation skills who can collaborate with diverse stakeholders.
• Strong programming skills with one or more of these languages: Python, C+, Java/Kotlin.
• Strong skills in data science tools (SQL, Pandas, etc.) and machine learning frameworks (Pytorch, Tensorflow, Scikit-learn, etc.).
• Proven records on driving end-to-end ML solutions from research to production.

• Experience in designing and implementing end-to-end ML systems that can fuse multi-modality data and understand/interpret a complex spatial-temporal problem.
• Knowledge of modern visual-language models and multi-modal AI systems.
• Familiarity with A/B testing and experimentation methodologies in industrial settings.
• Independent and self-starter with the ability to identify and solve problems.

Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy for details.

Job offers may vary based on many factors, such as candidate experience and skills required for the role. This role is also eligible for a new hire equity grant as well as annual refresh grants.

Base pay ranges (USD):

CA, NY, CT, NJ - $207,000 - $219,000

WA - $198,000 - $209,000

OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI - $190,000 - $200,000

All other states - $173,000 - $182,000