Data Science Tech Lead Manager, Model Experience

Description

The company is a public benefit corporation headquartered in San Francisco that builds reliable, interpretable and steerable AI systems meant to be safe and good for people and society.

The company is growing quickly, with researchers, engineers, policy specialists and business leaders working toward the same goals.

You would join the growing Data Science and Analytics group, where data guides decisions across the company as it scales, and help set its working norms and standards.

You will be the senior data science leader for Model Experience and a strategic partner to product, engineering and research leaders. You will help shape the model roadmap and launch calls, and bring a view on how people experience the models and what success looks like beyond benchmark scores.

As a tech lead manager, you will hire and manage data scientists, set their agenda, personally lead the highest-stakes analyses, and raise the bar for how data shapes model and product decisions.

Responsibilities

• Partner strategically with product, engineering and research leads on the model roadmap, launch decisions and major bets
• Decide the team's data science agenda, including where it can have the most effect on model development and launches and what it should stop prioritizing
• Recruit, manage and grow data scientists, coaching them to move from answering questions to shaping decisions
• Frame the hardest and least defined questions on model quality and user experience, estimate the opportunity, and recommend a clear course, even when that challenges the current direction
• Set the core metrics and measurement frameworks for success across external products and internal testing so teams and leaders agree on what matters
• Set the standard for experimentation and causal inference, including launches without a clean A/B test, and personally lead the highest-stakes analyses
• Turn complex findings on model and user behavior into clear stories and recommendations for senior leaders and cross-functional partners
• Build foundational data practices and the analytics infrastructure needed for fast iteration as models and products change

Requirements

• You may be a good fit if you:
• You have deep data science experience, including leading analytics for a product or research area at large scale
• You have managed data science teams for 3+ years, setting direction, hiring and developing senior data scientists
• You have been a trusted partner to senior product, research and business leaders, with clear examples of changing a roadmap or a high-stakes decision
• You have strong product sense and business judgment, including framing the right question and taking a position with incomplete information
• You have deep expertise in experimental design, causal inference and high-scale statistical modeling, plus enough Python and SQL to stay hands-on and guide others' technical work
• You communicate clearly in writing and in presentations, including to executives
• You have a bias for action and do well in ambiguous, fast-moving settings where you create clarity and drive progress
• You care about building AI that is helpful, honest and harmless
• You hold a Bachelor's degree or an equivalent combination of education, training and/or experience in a field relevant to the role, shown through coursework, training or professional experience
• Strong candidates may also have:
• Experience with AI/ML products, large language models or developer tools in the AI/ML ecosystem
• Experience as a tech lead manager or player-coach, balancing hands-on technical work with people management
• Experience building or scaling a data science team in a fast-growing organization
• Experience working closely with product or research teams, especially on LLM or AI products
• Comfort working with unstructured data

Conditions

Annual salary: $380,000 - $460,000 USD

Years of experience required depend on the internal job level for the role

Office-based hybrid: staff are expected in an office at least 25% of the time, though some roles may require more

Visa sponsorship is offered, but not for every role and every candidate. If an offer is made, the company will make every reasonable effort to obtain a visa and retains an immigration lawyer to help.

Candidates are encouraged to apply even if they do not meet every listed qualification.

Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Office space for collaborating with colleagues