Experiments Team

Experiments Team

See what we're building

People

What we're building

  • No-code experiments / Visual editor

    A visual editor for experiments would allow users to test changes to their website / app without having to touch the code.

    Project updates

    No updates yet. Engineers are currently hard at work, so check back soon!

Recently shipped

Custom experiment previews now available

You've probably noticed that it can tricky to tell variants apart from both each other and the control in the PostHog UI. So, Juraj has added the ability to uploac custom screenshots for each variant as an experiment preview.

This is especially useful if you're working on experiments which adjust small page elements, or if your traffic requires that experiments run for a long time to reach statistical significance.

Goals

Q4 2024 Objectives

This quarter, we're focusing on more feature improvements to help users create comprehensive and easy-to-analyze experiments. These improvements will make our product more mature and complete.

Objective 1: Finish HogQL rewrite

We will migrate Experiments to HogQL, making result calculations more reliable and performant. This will also enable the addition of new features listed below.

Objective 2: Multiple experiment goals supported + visualized

We will add support for multiple goal metrics in a single experiment, allowing them to be visualized together and making it easier to interpret results across all metrics simultaneously.

Objective 3: Reusable experiment metrics

We will add the ability to create metric sets that users can save and reuse. This will reduce friction, improve maintainability, and decrease the likelihood of errors.

Objective 4: Review and adjust methodology with a statistician

We will review our current methodology to ensure it is both accurate and easy for our users to understand.

Handbook

What this team does

We build PostHog's experimentation platform, allowing users run A/B tests and feature experiments easily in their apps. We help teams validate ideas, measure impact, and make informed decisions quickly and confidently.

Some of the things we're working on:

  • Experiments UI – an interface for setting up, managing, and analyzing experiments in PostHog.
  • Experimentation API – backend services that handle experiment creation, user assignment, and result analysis.
  • Statistical analysis – implementing statistical methods to ensure accurate interpretation of results.
  • Documentation – writing documentation and tutorials to help users get the most out of Experiments.

Slack channel

#team-experiments

Feature ownership

You can find out more about the features we (and the other teams) own here