* Adjust Digest Email design and configuration
* Adjust some tests
* Update tests
* More adjustments to markup and tests
* More adjustments to markup and tests
* Digest email feature flag
* Test title variants
* Add a/b test for feed style on new users
* Add current_user check
* Adjust to not look for current_user right away
* Move field test to the right place
* Add a/b test for which comments to show in feed
* Adjust figure
* Started at
* Move scope placement around
* Add tests for different comments_variants passed
* Fix typo
This involves declaring the 20220603-variant-a the winner of the past
experiment; note in the past experiment there was not a statistically
significant winner.
This new experiment adds a variant that deviates from the new
incumbentby way of reintroducing the follows an author and adjusting the
tag follow weights.
Closesforem/forem#18082
```shell
$ diff config/feed-variants/20220617-variant-a.json \
config/feed-variants/20220712-variant.json
```
Results in:
```shell
3c3
< "description": "Blend of 20220603-variant-b and 20220603-variant-a",
---
> "description": "Builds from 20220617-variant-a (see https://github.com/forem/forem/issues/18082)",
50a51,57
> "following_author": {
> "cases": [
> [0, 0.8],
> [1, 1]
> ],
> "fallback": 0.8
> },
70,73c77,80
< [0, 0.5],
< [1, 0.85],
< [2, 0.9],
< [3, 0.95],
---
> [0, 0.3],
> [1, 0.9],
> [2, 0.95],
> [3, 0.98],
```
This change introduces several things things:
1. Fixes the performance of the `/admin/abtests` page; instead of
rendering all of the experiment results, just render the overview.
2. Adjust the show page for an experiment to show the summary of
results.
3. Favor the existing "started_at" and "ended_at" attributes of
FieldTest (see https://github.com/ankane/field_test#config)
4. Update the field test experiments to include the `started_at` and
`ended_at` attributes.
5. Skip processing all non-active experiments in our conversion handler.
Why are there no tests? This is a page that is Admin only and is only
visible for reporting purposes. So, it's not quite worth writing tests
as you'd need lots of data. So we'll assume the logic from the upstream
[field_test gem][1] is adequate.
Closesforem/forem#17869
[1]:https://github.com/ankane/field_test
This commit contains two separate but related changes:
1. A check-list for creating a new experiment.
2. A new experiment along with declaring a winner for the previous experiment.
Below are the diffs of the two new variants versus the incumbent for the
experiment:
```
❯ diff config/feed-variants/20220603-variant-b.json config/feed-variants/20220518-variant.json
3,4c3
< "description": "As 202205518-variant but with modificiation to `order_by` lever.",
< "order_by": "final_order_by_random_weighted_to_score",
---
> "order_by": "relevancy_score_and_publication_date",
```
```
❯ diff config/feed-variants/20220603-variant-a.json config/feed-variants/20220518-variant.json
3d2
< "description": "As 202205518-variant but with modificiation to `matching_positive_tags_intersection_count`.",
69c68
< [0, 0.5],
---
> [0, 0.7],
```
Closesforem/forem#17822
