EXP-001 running
Contextual 'No Gina yet?' CTA after Step 1 on the Facebook group watcher guide
Page: /guides/facebook-group-watcher-meta-muse/
- What we think
- Readers of this guide stall at Step 1 because the watcher needs a Gina they do not have; a CTA at that point, promising setup on a call, will produce booking clicks where the generic hero and footer 'Book a call' buttons produced none.
- Before
- Only the generic hero and footer 'Book a call' buttons; nothing at the point in the steps where a reader without a Gina gets stuck.
- After
- Inline note after Step 1: 'No Gina yet? The watcher needs one to send its finds to. Book a call and we'll connect Muse to your Gina and tune the first watcher with you.' Link /?offer=fb-watcher#get-started, so a resulting CRM lead reads 'Asked about: the Facebook group watcher'. No title, meta, H1 or H2 changed.
- The number that decides it
- cta click. Baseline before the change: 0.
- Must not get worse
- engagement rate >= 0.6, organic ctr >= 0.03
- How we call it
- Read weekly; decide only once the page has >= 60 sessions in the read window. Win: >= 2 cta_click on this page (or any CRM lead 'Asked about: the Facebook group watcher') with both guardrails holding. Loss: 0 cta_click at the floor. Otherwise inconclusive. A guardrail breach reverts the change.
4 of 60 sessions, the amount of data we need before we trust a read.
Latest read (2026-10-27): inconclusive. Day one. Far below the sample floor, so no read. Search Console hasn't reported yet.
Log
- Proposed. Readers of the guide stall at Step 1 because the watcher needs a Gina they don't have.
- Staged. Built and checked on the staging site, in a browser at desktop and phone width.
- Approved. A founder approved it for production.
- Live. On production. The clock starts.
- Read. 4 of 60 sessions: inconclusive. Day one. Far below the sample floor, so no read. Search Console hasn't reported yet.
The raw record
{
"id": "EXP-001",
"title": "Contextual 'No Gina yet?' CTA after Step 1 on the Facebook group watcher guide",
"page": "/guides/facebook-group-watcher-meta-muse/",
"source_file": "src/guides/facebook-group-watcher-meta-muse.md",
"status": "running",
"risk_tier": "low",
"owner": "a founder",
"hypothesis": "Readers of this guide stall at Step 1 because the watcher needs a Gina they do not have; a CTA at that point, promising setup on a call, will produce booking clicks where the generic hero and footer 'Book a call' buttons produced none.",
"change": {
"kind": "cta",
"before": "Only the generic hero and footer 'Book a call' buttons; nothing at the point in the steps where a reader without a Gina gets stuck.",
"after": "Inline note after Step 1: 'No Gina yet? The watcher needs one to send its finds to. Book a call and we'll connect Muse to your Gina and tune the first watcher with you.' Link /?offer=fb-watcher#get-started, so a resulting CRM lead reads 'Asked about: the Facebook group watcher'. No title, meta, H1 or H2 changed.",
"shipped": "2026-10-26"
},
"primary_metric": "cta_click",
"guardrails": [
{
"metric": "engagement_rate",
"op": ">=",
"value": 0.6
},
{
"metric": "organic_ctr",
"op": ">=",
"value": 0.03
}
],
"sample_floor": {
"metric": "sessions",
"min": 60
},
"baseline": {
"window": {
"start": "2026-09-28",
"end": "2026-10-25"
},
"values": {
"sessions": 13,
"cta_click": 0,
"form_start": 0,
"generate_lead": 0,
"engagement_rate": 0.769,
"organic_clicks": 5,
"organic_ctr": 0.0455,
"position": 5.52
},
"note": "GA4 sessions/engagement 2026-09-28..10-25; Search Console clicks/CTR/position 2026-09-26..10-23 (2-3 day lag). cta_click baseline undercounts: offer links were not matched by the old click selector, fixed in the same PR."
},
"read_window": {
"start": "2026-10-27",
"end": "2026-12-21"
},
"decision_rule": "Read weekly; decide only once the page has >= 60 sessions in the read window. Win: >= 2 cta_click on this page (or any CRM lead 'Asked about: the Facebook group watcher') with both guardrails holding. Loss: 0 cta_click at the floor. Otherwise inconclusive. A guardrail breach reverts the change.",
"approval": {
"state": "approved",
"requested_from": "a founder",
"production_approved": "a founder 2026-10-26, sha 17356cb live 03:26 UTC"
},
"result": {
"label": "pending"
},
"sources": [
"GA4 property runReport (sessions, engagementRate, eventCount by eventName x pagePath), pulled 2026-10-26",
"Search Console talktogina.ai top pages, pulled 2026-10-26"
],
"limitations": [
"Staged before/after on one page, not a randomised split: seasonality and traffic mix can move the number.",
"About 3 sessions a week: the floor may take two months; most weekly reads will be inconclusive.",
"The tracking fix ships with the change, so part of any cta_click rise may be measurement, not behaviour; the offer=fb-watcher parameter isolates clicks on the new link."
],
"log": [
{
"date": "2026-10-26",
"event": "Proposed",
"note": "Readers of the guide stall at Step 1 because the watcher needs a Gina they don't have."
},
{
"date": "2026-10-26",
"event": "Staged",
"note": "Built and checked on the staging site, in a browser at desktop and phone width."
},
{
"date": "2026-10-26",
"event": "Approved",
"note": "A founder approved it for production."
},
{
"date": "2026-10-26",
"event": "Live",
"note": "On production. The clock starts."
}
],
"reads": [
{
"date": "2026-10-27",
"window": {
"start": "2026-10-26",
"end": "2026-10-26"
},
"sample": "4 of 60 sessions",
"observed": {
"sessions": 4,
"engagement_rate": 0.25,
"cta_click": 0,
"form_start": 0,
"generate_lead": 0,
"app_link_click": 0
},
"label": "inconclusive",
"note": "Day one. Far below the sample floor, so no read. Search Console hasn't reported yet."
}
]
}