Implementation: Sandbox Testing & Feedback Best Practices

Modified on Wed, Sep 9 at 11:43 AM

TABLE OF CONTENTS


Overview

Sandbox testing is where you see your configured experience for the first time and tell us what needs to change. How that feedback reaches us has a real effect on how quickly your implementation moves.

The practices below apply to any Clutch testing workbook, whatever product or phase you're testing. None of them take much time — most are about deciding who is doing what, and writing feedback in a way our team can act on right away.


Before You Begin

Block Dedicated Testing Time

Testing moves efficiently when the time is scheduled on purpose. Before the sprint starts, put these on your team's calendars:

  • Initial review — 1 to 2 hours, within the first three days.
  • Internal alignment — about 1 hour, to agree on what you're sending us.
  • Re-testing after updates — 1 to 2 hours.

Treat these as real meetings with a start and an end. Testing that gets squeezed between other work is the single most common cause of a sprint slipping.

Stay in the Current Sprint

Each sprint has its own themes and focus areas, and the sandbox is configured to match. Reviewing scenarios from a later sprint often means testing something that isn't finished yet, which produces feedback we then have to set aside.

Important: Working ahead almost always creates rework. If you have extra capacity, use it to re-test the current sprint or to align internally rather than to move forward.


Ownership and Internal Alignment

Assign a Clear Owner to Every Scenario

Each scenario in the workbook should have one named owner. Doing this up front prevents the four problems that slow testing down most:

  • Scenarios being overlooked because everyone assumed someone else had them.
  • Two people testing the same scenario and logging conflicting notes.
  • One person quietly carrying the entire workload.
  • Confusion later about who logged a piece of feedback and why.

Align Internally Before Requesting a Change

The person who defined a requirement often has a slightly different expectation than the person reviewing the sandbox. Sorting that out on your side first saves a round trip. Before you mark anything for Clutch to review:

  • Confirm with the right team member that the item genuinely needs to change, so we don't build an update you'll want reversed.
  • Consolidate everyone's input into one clear note.
  • Log the same issue once, rather than repeating it across multiple rows.

Using the Workbook

Start With the Instructions Tab

Before testing anything, read the instructions at the front of the workbook. It's short, and it's where the answers to most process questions live:

  • How to use the sheet.
  • What each status means.
  • The description, themes, and focus areas for each sprint.
  • What's expected of you during re-testing.

Be Specific in Your Notes

When you flag something for us to review, describe what's wrong and where you saw it. A specific note can usually be actioned the same day it's read. A vague one costs a round of questions first.

HelpfulLess helpful
APR disclosure is missing autopay language.Looks off.
Logo appears stretched on mobile view.Wrong.
Remove the NCUA logo from the footer.Fix this section.
Rate display should not show the maximum loan limit.Rates are incorrect.

Date and Initial Every Note

Start each comment with the date and your initials. This tells us which feedback is most recent when a row has been through more than one round, and who to follow up with if we have a question.

  • Example: 2/26 LA: Please change "Apply Now" to "Get Started."

Use Statuses Intentionally

Statuses are how we prioritize, so the difference between them matters. Your workbook's instructions tab defines the exact options, but the distinction to keep in mind is:

  • Something is broken — the page or feature can't be accessed, or it fails outright. These get looked at first.
  • Something needs an adjustment — the page loads and works, but copy, a disclosure, an image, or a displayed rate isn't right.
  • Something is confirmed — you've tested it, it's correct, and it's complete.

Remember to update the status as you go, not at the end. A row left on its default status reads to us as untested, even if you've added a note to it.


Re-Testing After Updates

Once we've addressed the items you flagged, they come back to you for a second look. That cycle works like this:

  1. Clutch makes the update and moves the item back to your team.
  2. Re-test the scenario in the sandbox to confirm the change landed the way you expected.
  3. Update the status to reflect what you found — approved if it's now correct, or back to us if it still isn't right.
  4. Add a dated note if anything is still off, describing what you're seeing now rather than restating the original issue.

A sprint closes when every scenario has been tested, re-tested where needed, and confirmed.


Frequently Asked Questions

What should we do if we finish the current sprint's scenarios early?

  • Use the time to re-test items that came back to you, or to align internally on feedback you haven't sent yet. Let your Engagement Manager know you have capacity — moving into the next sprint's scenarios before they're ready usually creates rework.

What if we spot an issue that isn't part of the current sprint?

  • Log it anyway, and note that it sits outside the current sprint's focus. We'll route it to the right sprint rather than losing it. Just don't go looking for those issues at the expense of the scenarios in front of you.

Who should own a scenario when more than one team is involved?

  • Give it a single owner — usually whoever is closest to the requirement being tested. That person is responsible for gathering input from compliance, marketing, or operations and consolidating it into one note. Shared ownership tends to mean no ownership.

What if our team disagrees about whether something needs to change?

  • Settle it internally before flagging the item. If you'd like input from us on what's possible or what other credit unions typically do, raise it with your Engagement Manager rather than logging both positions in the workbook.

Can we send feedback by email or in a meeting instead of the workbook?

  • Please put it in the workbook. It's the single record our team works from, and it's what tells us which items are still open. Feedback that arrives another way is easy to lose track of, and it won't show up when we review sprint status together.

Do we need to re-test everything after Clutch makes updates?

  • No — only the items that came back to your team. Scenarios you've already confirmed stay confirmed unless we tell you a change affected them.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article