Choosing the wrong email marketing agency is an expensive mistake. Not just because of the retainer you will pay while results fail to materialise, but because of the months of lost revenue, the damage to your list health from poor practices, and the time it takes to rebuild properly after a bad experience.

This guide gives you the exact criteria to evaluate any agency before you sign, the questions to ask on every discovery call, and the red flags that should end the conversation immediately.

The Non-Negotiables Before You Start Comparing Agencies

Before you evaluate anything else, three things should be present. If any of them are absent, move on.

Klaviyo partner status. If an agency is positioning itself as a specialist email partner for ecommerce brands in 2025 or 2026 and does not hold Klaviyo partner certification, that is a fundamental credibility gap. Klaviyo is the dominant email platform for DTC ecommerce. Klaviyo partner status means the agency has met specific training requirements, maintains a minimum volume of active Klaviyo clients, and has demonstrated platform expertise that Klaviyo itself has verified. It is not a guarantee of quality on its own, but its absence is a reliable signal of inexperience.

Ecommerce-specific case studies with real revenue numbers. Not screenshots of open rates. Not testimonials that say "great to work with." Specific case studies showing a DTC brand, the problem that existed, the strategy deployed, and the revenue outcome. Numbers. Dates. Context.

Any agency that cannot show you this either has not achieved results worth documenting, or does not understand that revenue outcomes are what clients actually care about. Neither is a good sign.

A clear answer to the question "who will actually be working on my account?" The agency principal who takes the sales call will not be the person building your flows. That is normal. What is not acceptable is vagueness about the team structure, unclear accountability, or an account manager who is handling 15 to 20 clients simultaneously. Ask directly how many clients each account manager carries. Top-tier agencies maintain two to three clients per account manager for strategic depth. Most carry ten to fifteen, which means your account gets attention when there is a crisis rather than consistent proactive strategy.

The Questions to Ask on Every Discovery Call

These are not generic questions. They are specifically designed to reveal how an agency actually operates rather than how they describe themselves.

"Walk me through your onboarding process in the first 30 days."

A competent agency should be able to answer this without hesitation. The first 30 days should include a full Klaviyo audit, a deliverability assessment, a strategy session, and the first flows going live. If the answer involves multiple strategy workshops, brand discovery sessions, and a "roadmap phase" before anything is built, that is a slow onboarding process dressed up in process language. You should see infrastructure live and revenue attributing within the first 30 days.

"What percentage of my store revenue should email be generating, and how will you get me there?"

This question separates agencies that understand ecommerce from agencies that just manage Klaviyo accounts. The correct answer is 25 to 35% of total store revenue for a well-run programme, with a specific explanation of the flow architecture and campaign cadence required to achieve it. A vague answer or an answer that focuses on open rates rather than revenue is a signal that the agency does not think in terms of business outcomes.

"Can you show me a case study from a brand in a similar category to mine, with specific revenue numbers?"

This is the most important question on the list. The answer reveals whether the agency has real results to stand behind. At Retain Marketing, we have documented case studies across sneakers, fragrance, wellness, bed linen, fitness, and multiple other verticals, each with specific revenue figures and outcomes. A brand in premium fragrance does not need a generic ecommerce case study. They need evidence that the agency understands their customer psychology, their purchase frequency, and their price point. Vertical-specific experience translates directly into faster results.

"How do you handle deliverability, and what is your process if our domain health declines?"

Deliverability is the invisible foundation of every email programme. If your emails are landing in spam, none of the creative or strategy matters. A good agency actively monitors domain health, sender reputation, and inbox placement rates. They know what a healthy Klaviyo deliverability score looks like, they track it monthly, and they have a clear remediation process if it declines. If the agency looks confused by the question or gives a surface-level answer about "best practices," that is a gap.

"How do you measure success, and what does your monthly reporting look like?"

The answer should centre on revenue. Specifically, total email-attributed revenue, revenue per recipient across flows and campaigns, email revenue as a percentage of total store revenue, and month-on-month trends across those figures. If the answer emphasises open rates, subscriber growth, and list size without connecting those metrics to revenue outcomes, the agency is reporting on activity rather than results. Activity is what they do. Results are what you pay for.

Red Flags That Should End the Conversation

These are not minor concerns. Each of these is a signal of an agency that will cost you more than their retainer.

Revenue-share pricing. Some agencies charge a percentage of email-attributed revenue rather than a flat retainer. On the surface this sounds aligned with your interests. In practice it creates an incentive to over-send, to count revenue that would have happened anyway, and to prioritise volume over list health. Over-sending to hit a revenue target damages your deliverability, accelerates list fatigue, and burns through subscriber trust that took months to build. A flat retainer aligns the agency's incentives with sustainable performance rather than short-term revenue extraction.

Locking you out of your own Klaviyo account. Your Klaviyo account is your asset. Your list, your flows, your templates, your data. An agency should be working within your account, not creating a separate account they control. If an agency insists on owning the account or makes it difficult for you to have full admin access at any time, walk away. This is a retention tactic that holds your data hostage and makes switching impossible without losing everything you have built.

No defined onboarding timeline with specific deliverables. Vagueness in the sales process predicts vagueness in the delivery process. If an agency cannot tell you precisely what will be built in the first 30 days and what revenue benchmarks they are targeting by month three, they are selling you a relationship rather than a result.

Promising specific revenue figures before they have audited your account. This is the opposite problem from vagueness, but equally concerning. An agency that tells you "we will get you to 30% email revenue in 60 days" before reviewing your current Klaviyo setup, your list health, your deliverability score, or your existing flow architecture is telling you what you want to hear rather than what is honest. Realistic projections require real data. Anyone who skips the data step and goes straight to the promise is selling, not advising.

Generic proposals. If the proposal you receive after a discovery call could have been sent to any ecommerce brand with your name swapped in at the top, the agency is not thinking about your specific situation. A specialist agency should reference your specific gaps, your vertical, your current email percentage, and the particular flows or fixes that would have the highest impact for your brand. Generic proposals produce generic results.

What Good Looks Like in Practice

When you find the right agency, the discovery process feels different. They ask more questions than they answer in the first conversation. They want to understand your customer, your product, your current metrics, and your revenue goals before they talk about what they would do. They show you case studies that feel genuinely relevant to your situation. They give you a clear picture of what the first 30, 60, and 90 days look like. And they are direct about what they can and cannot achieve given your current starting point.

At Retain Marketing, we work exclusively with DTC ecommerce brands doing a minimum of $50,000/month in revenue. We are selective about who we take on because the results we have documented, 396% flow growth for a US sneaker brand, £50,000 in 90 days for a UK fragrance brand, 642% revenue growth for a German bed linen brand, came from working in genuine partnership with brands whose foundations we believed in.

We do not take every enquiry. We take the ones where we are confident we can move the number significantly. And we tell you honestly in the first conversation if that is not the case.

A Simple Scorecard for Comparing Agencies

When you are evaluating multiple agencies simultaneously, score each one across these five criteria on a scale of one to five.

Klaviyo partner status and verified platform expertise. Ecommerce-specific case studies with real revenue numbers. Clarity on team structure and account manager capacity. Specificity of onboarding timeline and first 30-day deliverables. Reporting framework centred on revenue rather than engagement metrics.

Any agency scoring below three on any single criterion is worth questioning further before proceeding. Any agency scoring below three on two or more criteria is worth removing from consideration.

The agency that scores highest across all five is not necessarily the most expensive one. It is the one most likely to generate a return that makes the retainer irrelevant.

The Bottom Line

The email marketing agency landscape is crowded with generalists, platforms dressed up as agencies, and freelancers operating at a scale that cannot serve a growing DTC brand properly. Finding a genuine specialist is not difficult if you know what to look for.

Ask for revenue numbers. Ask about deliverability. Ask who is actually working on your account. Ask what the first 30 days look like. And trust the answers more than the pitch deck.

Book a 15-minute call with Retain Marketing and ask us every one of these questions. We will answer all of them directly, show you the case studies relevant to your category, and give you an honest assessment of what your email programme should be generating and what it would take to get it there.