The Crisis in Consumer Insights Research: How Bots, Fraud, and Failing Methodologies Are Poisoning Your Data
AI bots evade survey detection 99.8% of the time. Here's what this means for consumer research.
Most retention incentive programs create perverse outcomes. Here's what the data reveals about compensation structures that ac...

Sales compensation plans get audited quarterly. Marketing spend undergoes constant optimization. Yet retention incentives—the structures meant to keep your most valuable customers—often run on autopilot for years, quietly creating outcomes nobody intended.
A SaaS company we studied paid customer success managers based on account retention rates. Logical enough. The result: CSMs became expert firefighters, intervening dramatically when accounts showed churn risk. What they stopped doing: the proactive work that prevents fires from starting. Retention rates held steady while the organization burned resources on crisis management that shouldn't have been necessary.
The compensation structures designed to reduce churn frequently produce the opposite effect. Not because the people are incompetent or unmotivated, but because incentive design is harder than it looks. When you measure the wrong things, reward the wrong behaviors, or create the wrong time horizons, you get predictable dysfunction.
Traditional retention incentive structures carry costs that don't appear in budget line items. A customer success team at a mid-market software company discovered this when analyzing why their retention numbers looked good on paper but customer health scores were declining. Their comp plan rewarded preventing cancellations in the current quarter. CSMs had become skilled at convincing at-risk customers to stay—for now.
The pattern repeated across accounts. A customer would signal dissatisfaction. The CSM would intervene with discounts, feature promises, or executive attention. The customer would stay. Three months later, the cycle would repeat with higher stakes. The company was retaining revenue while accumulating an expanding population of unhappy customers who required increasing intervention to prevent departure.
The real cost wasn't the discounts or the CSM time. It was the opportunity cost of not addressing root causes. While the team optimized for preventing immediate cancellations, they weren't fixing the product gaps, onboarding failures, or expectation mismatches that created churn risk in the first place. Research into churn patterns reveals that companies spending more than 30% of CSM time on retention firefighting typically have systemic issues that reactive incentives mask rather than solve.
Another pattern emerges in organizations that tie retention bonuses to annual renewal rates. Account managers learn to time difficult conversations carefully. A customer wants to discuss downsizing their contract in November? That conversation might naturally drift into January, after bonuses are calculated. The incentive structure creates artificial cliffs in customer communication, exactly when continuous dialogue would serve both parties better.
Retention incentive design intersects with several well-documented behavioral patterns. Loss aversion—people's tendency to prefer avoiding losses over acquiring equivalent gains—shows up in how teams respond to at-risk accounts. When compensation structures penalize lost accounts more heavily than they reward healthy ones, teams naturally overweight retention of struggling customers relative to expansion of thriving ones.
A financial services platform restructured their CS compensation after noticing this pattern. Under their previous structure, losing a $50K account cost a CSM more (in terms of bonus impact) than expanding a $50K account into a $75K account gained them. The predictable result: CSMs allocated time toward accounts least likely to expand, because those were the accounts most likely to churn. The company was incentivizing defensive play over growth.
Present bias compounds these effects. Incentive structures that emphasize short-term retention metrics over longer-term health indicators create predictable time horizon problems. A CSM choosing between spending time on a customer success plan that will reduce churn risk in six months versus handling an escalation that threatens this quarter's numbers will rationally choose the escalation—even when the success plan would create more value.
The research on temporal discounting suggests that people systematically undervalue future outcomes relative to immediate ones. When compensation structures mirror this bias by heavily weighting current-period retention over future-period health, they amplify rather than correct for this cognitive tendency. Organizations end up with teams that are rationally responding to incentives in ways that harm long-term retention.
Effective retention requires several distinct activities, each with different time horizons and measurability. Onboarding work that ensures customers reach first value quickly prevents churn that might otherwise occur six months later. Proactive success planning that aligns product capabilities with customer objectives prevents churn that might otherwise occur in year two. Relationship building that creates organizational advocates prevents churn that might follow a champion departure.
Most retention incentive structures collapse this multidimensional work into a single metric: did the customer renew? This creates several problems. First, it makes attribution nearly impossible. When a customer renews, which activities drove that outcome? The onboarding work from 18 months ago? The quarterly business review last month? The product improvements the team advocated for? The single metric obscures the causal chain.
Second, it creates time horizon mismatches. Activities that prevent churn in future periods compete for attention with activities that prevent churn in the current measurement period. When both activities contribute to the same metric but on different timescales, the immediate always wins. This is rational behavior given typical incentive structures, but it systematically underinvests in longer-term retention drivers.
Third, it ignores the quality dimension of retention. A customer who renews after aggressive discounting and multiple executive escalations counts the same as a customer who renews enthusiastically and expands their contract. The incentive structure can't distinguish between retention that required extraordinary intervention and retention that flowed naturally from product-market fit and effective customer success work.
A B2B software company with 400+ enterprise accounts ran a natural experiment when they split their customer success team into two groups with different compensation structures. Group A continued with traditional retention-rate-based bonuses. Group B moved to a balanced scorecard that weighted retention rate at 40%, customer health scores at 30%, expansion revenue at 20%, and product adoption metrics at 10%.
Over 18 months, several patterns emerged. Group A maintained their historical retention rate of 91% but showed declining health scores among retained accounts and minimal expansion revenue. Group B saw retention rates initially dip to 89% (not statistically significant given sample sizes) but then recover to 93% by month 18. More importantly, their expansion revenue was 2.3x higher and customer health scores improved rather than declined.
The initial dip in Group B's retention rate revealed something important. Under the old structure, CSMs had been retaining some accounts that probably shouldn't have been retained—customers with poor product fit who required disproportionate resources. The new incentive structure made it rational to have honest conversations about fit rather than applying heroic measures to prevent every cancellation. Some marginal accounts churned earlier, freeing resources for customers with better long-term potential.
By month 18, Group B was retaining more accounts than Group A, but the composition had shifted. They were losing poor-fit accounts earlier while retaining and expanding good-fit accounts more effectively. The balanced scorecard had created space for strategic account management rather than pure retention defense.
Another organization experimented with team-based versus individual retention incentives. Their hypothesis: individual incentives might create information hoarding and lack of collaboration, while team incentives might create free-rider problems. They tested both structures across different regions.
The results were nuanced. Team-based incentives did increase collaboration and knowledge sharing, as hypothesized. CSMs were more willing to help colleagues with challenging accounts because there was no individual penalty for time spent on accounts outside their portfolio. However, team structures also made it harder to identify and address individual performance issues. Low performers could hide within high-performing teams.
The solution they converged on: hybrid structures with 70% of retention incentives based on individual portfolio performance and 30% based on team outcomes. This preserved individual accountability while creating meaningful incentives for collaboration. The key insight was that the optimal structure depends on the specific coordination problems your organization faces.
Quantitative metrics dominate retention incentive structures because they're easy to measure and hard to dispute. Revenue retained, accounts renewed, and net retention rates can be calculated precisely. But this precision comes at a cost. The most important early indicators of future churn risk are often qualitative: deteriorating relationships, declining executive engagement, growing misalignment between product roadmap and customer needs.
Organizations struggle to incorporate these signals into compensation structures because they resist easy quantification. How do you fairly compensate someone for relationship quality or strategic alignment? The typical solution is to ignore these factors in formal incentives while hoping that professional pride and company culture will motivate the right behaviors anyway.
Some organizations are finding middle ground by using structured qualitative assessments as inputs to compensation decisions. One approach: quarterly account reviews where CS leaders evaluate not just outcomes but the quality of customer success work. Did the CSM proactively identify risks before they became crises? Are they building relationships beyond their day-to-day contact? Do they understand the customer's business well enough to provide strategic guidance?
These assessments don't replace quantitative metrics but complement them. A CSM with strong retention numbers but poor marks on qualitative factors might be succeeding through luck or favorable account assignment rather than skill. Conversely, a CSM with temporarily weak numbers but strong qualitative performance might be investing in longer-term retention drivers that haven't yet shown up in renewal rates.
Customer research platforms are making some qualitative factors more measurable. Systematic analysis of customer conversations can surface sentiment trends, engagement patterns, and early warning signals that previously required subjective assessment. When customers start using more tentative language in success calls or asking more questions about contract flexibility, these can be quantified and tracked even if they don't immediately impact retention rates.
Retention incentives that work for enterprise accounts often fail for mid-market or SMB segments, yet many organizations apply uniform structures across their entire customer base. The dynamics are fundamentally different. Enterprise retention depends heavily on relationship depth, strategic alignment, and organizational change management. SMB retention depends more on product usability, time-to-value, and self-service support quality.
A company serving both segments discovered this when their enterprise CSMs thrived under relationship-focused incentives while their SMB CSMs struggled. The SMB team couldn't build the same relationship depth with 200 accounts that the enterprise team built with 20. They needed different metrics that reflected the different retention drivers in their segment.
The solution involved segment-specific scorecards. Enterprise CSMs were evaluated on relationship depth (measured through executive engagement, strategic planning sessions, and expansion pipeline), account health (measured through product adoption and support ticket trends), and retention outcomes. SMB CSMs were evaluated on scaled engagement metrics (webinar participation, resource utilization, community involvement), product adoption velocity, and retention cohorts.
The key insight: retention drivers vary by segment, so retention incentives should vary too. Trying to apply enterprise relationship-building incentives to SMB segments creates frustration and dysfunction. The CSM can't physically build deep relationships with 200 accounts, so they either burn out trying or game the system by focusing on a subset of accounts while neglecting others.
Many organizations separate retention and expansion responsibilities, assigning customer success teams to retention and account management or sales teams to expansion. The logic seems sound: different skills, different activities, different metrics. The reality often creates perverse incentives and customer confusion.
A customer signals interest in additional products. Who owns that conversation? If the CSM refers it to an account manager, they might lose credit for expansion revenue while doing the relationship work that made expansion possible. If they try to handle it themselves, they might lack the skills or authority to close the deal. The customer experiences handoff friction and unclear ownership.
Worse, the separation can create conflicting incentives. The CSM is measured on retention, which might be easiest to achieve by keeping the customer relationship stable and avoiding difficult conversations about underutilized features or missing capabilities. The account manager is measured on expansion, which requires surfacing unmet needs and creating urgency around gaps. The customer receives mixed messages.
Organizations are experimenting with structures that align retention and expansion incentives. One approach: CSMs receive credit for expansion opportunities they identify and qualify, even if someone else closes the deal. This creates incentive alignment—the CSM benefits from surfacing expansion potential rather than keeping the relationship safely static.
Another approach: shared goals where both CSMs and account managers are measured on net retention rate, which combines retention and expansion. This creates natural collaboration because both parties benefit from the same outcomes. The challenge is ensuring fair credit attribution when multiple people contribute to an outcome.
Most retention incentive structures use quarterly or annual measurement periods because they align with business planning cycles and compensation administration. But retention work often operates on longer timescales. The onboarding work that prevents six-month churn, the success planning that prevents 18-month churn, and the relationship building that prevents champion-departure churn all require time horizons that don't fit neatly into quarterly reviews.
This creates several problems. First, it undervalues long-term retention drivers. A CSM choosing between activities that will impact this quarter's retention versus activities that will impact next year's retention will rationally choose the former if that's what their compensation measures. Second, it makes it hard to learn what works. If you change your onboarding approach, you might not see retention impact for six to twelve months. By then, you've probably changed several other things too, making attribution difficult.
Some organizations are experimenting with longer measurement periods. Instead of quarterly bonuses based on that quarter's retention, they use rolling 12-month retention rates or cohort-based metrics that track customers from onboarding through renewal. This better aligns incentive timeframes with retention driver timeframes.
The challenge is balancing longer measurement periods with the need for frequent feedback. Waiting 12 months to learn whether your approach is working is too slow. The solution often involves leading indicators—metrics that predict future retention and can be measured more frequently. Product adoption rates, customer health scores, and engagement metrics can provide quarterly feedback on activities that will impact retention over longer periods.
Retention incentive structures typically use internal metrics: renewal rates, revenue retention, account health scores calculated from product usage and support data. These metrics matter, but they can miss something fundamental: what customers actually think and feel about their experience.
An enterprise software company discovered this gap when they noticed a disconnect between their customer health scores and actual renewal outcomes. Accounts that looked healthy based on product usage and support metrics were churning at higher rates than expected. When they started conducting systematic exit interviews, they found that many customers were frustrated with aspects of the relationship that internal metrics didn't capture: slow response times to strategic questions, lack of proactive guidance, feeling like just another account number.
They restructured their retention incentives to include customer sentiment as a component. Not NPS scores, which they found too gameable and disconnected from actual retention risk, but structured feedback from quarterly customer conversations. Research-grade customer interviews conducted systematically can surface retention risks that usage metrics miss.
The key was making the feedback specific and actionable. Rather than asking customers to rate their satisfaction on a scale, they asked about specific aspects of the relationship: Are we helping you achieve your business objectives? Are you getting the strategic guidance you need? Would you recommend us to a peer? The responses provided clear signals about relationship health that complemented usage-based metrics.
Incorporating customer voice into compensation structures requires solving several challenges. First, ensuring feedback is genuine rather than inflated because customers know it affects their CSM's compensation. Second, making it fair when some CSMs inherit problematic accounts with years of accumulated issues. Third, preventing gaming where CSMs coach customers on what to say.
The solutions typically involve independent research teams conducting customer conversations, clear communication that feedback is confidential and won't directly impact the CSM's compensation (it's one input among many), and focusing on trends over time rather than absolute scores. A CSM who inherits a struggling account and gradually improves sentiment scores demonstrates more skill than one who maintains high scores on naturally healthy accounts.
Retention isn't just the responsibility of customer success teams. Product teams that build features customers need, support teams that resolve issues quickly, sales teams that set accurate expectations, and executive teams that maintain strategic relationships all contribute to retention outcomes. Yet retention incentives typically focus narrowly on CS teams.
This creates coordination problems. A product team decides to sunset a feature that 20% of customers rely on. The CS team deals with the churn fallout, but the product team faces no retention consequences in their compensation structure. A sales team overpromises capabilities to close deals. The CS team inherits customers with unrealistic expectations, but the sales team has already collected their commission.
Organizations are experimenting with broader retention accountability. Some tie a portion of product team bonuses to retention rates among customers using their features. Some include retention metrics in sales compensation, not just at the point of initial sale but over the customer lifetime. Some make executive bonuses dependent on company-wide retention performance.
The challenge is keeping incentives simple enough to understand while making them comprehensive enough to drive aligned behavior. A product manager who is measured on feature adoption, customer satisfaction, development velocity, and retention might face so many competing priorities that the incentive structure loses effectiveness. The solution often involves clear prioritization—retention as the primary metric with others as constraints or secondary factors.
After examining incentive structures across dozens of organizations and reviewing the behavioral economics literature, several principles emerge for designing retention incentives that don't backfire.
First, measure what matters, not just what's easy to measure. Retention rate is easy to calculate but often misses the quality dimension. A balanced scorecard that includes customer health, expansion potential, and relationship quality alongside retention outcomes creates better incentives than retention rate alone. The additional complexity is worth it when it prevents gaming and misaligned behavior.
Second, align time horizons with retention drivers. If the activities that prevent churn take six months to show results, don't measure performance quarterly. Use leading indicators that can be measured more frequently while tying ultimate compensation to longer-term outcomes. This might mean quarterly feedback on health scores and annual bonuses based on retention rates.
Third, make incentives specific to customer segments and organizational roles. Enterprise CSMs need different incentives than SMB CSMs. Product teams need different incentives than customer success teams. One-size-fits-all structures create dysfunction because they can't account for different retention drivers and different spheres of control.
Fourth, incorporate customer voice systematically. Internal metrics can miss relationship issues that predict churn. Structured customer feedback, collected independently and analyzed rigorously, provides signal that usage data can't capture. The key is making it systematic rather than anecdotal and fair rather than gameable.
Fifth, balance individual and team incentives based on your coordination needs. If retention requires significant collaboration and knowledge sharing, weight team incentives more heavily. If individual accountability is critical, weight individual incentives more heavily. Most organizations need both, with the specific balance depending on their structure and challenges.
Sixth, test and iterate. Incentive structures have complex effects that are hard to predict. Start with hypotheses about what behaviors you want to encourage, implement structures that should encourage those behaviors, measure actual outcomes, and adjust based on evidence. The organizations with the most effective retention incentives are those that treat incentive design as an ongoing experiment rather than a set-it-and-forget-it decision.
Changing retention incentive structures is harder than designing better ones. People have built their work patterns around existing incentives. Compensation changes create anxiety and resistance. Teams worry that new structures will penalize them for factors outside their control or reward colleagues who have easier accounts.
Successful transitions typically involve several elements. First, extensive communication about why the change is happening and what problems the current structure creates. Teams need to understand not just what's changing but why it matters. Second, grandfathering or transition periods that give people time to adjust their approach before the new incentives fully take effect. Immediate switches create panic and resentment.
Third, fairness mechanisms that account for factors outside individual control. If some CSMs inherit struggling accounts while others get healthy ones, the incentive structure needs to account for starting conditions. This might mean measuring improvement rather than absolute performance, or risk-adjusting targets based on account characteristics.
Fourth, transparency about how incentives are calculated and what behaviors they're meant to encourage. Black box compensation formulas create anxiety and prevent people from optimizing their approach. Clear, simple structures that people can understand and predict work better than complex formulas that seem arbitrary.
Fifth, feedback loops that let people see how their actions connect to outcomes. If someone changes their approach based on new incentives, they need to see relatively quickly whether it's working. Long delays between action and feedback make learning difficult and create frustration with the new structure.
Technology is making new approaches possible. AI-powered analysis of customer interactions can surface early warning signals that were previously invisible or required subjective assessment. Predictive models can estimate future churn risk with increasing accuracy, enabling incentive structures based on risk-adjusted outcomes rather than just binary retention.
Real-time dashboards can provide continuous feedback on retention drivers rather than quarterly snapshots. This enables shorter learning cycles and more responsive behavior change. A CSM can see within days rather than months whether changes to their approach are improving customer health scores or engagement metrics.
More sophisticated attribution models can better allocate credit when multiple people and teams contribute to retention outcomes. Machine learning approaches can identify which activities and touchpoints most strongly predict retention, enabling incentive structures that reward the highest-impact work rather than just the most visible work.
But technology doesn't solve the fundamental challenge: aligning individual incentives with organizational outcomes in ways that don't create perverse effects. That requires careful thinking about human behavior, organizational dynamics, and the specific retention drivers in your business. The best retention incentive structures will always be those designed with deep understanding of how people actually respond to incentives, not just how we wish they would respond.
The organizations that get this right don't just reduce churn. They create cultures where retention is everyone's responsibility, where teams naturally collaborate around customer success, and where the work that prevents churn is also the work that people find most rewarding. That's when incentive structures stop being necessary evils and start being genuine enablers of better outcomes.