Managing Multiple Sample Suppliers From One Dashboard: Blend, Deduplicate, Allocate

Few research agencies run a study using only one sample source anymore. Hard-to-reach audiences, project deadlines, pricing, and sample availability often make it necessary to work with multiple suppliers.

Managing those suppliers involves more than tracking completes and quotas. Research teams also need to prevent duplicate respondents, maintain a consistent sample mix, and decide how to allocate responses across different sources.

The operational side of supplier databases, rate cards, feasibility requests, scorecards, and invoices is covered in OnGraph’s guide to market research supplier management software. For tracking completes and quota progress, see our guide to tracking survey quotas across multiple suppliers.

This article focuses on three problems that become important when multiple suppliers work on the same project: respondents entering through more than one supplier, survey results changing because the supplier mix changes, and allocation decisions that must balance cost with consistency.

These are the main reasons research agencies need a central dashboard for multi-supplier sample management, rather than relying on separate supplier reports.

Why Individual Supplier Reports Are Not Enough

Every sample supplier reports on its own traffic and uses methods to identify duplicate respondents within its network.

For example, Toluna’s ESOMAR 37 response (2025) explains that respondents cannot participate in the same survey more than once across its sample sources. The company uses technology to recognize respondents even when they attempt to enter through another source within its network.

Similarly, Cint uses duplicate checks and provides response status codes for issues such as duplicate supplier IDs and cookies.

These checks help suppliers control duplicate participation within their own systems. However, they do not automatically provide visibility across every independent supplier used by a research agency.

For example, Toluna may not know that a respondent has also entered the same study through Cint or an agency’s owned panel. Each supplier sees its own traffic, but the research agency needs to see the complete picture.

Combining supplier reports can show total responses and delivery progress. It does not automatically reveal duplicate respondents across suppliers, changes in sample composition, or differences in survey results between sources.

That is why research agencies need a shared view of all suppliers working on the same project.

Problem 1: The Same Respondent Enters Through Two Suppliers

Respondents often belong to more than one online research panel. This creates a risk when multiple suppliers recruit participants for the same study.

The American Association for Public Opinion Research (AAPOR), in its 2010 report on online panels, discussed the problem of overlapping panel memberships.

The report cited an Advertising Research Foundation study involving 17 panel companies. It reported duplication rates of 40% or 16%, depending on the measurement method. Another comparison in the Netherlands found that 62% of respondents belonged to more than one panel, with an average of 2.7 panel memberships.

These findings are historical and should not be treated as current duplication rates. However, they show why panel overlap has long been an important consideration in online research.

AAPOR’s 2022 task force report on data quality also noted that the current level of overlap across panels remains unclear.

The important distinction is that belonging to several panels is not necessarily a problem. The problem occurs when the same respondent is counted more than once in the same study.

Duplicate participation can affect research quality in several ways:

• Sample representation: A duplicate respondent receives more weight in the final dataset than intended.
• Research costs: The agency may pay multiple suppliers for responses from the same person.
• Quota accuracy: Duplicate completes can make quota cells appear full before the required number of unique respondents has been reached.
• Data quality: Repeated participation can affect the reliability of survey findings.

How to manage duplicate respondents across suppliers

The agency needs a cross-supplier deduplication process that checks respondents before they enter the survey.

AAPOR’s 2022 task force describes using information such as IP addresses, panelist identifiers, and device information to identify potential duplicates when combining samples from multiple vendors.

Supplier-assigned respondent IDs alone are not enough because the same person may have different IDs across panels.

A central deduplication process should evaluate available signals across all suppliers, identify likely duplicate participation, and apply the appropriate response status. These checks should also account for false positives, shared networks, privacy requirements, and applicable consent rules.

The dashboard should record which suppliers are involved in duplicate attempts. For example, if many duplicate attempts occur between Supplier A and Supplier B, the research team can review whether both suppliers should receive the same allocation in future projects.

The technical handling of supplier response statuses and callbacks is covered in our guide to market research software integrations.

The goal is to prevent duplicate responses from being accepted as separate valid completes and ensure supplier reconciliation follows the agreed project rules.

Problem 2: Survey Results Change When the Supplier Mix Changes

Different sample suppliers may produce different survey results, even when they work on the same study.

Suppliers can differ in recruitment methods, panel composition, respondent behavior, and audience availability. These differences can affect the responses collected.

Pew Research Center’s 2016 study, Evaluating Online Nonprobability Surveys, compared nine online samples against 20 benchmarks.

The most accurate sample had an average estimated bias of 5.8 percentage points. The least accurate samples produced estimates that were approximately 10 percentage points away from benchmark values on average.

For one question about whether someone in a household had received unemployment compensation during the previous year, the government benchmark was 4%. Estimates from the nine weighted online samples ranged from 8% to 16%.

These findings show why the choice of sample source matters.

How changing the sample blend affects results

Consider a survey using two suppliers. Supplier A reports an 8% result for a particular question, while Supplier B reports 16%.

The figures below use those two values to illustrate how a change in supplier allocation can affect the combined result.

Illustrative calculation using the 8% and 16% values discussed above. The combined results assume the stated supplier shares are the applicable weights.

In this example, changing the supplier mix from 50/50 to 70/30 moves the combined result from 12% to 10.4%.

That is a difference of 1.6 percentage points, even though the result within each supplier has not changed.

For a one-time study, this can complicate interpretation. For a tracking study, it can create an apparent change over time that is partly caused by the sample source rather than the market.

How to maintain sample blend consistency

ESOMAR’s 37 Questions to Help Buyers of Online Samples addresses this issue directly.

Question 26 asks suppliers how they manage source consistency and sample blending at the project level, particularly for tracking studies. It also asks whether suppliers can provide source reports and include source information in respondent-level data.

Research agencies managing multiple suppliers should apply similar controls across their full project.

A practical approach includes:

• Track the source of every response: Store supplier information with each respondent record.
• Set target supplier shares: Define the planned blend before fieldwork begins.
• Monitor the blend by quota cell: Check supplier contributions within important audience segments.
• Compare tracking waves: Identify changes in source composition between waves.
• Set tolerance limits: Alert project managers when supplier shares move beyond agreed limits.
• Review supplier-level results: Compare important survey measures by source to identify meaningful differences.

For tracking studies, the initial supplier mix should be documented and kept reasonably consistent across waves.

If a supplier must be replaced, running the old and new sources in parallel for a wave can help the research team assess potential differences before making a permanent change.

The objective is to understand how supplier changes may affect results and avoid treating every movement in a tracker as a real market change.

Problem 3: Supplier Allocation Must Balance Cost, Delivery, and Consistency

Allocating survey completes across suppliers is not simply a matter of choosing the lowest price.

Research teams usually need to balance four factors:

• Feasibility: Whether a supplier can reach the required audience.
• Cost: The price of obtaining usable survey completes.
• Delivery performance: How quickly and consistently a supplier can deliver responses.
• Sample consistency: Whether the supplier mix remains suitable for the study.

These factors do not always point toward the same decision.

For example, sending more traffic to the cheapest supplier may reduce immediate costs. However, it can also change the sample blend and affect the consistency of survey results.

On the other hand, maintaining a fixed supplier allocation may increase costs or delay fieldwork when one supplier cannot deliver enough respondents.

Supplier participation also depends on the economics of the survey.

According to Cint’s earnings-per-click guidance, surveys with earnings per click below $0.15 can struggle to attract supplier traffic.

This means a supplier’s actual contribution depends not only on the allocation requested by the buyer but also on survey conversion rates and expected earnings.

A practical example of supplier allocation

Suppose a research agency needs 1,000 valid completes from three suppliers.

The project manager decides on the following initial allocation:

This is an illustrative allocation, not actual project data.

Now suppose Supplier B is unable to deliver its full allocation for a particular quota cell.

The agency may need to open additional capacity with another supplier. However, automatically moving all remaining completes to the cheapest available source could change the agreed sample blend.

A better approach is to review the remaining quota, delivery performance, source overlap, and acceptable blend limits before reallocating traffic.

This is where a central supplier management dashboard becomes useful.

Primary suppliers and backfill suppliers

One practical approach is to separate primary suppliers from backfill suppliers.

Primary suppliers receive the agreed allocation and are responsible for delivering the planned sample mix.

Backfill suppliers are used when primary suppliers cannot fill particular quota cells within the required time.

Backfill should be controlled rather than left open without limits. The dashboard should show when backfill begins, how many completes it contributes, and how those responses affect the original supplier mix.

Research teams should also set quotas by supplier and quota cell instead of relying only on one shared project-level target.

Through survey panel integration, quota status and survey responses can be coordinated between suppliers and the research platform, subject to the capabilities of the connected systems.

When a supplier reaches its allocated limit, the system should stop or redirect further traffic according to the project’s rules.

Cross-supplier duplicate reports can also help with future allocation decisions. If two suppliers consistently show high overlap, the research team may decide to reduce one supplier’s share or use it mainly for backfill.

What One Multi-Supplier Dashboard Should Show

A useful multi-supplier sample management dashboard should allow project managers to monitor the entire study without downloading and combining separate supplier reports.

It should bring together delivery, duplicate checks, sample blending, costs, and supplier status.

The following six areas are especially important.

1. Delivery by supplier and quota cell

The dashboard should show completes, terminates, overquotas, and quality removals for every supplier within each quota cell.

This helps project managers identify which suppliers are delivering the required audience and where fieldwork is falling behind.

2. Cross-supplier duplicate tracking

The system should show the number of duplicate attempts detected across suppliers and identify the supplier pairs involved.

This makes it easier to review overlapping sources and understand where duplicate participation is affecting delivery.

3. Sample blend monitoring

Project managers should be able to compare actual supplier shares against the planned allocation.

For tracking studies, the dashboard should also show changes by wave and quota cell, with alerts when the blend moves outside agreed limits.

4. Supplier-level survey results

Important survey measures should be available by supplier.

If one source consistently produces different results, the research team can investigate during fieldwork instead of discovering the issue after data collection has finished.

5. Cost per usable complete

The cheapest supplier is not always the most cost-effective.

A supplier may offer a lower quoted price but deliver more responses that fail quality checks or cannot be accepted.

The dashboard should therefore calculate cost per usable complete after quality removals and reconciliation, using the project’s agreed billing rules.

6. Supplier and quota status

The dashboard should show which suppliers are open, paused, or closed, along with their remaining allocation.

It should also help project managers confirm that supplier-level quotas match the status maintained by the survey platform.

Many market research project management tools already support supplier delivery tracking and cost management.

However, cross-supplier deduplication, blend monitoring, and supplier-level response comparisons require visibility across the full project.

These capabilities are what make a central dashboard more useful than simply displaying several supplier reports together.

For a broader view of how supplier management connects with project setup, fieldwork, reporting, and billing, see our guide to market research project management software.

How Research Teams Can Use the Dashboard During Fieldwork

A central dashboard becomes more valuable when project managers use it throughout fieldwork, rather than only reviewing the final numbers.

At the beginning of a project, the team should confirm supplier allocations, quota targets, duplicate-check rules, and the planned sample blend.

During fieldwork, project managers can review delivery by supplier, identify quota cells that need attention, and check whether duplicate attempts or quality removals are affecting usable completes.

If a supplier falls behind, the team can compare available backfill options before changing the allocation. The decision should consider delivery speed, cost, supplier overlap, and the effect on the overall sample mix.

Before closing fieldwork, the team should reconcile accepted completes, review supplier contributions, and confirm that final quotas and billing figures agree with the project records.

This process helps research agencies make allocation decisions using shared project data instead of relying on separate reports and manual spreadsheets.

Where OnGraph Fits

OnGraph develops custom and white-label project management platforms for market research companies.

Its white-label market research platform covers areas such as traffic sourcing, respondent qualifications, quota management, survey links, security, and supplier integrations.

The company’s published platform information also describes server-to-server callbacks, hashing protocols, fraud detection capabilities, 65+ global panel integrations, and 40+ API integrations.

These capabilities are part of OnGraph’s broader market research software development services.

For agencies managing several sample suppliers, a custom platform can be designed around their existing supplier relationships, quota rules, respondent validation process, reporting needs, and project workflows.

Cross-supplier deduplication, blend monitoring, and allocation controls should be defined clearly during requirements planning. Their availability and implementation will depend on the platform configuration, integrations, and project scope.

Final Thoughts

Managing multiple sample suppliers involves more than collecting completes from different sources.

Research agencies need to understand whether respondents are being counted more than once, whether the sample blend remains consistent, and whether supplier allocation decisions are affecting cost or research quality.

Separate supplier reports cannot provide the full picture because each supplier sees only its own traffic.

A central dashboard helps research teams connect supplier delivery, deduplication, blend monitoring, quota allocation, and cost reconciliation in one place.

For agencies running complex or recurring studies, that visibility can make fieldwork easier to manage and survey results easier to interpret.