Sample questions
Pf Environment Fidelity Test DesignDifficulty 1
Why can a load test that passes on a staging environment still fail to predict production behavior accurately?
- aBecause staging environments always use a newer version of the application code than production
- bBecause load testing tools cannot generate enough virtual users to matter for staging
- cBecause differences in data volume, infra scale, or network topology can make the results invalid✓
- dBecause staging environments are legally required to have unlimited resources
Explanation:Environment fidelity means how closely a test environment mirrors production. If staging has smaller data sets, fewer server instances, or a different network path than production, the observed latency/throughput numbers may not transfer to prod, even if the test itself passed cleanly.
Pf Environment Fidelity Test DesignDifficulty 1
A performance test is run against a database table containing only 500 rows, while the production table has 50 million rows. What is the main risk of this setup?
- aThe test results will be identical either way, because row count never affects query planning or performance in any database engine
- bQuery plans and index behavior can differ sharply at small scale, so results won't reflect production✓
- cThe database will refuse to run queries on tables smaller than the production size
- dSmall tables always cause artificially high latency compared to large tables
Explanation:With only 500 rows, the query optimizer may choose a full scan that is fast regardless of missing indexes, or an index that would behave differently under 50M rows (e.g. more page reads, different join strategy). Data volume fidelity is critical for realistic performance results.
Pf Environment Fidelity Test DesignDifficulty 1
What does 'environment fidelity' mean in the context of performance test design?
- aHow well the test script covers all functional user flows of the application
- bHow many virtual users a load testing tool can simulate simultaneously
- cWhether the test environment happens to have the exact same source code branch deployed as the current production release
- dHow closely the test environment matches production in terms of scale, data, topology, and configuration✓
Explanation:Environment fidelity specifically refers to how representative the test environment is of production characteristics (hardware scale, data volume, network topology, caching layers, configuration) — not code coverage or code branch matching.
Pf Environment Fidelity Test DesignDifficulty 2
A team runs its load test against a single-node test environment, while production runs behind a load balancer with 6 application nodes. What is the most likely consequence?
- aThe single node may bottleneck at a much lower load than production could handle, underestimating capacity✓
- bThe results will be exactly the same because load balancers do not affect throughput
- cThe single-node test will always show higher throughput than the 6-node production setup
- dLoad balancers only affect security, not performance testing accuracy
Explanation:A single node has a fraction of the aggregate CPU/memory/connection capacity of a 6-node cluster, so it will saturate and show degraded latency/errors at a load level production could handle comfortably — underestimating real capacity.
Pf Environment Fidelity Test DesignDifficulty 2
Why does a CDN (Content Delivery Network) in front of production complicate performance test design?
- aCDNs always slow down every single request regardless of caching state, so performance tests should simply ignore them entirely
- bThe test may hit CDN cache hits, measuring edge cache latency instead of real origin/backend performance✓
- cCDNs make it impossible to run any kind of load test against production-like environments
- dCDNs only affect DNS resolution time and have no impact on measured response times
Explanation:When requests are served from CDN edge caches, the load test measures the CDN's cache-hit latency, not the origin server's real processing time. To test backend/origin performance, the test design must account for cache bypass or target the origin directly.
Pf Environment Fidelity Test DesignDifficulty 1
What is a 'performance regression baseline' in the context of integrating performance tests into CI/CD?
- aThe minimum number of virtual users required for a test to be considered valid
- bA list of all functional test cases that must pass before a performance test can run
- cA previously recorded set of performance metrics used as a reference point to detect measurable regressions in new builds✓
- dThe default configuration file used by the load testing tool when no options are specified
Explanation:A baseline is a stored reference of prior performance metrics. New test runs are compared against it to detect regressions (e.g. p95 latency increased by 20%) automatically as part of the CI/CD pipeline, rather than relying on manual judgment each time.