Q&ATrending
How do you write meaningful performance assertions in your load tests?Most load test examples I see just report numbers (p95, p99, RPS) without failing the test definitively. I want our…
1.2k viewsBe the first to answer
109 discussions
Q&ATrending
How do you onboard new team members to a large legacy test suite?We have a 1,200-test suite built over 4 years. Good test coverage, but: - No documentation of test strategy or…
1.2k viewsBe the first to answer
Q&ATrending
Do you practice mutation testing and does it actually improve your test suite?Mutation testing (mutmut for Python, Stryker for JS) sounds powerful in theory: introduce small code changes and verify…
1.1k viewsBe the first to answer
Q&ATrending
How do you properly clean up database state between pytest tests without killing speed?Our API test suite uses a real PostgreSQL database (Docker, spun up in CI). Each test creates data and we need…
1.1k viewsBe the first to answer
Q&ATrending
Best approach for secrets management for test credentials in CI?We have test credentials (API keys for sandbox environments, DB passwords, OAuth tokens) that need to be available in…
1.1k viewsBe the first to answer
Q&ATrending
How do you validate AI-generated test code before committing it?I've started using AI to generate first-pass test code. The problem: I've caught several subtle bugs in AI-generated…
1.1k viewsBe the first to answer
Q&ATrending
What is the most effective approach to testing GraphQL APIs?REST API testing feels natural with pytest + requests, but I'm not sure how to apply the same discipline to GraphQL.…
1.1k viewsBe the first to answer
Q&ATrending
Is Selenium Grid 4 still worth self-hosting or should we just use cloud providers?We're running Selenium Grid 3 on 6 VMs and it's a maintenance headache — node crashes, session leaks, version…
1.0k viewsBe the first to answer
Q&ATrending
Is there a practical upper limit on how long a single automated test should run?We have a handful of E2E tests that take 4–6 minutes each. They cover complex user journeys (onboarding flow,…
1.0k viewsBe the first to answer
Q&ATrending
JSON schema validation — jsonschema vs pydantic vs just asserting against the OpenAPI spec?I need to validate API response structures in pytest tests. Three paths I see: 1. jsonschema — explicit, dict-based…
976 viewsBe the first to answer
Q&ATrending
Managing test data in pytest — factory pattern, fixtures, or external files?As our API test suite grows I'm realising ad-hoc test data in each test function is a maintenance nightmare. Three…
964 viewsBe the first to answer
Q&ATrending
Database testing strategies when your team does not own the database schema?We're an SDET team testing a service that uses a database we don't own — the schema is managed by a platform team and…
962 viewsBe the first to answer
Q&ATrending
How do you handle timezone-related test failures in a distributed team?We have engineers in India, UK, and US. Our tests occasionally fail due to timezone-dependent logic: - Date range…
939 viewsBe the first to answer
DiscussionTrending
AI-assisted test generation — real productivity boost or just hype?Over the past few months I've been experimenting with Claude and GitHub Copilot for test case generation at work. Mixed…
924 views
Q&ATrending
What test metrics do you actually report from CI to Slack or Teams?We want to add test result notifications to our Slack channel after each CI run. Before I build this out I want to know…
919 viewsBe the first to answer
Q&ATrending
pytest-xdist vs pytest-parallel — which is more reliable for parallel test execution?We need to parallelise a 600-test pytest suite. Current serial runtime is ~22 minutes, target is under 8 minutes. I've…
914 viewsBe the first to answer
Q&ATrending
Headless vs headed browser testing — when do you run headed locally?Most people run headed during development and headless in CI. But I'm curious about the exceptions: - When do you run…
905 viewsBe the first to answer
Q&ATrending
When should you use Playwright component testing vs full E2E tests?Playwright now supports component testing (React/Vue/Svelte) which blurs the line with E2E tests. In practice I'm…
900 viewsBe the first to answer
Q&ATrending
Using LLMs to detect flaky test patterns — any practical experience?I had an idea: take our flaky test history (test name, failure messages, stack traces, timestamps) and feed it to an…
896 viewsBe the first to answer
Q&ATrending
How do you handle API rate limiting in automated test suites?Our test suite hits a third-party API (Stripe sandbox) and we occasionally get 429s in CI, causing random test…
878 viewsBe the first to answer