test-automator▌
charon-fan/agent-playbook · updated Apr 8, 2026
Expert in creating and maintaining automated tests for various frameworks and languages.
Test Automator
Expert in creating and maintaining automated tests for various frameworks and languages.
When This Skill Activates
Activates when you:
- Ask to write tests
- Mention test automation
- Request test coverage improvement
- Need to set up testing framework
Testing Pyramid
/\
/E2E\ - Few, expensive, slow
/------\
/ Integration \ - Moderate number
/--------------\
/ Unit Tests \ - Many, cheap, fast
/------------------\
Unit Testing
Principles
- Test behavior, not implementation
- One assertion per test (generally)
- Arrange-Act-Assert pattern
- Descriptive test names
Example (Jest)
describe('UserService', () => {
describe('createUser', () => {
it('should create a user with valid data', async () => {
// Arrange
const userData = {
name: 'John Doe',
email: 'john@example.com'
};
// Act
const user = await userService.create(userData);
// Assert
expect(user.id).toBeDefined();
expect(user.email).toBe(userData.email);
});
it('should throw error for invalid email', async () => {
// Arrange
const userData = { email: 'invalid' };
// Act & Assert
await expect(userService.create(userData))
.rejects.toThrow('Invalid email');
});
});
});
Integration Testing
Principles
- Test component interactions
- Use test doubles for external services
- Clean up test data
- Run in isolation
Example (Supertest)
describe('POST /api/users', () => {
it('should create a user', async () => {
const response = await request(app)
.post('/api/users')
.send({
name: 'John Doe',
email: 'john@example.com'
})
.expect(201)
.expect((res) => {
expect(res.body.id).toBeDefined();
expect(res.body.email).toBe('john@example.com');
});
});
});
E2E Testing
Principles
- Test critical user flows
- Use realistic test data
- Handle async operations properly
- Clean up after tests
Example (Playwright)
test('user can login', async ({ page }) => {
await page.goto('/login');
await page.fill('[name="email"]', 'user@example.com');
await page.fill('[name="password"]', 'password123');
await page.click('button[type="submit"]');
await expect(page).toHaveURL('/dashboard');
await expect(page.locator('h1')).toContainText('Welcome');
});
Test Coverage
Coverage Goals
| Type | Target |
|---|---|
| Lines | > 80% |
| Branches | > 75% |
| Functions | > 80% |
| Statements | > 80% |
Coverage Reports
# Jest
npm test -- --coverage
# Python (pytest-cov)
pytest --cov=src --cov-report=html
# Go
go test -coverprofile=coverage.out
go tool cover -html=coverage.out
Testing Best Practices
DO's
- Write tests before fixing bugs (TDD)
- Test edge cases
- Keep tests independent
- Use descriptive test names
- Mock external dependencies
- Clean up test data
DON'Ts
- Don't test implementation details
- Don't write brittle tests
- Don't skip tests without a reason
- Don't commit commented-out tests
- Don't test third-party libraries
Test Naming Conventions
// Good: Describes what is being tested
it('should reject invalid email addresses')
// Good: Describes the scenario and outcome
it('returns 401 when user provides invalid credentials')
// Bad: Vague
it('works correctly')
Common Testing Frameworks
| Language | Framework | Command |
|---|---|---|
| TypeScript/JS | Jest, Vitest | npm test |
| Python | pytest | pytest |
| Go | testing | go test |
| Java | JUnit | mvn test |
| Rust | built-in | cargo test |
Scripts
Generate test boilerplate:
python scripts/generate_test.py <filename>
Check test coverage:
python scripts/coverage_report.py
References
references/best-practices.md- Testing best practicesreferences/examples/- Framework-specific examplesreferences/mocking.md- Mocking guidelines
Discussion
Product Hunt–style comments (not star reviews)- No comments yet — start the thread.
Ratings
4.6★★★★★63 reviews- ★★★★★Nia Huang· Dec 28, 2024
Keeps context tight: test-automator is the kind of skill you can hand to a new teammate without a long onboarding doc.
- ★★★★★William Martin· Dec 20, 2024
I recommend test-automator for anyone iterating fast on agent tooling; clear intent and a small, reviewable surface area.
- ★★★★★Ganesh Mohane· Dec 16, 2024
test-automator reduced setup friction for our internal harness; good balance of opinion and flexibility.
- ★★★★★Sakura Park· Dec 8, 2024
Useful defaults in test-automator — fewer surprises than typical one-off scripts, and it plays nicely with `npx skills` flows.
- ★★★★★Dev Johnson· Dec 4, 2024
test-automator reduced setup friction for our internal harness; good balance of opinion and flexibility.
- ★★★★★Nia Kim· Nov 27, 2024
Registry listing for test-automator matched our evaluation — installs cleanly and behaves as described in the markdown.
- ★★★★★Luis Mensah· Nov 23, 2024
I recommend test-automator for anyone iterating fast on agent tooling; clear intent and a small, reviewable surface area.
- ★★★★★Ren Haddad· Nov 19, 2024
test-automator has been reliable in day-to-day use. Documentation quality is above average for community skills.
- ★★★★★Yash Thakker· Nov 15, 2024
We added test-automator from the explainx registry; install was straightforward and the SKILL.md answered most questions upfront.
- ★★★★★William Yang· Nov 11, 2024
test-automator reduced setup friction for our internal harness; good balance of opinion and flexibility.
showing 1-10 of 63