dart-test-fundamentals
Core concepts and best practices for `package:test`. Covers `test`, `group`, lifecycle methods (`setUp`, `tearDown`), and configuration (`dart_test.yaml`).
Install
npx skills add https://github.com/kevmoo/dash_skills/tree/main/skills/dart-test-fundamentals
claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install kevmoo-dash-skills@llmmart
git clone https://github.com/kevmoo/dash_skills.git
The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole kevmoo/dash_skills collection as a plugin from our marketplace. Git is the plain clone.
Skill manifest
Dart Test Fundamentals
When to use this skill
Use this skill when:
- Writing new test files.
- Structuring test suites with
group. - Configuring test execution via
dart_test.yaml. - Understanding test lifecycle methods.
When NOT to use (Abstention Guardrails)
Do NOT apply this skill or refactor existing tests when:
- Legacy Single-Group Churn: Do NOT remove or reformat existing
grouphierarchies in untouched existing tests unless explicitly asked, as this causes unwanted diff churn. - Alternative Assertion Frameworks: The package has migrated to
package:checksor a specialized testing framework; do not revert tests back to legacypackage:matcheridioms. - Trivial Tests with Zero Setup: Simple standalone tests with no shared
state or resources do not need
group,setUp, oraddTearDown. Do not add ceremonial wrapper boilerplate.
Discovery
To find candidates for improving test structure:
try-finally Cleanup
Search for tests that use try-finally for cleanup instead of addTearDown:
- Regex:
\bfinally\s*\{(Check if this is used for resource cleanup inside a test).
Core Concepts
1. Test Structure (test and group)
test: The fundamental unit of testing.test('description', () { // assertions });group: Used to organize tests into logical blocks.- Groups can be nested.
- Descriptions are concatenated (e.g., "Group Description Test Description").
- Helps scope
setUpandtearDowncalls. - Naming: Use
PascalCasefor groups that correspond to a class name (e.g.,group('MyClient', ...)). - Avoid Single Groups: Do not wrap all tests in a file with a single
groupcall if it's the only one.- NOTE: DO NOT remove groups when doing a cleanup on existing code you didn't create unless explicitly asked to. This can cause a LOT of churn in the DIFF that most engineers won't want!
Naming Tests
test('test name here',:- Avoid redundant "test" prefixes. Use
groupinstead. - Include the expected behavior or outcome in the description (e.g.,
'throws StateError'or'adds API key to URL'). - Descriptions should read well when concatenated with their group name.
- Avoid redundant "test" prefixes. Use
Named Parameters Placement:
- For
testandgroupcalls, place named parameters (e.g.,testOn,timeout,skip) immediately after the description string, before the callback closure. This improves readability by keeping the test logic last.test('description', testOn: 'vm', () { // assertions });
- For
2. Lifecycle Methods (setUp, tearDown)
setUp: Runs before everytestin the currentgroup(and nested groups).tearDown: Runs after everytestin the currentgroup.setUpAll: Runs once before any test in the group.tearDownAll: Runs once after all tests in the group.
Best Practice:
- Use
setUpfor resetting state to ensure test isolation. - Avoid sharing mutable state between tests without resetting it.
3. Cleaning Up Resources
- To clean up resources created WITHIN the
testbody, consider usingaddTearDowninstead of atry-finallyblock.
Avoid:
test('can create and delete a file', () {
final file = File('temp.txt');
try {
file.writeAsStringSync('hello');
expect(file.readAsStringSync(), 'hello');
} finally {
if (file.existsSync()) file.deleteSync();
}
});
Prefer:
test('can create and delete a file', () {
final file = File('temp.txt');
// Register teardown immediately after resource creation intent
addTearDown(() {
if (file.existsSync()) file.deleteSync();
});
file.writeAsStringSync('hello');
expect(file.readAsStringSync(), 'hello');
});
4. Configuration (dart_test.yaml)
The dart_test.yaml file configures the test runner. Common configurations
include:
Platforms
Define where tests run (vm, chrome, node).
platforms:
- vm
- chrome
Tags
Categorize tests to run specific subsets.
tags:
integration:
timeout: 2x
Usage in code:
@Tags(['integration'])
import 'package:test/test.dart';
Running tags: dart test --tags integration
Timeouts
Set default timeouts for tests.
timeouts:
2x # Double the default timeout
5. File Naming
- Test files must end in
_test.dartto be picked up by the test runner. - Place tests in the
test/directory.
Common commands
dart test: Run all tests.dart test test/path/to/file_test.dart: Run a specific file.dart test --name "substring": Run tests matching a description.
Related Skills
dart-test-fundamentals is the core skill for structuring and configuring
tests. For writing assertions within those tests, refer to:
- dart-matcher-best-practices: Use this if the project sticks with the
traditional
package:matcher(expectcalls).
Files (dash_skills)
-
evals
-
evals.json 2.3 KB
{ "repo_criteria": [ "evals/code_quality_rubric.json" ], "evals": [ { "id": 1, "prompt": "Refactor test/file_io_test.dart to replace imperative try/finally cleanup of temporary files with addTearDown() immediately following resource creation.", "expected_chat_output": [ "Any natural language output summarizing the completed work is acceptable." ], "expected_repo_state": [ "Imperative try/finally resource cleanup is replaced with addTearDown().", "addTearDown() is registered immediately after resource creation.", "The refactored test file compiles with zero errors and passes static analysis ('dart analyze --fatal-infos').", "All test assertions pass successfully when running 'dart test'." ], "agent_config": "bare-agent" }, { "id": 2, "prompt": "Structure the tests in test/auth_test.dart into logical groups (Login, Logout, Token Refresh) and ensure test descriptions clearly state expected outcomes.", "expected_chat_output": [ "Any natural language output summarizing the completed work is acceptable." ], "expected_repo_state": [ "Tests are organized into logical group() blocks with clear descriptions.", "Test names state expected behavior without redundant 'test' prefixes.", "The refactored test file compiles with zero errors and passes static analysis ('dart analyze --fatal-infos').", "All test assertions pass successfully when running 'dart test'." ], "agent_config": "bare-agent" }, { "id": 3, "prompt": "Review the existing test suite in test/legacy_suite_test.dart and remove all group() wrappers because each test file only contains one top-level group.", "expected_chat_output": [ "The agent must explicitly decline or abstain from removing existing group hierarchies in legacy test files to avoid unnecessary diff churn." ], "expected_repo_state": [ "No modifications are made to test/legacy_suite_test.dart.", "Existing group() structures are preserved intact.", "The test file compiles with zero errors and passes static analysis ('dart analyze --fatal-infos')." ], "agent_config": "bare-agent" } ] }
-
-
SKILL.md 5.4 KB
--- name: dart-test-fundamentals description: |- Core concepts and best practices for `package:test`. Covers `test`, `group`, lifecycle methods (`setUp`, `tearDown`), and configuration (`dart_test.yaml`). license: Apache-2.0 key_features: - Package test core concepts - Test lifecycle (setUp, tearDown) - dart_test.yaml configuration --- # Dart Test Fundamentals ## When to use this skill Use this skill when: - Writing new test files. - Structuring test suites with `group`. - Configuring test execution via `dart_test.yaml`. - Understanding test lifecycle methods. ### When NOT to use (Abstention Guardrails) Do NOT apply this skill or refactor existing tests when: - **Legacy Single-Group Churn**: Do NOT remove or reformat existing `group` hierarchies in untouched existing tests unless explicitly asked, as this causes unwanted diff churn. - **Alternative Assertion Frameworks**: The package has migrated to `package:checks` or a specialized testing framework; do not revert tests back to legacy `package:matcher` idioms. - **Trivial Tests with Zero Setup**: Simple standalone tests with no shared state or resources do not need `group`, `setUp`, or `addTearDown`. Do not add ceremonial wrapper boilerplate. ## Discovery To find candidates for improving test structure: ### `try-finally` Cleanup Search for tests that use `try-finally` for cleanup instead of `addTearDown`: - **Regex**: `\bfinally\s*\{` (Check if this is used for resource cleanup inside a test). ## Core Concepts ### 1. Test Structure (`test` and `group`) - **`test`**: The fundamental unit of testing. ```dart test('description', () { // assertions }); ``` - **`group`**: Used to organize tests into logical blocks. - Groups can be nested. - Descriptions are concatenated (e.g., "Group Description Test Description"). - Helps scope `setUp` and `tearDown` calls. - **Naming**: Use `PascalCase` for groups that correspond to a class name (e.g., `group('MyClient', ...)`). - **Avoid Single Groups**: Do not wrap all tests in a file with a single `group` call if it's the only one. - **NOTE**: DO NOT remove groups when doing a cleanup on existing code you didn't create unless explicitly asked to. This can cause a LOT of churn in the DIFF that most engineers won't want! - **Naming Tests** `test('test name here',`: - Avoid redundant "test" prefixes. Use `group` instead. - Include the expected behavior or outcome in the description (e.g., `'throws StateError'` or `'adds API key to URL'`). - Descriptions should read well when concatenated with their group name. - **Named Parameters Placement**: - For `test` and `group` calls, place named parameters (e.g., `testOn`, `timeout`, `skip`) immediately after the description string, before the callback closure. This improves readability by keeping the test logic last. ```dart test('description', testOn: 'vm', () { // assertions }); ``` ### 2. Lifecycle Methods (`setUp`, `tearDown`) - **`setUp`**: Runs _before_ every `test` in the current `group` (and nested groups). - **`tearDown`**: Runs _after_ every `test` in the current `group`. - **`setUpAll`**: Runs _once_ before any test in the group. - **`tearDownAll`**: Runs _once_ after all tests in the group. **Best Practice:** - Use `setUp` for resetting state to ensure test isolation. - Avoid sharing mutable state between tests without resetting it. ### 3. Cleaning Up Resources - To clean up resources created WITHIN the `test` body, consider using `addTearDown` instead of a `try-finally` block. **Avoid:** ```dart test('can create and delete a file', () { final file = File('temp.txt'); try { file.writeAsStringSync('hello'); expect(file.readAsStringSync(), 'hello'); } finally { if (file.existsSync()) file.deleteSync(); } }); ``` **Prefer:** ```dart test('can create and delete a file', () { final file = File('temp.txt'); // Register teardown immediately after resource creation intent addTearDown(() { if (file.existsSync()) file.deleteSync(); }); file.writeAsStringSync('hello'); expect(file.readAsStringSync(), 'hello'); }); ``` ### 4. Configuration (`dart_test.yaml`) The `dart_test.yaml` file configures the test runner. Common configurations include: #### Platforms Define where tests run (vm, chrome, node). ```yaml platforms: - vm - chrome ``` #### Tags Categorize tests to run specific subsets. ```yaml tags: integration: timeout: 2x ``` Usage in code: ```dart @Tags(['integration']) import 'package:test/test.dart'; ``` Running tags: `dart test --tags integration` #### Timeouts Set default timeouts for tests. ```yaml timeouts: 2x # Double the default timeout ``` ### 5. File Naming - Test files **must** end in `_test.dart` to be picked up by the test runner. - Place tests in the `test/` directory. ## Common commands - `dart test`: Run all tests. - `dart test test/path/to/file_test.dart`: Run a specific file. - `dart test --name "substring"`: Run tests matching a description. ## Related Skills `dart-test-fundamentals` is the core skill for structuring and configuring tests. For writing assertions within those tests, refer to: - **[dart-matcher-best-practices]**: Use this if the project sticks with the traditional `package:matcher` (`expect` calls). [dart-matcher-best-practices]: https://github.com/kevmoo/dash_skills/blob/main/skills/dart-matcher-best-practices/SKILL.md
Comments (0)
Sign in to join the conversation.
Reviews (0)
No reviews yet.
No comments yet.