1
0
Fork 0
mirror of https://github.com/denoland/deno.git synced 2024-12-27 01:29:14 -05:00
denoland-deno/tests/specs
Nathan Whitaker ab67b4c645
fix(coverage): Error if no files are included in the report (#22952)
Fixes #22941.

In that case, the only file with coverage was the `test.ts` file. The
coverage reporter filters out test files before compiling its report, so
after filtering we were left with an empty set of files. Later on it's
assumed that there is at least 1 file to be reported on, and we panic.
Instead of panicking, just issue an error after filtering.
2024-03-15 20:58:57 -07:00
..
check/types_resolved_relative_config chore(specs): use jsonc for metadata file (#22946) 2024-03-15 17:27:52 +00:00
coverage fix(coverage): Error if no files are included in the report (#22952) 2024-03-15 20:58:57 -07:00
flags chore: move more tests away from itest (#22909) 2024-03-15 15:46:51 -04:00
import_map/import_map_config chore(specs): use jsonc for metadata file (#22946) 2024-03-15 17:27:52 +00:00
info/ts_error chore(specs): use jsonc for metadata file (#22946) 2024-03-15 17:27:52 +00:00
jsr chore: move more tests away from itest (#22909) 2024-03-15 15:46:51 -04:00
jupyter/install_command_not_exists chore: move more tests away from itest (#22909) 2024-03-15 15:46:51 -04:00
npm chore(specs): use jsonc for metadata file (#22946) 2024-03-15 17:27:52 +00:00
run/redirect_javascript chore(specs): use jsonc for metadata file (#22946) 2024-03-15 17:27:52 +00:00
test chore(specs): use jsonc for metadata file (#22946) 2024-03-15 17:27:52 +00:00
mod.rs chore: move more tests away from itest (#22909) 2024-03-15 15:46:51 -04:00
README.md chore(lsp): add tests for compiler options being resolved relative the config file (#22924) 2024-03-15 14:27:43 +00:00

specs

These are integration tests that execute the deno binary. They supersede the itest macro found in the tests/integration folder and are the preferred way of writing tests that use the deno binary.

Structure

Tests must have the following directory structure:

tests/specs/<category_name>/<test_name>/__test__.json

Test filtering

To run a specific test, run:

cargo test specs::category_name::test_name

Or just the following, though it might run other tests:

cargo test test_name

__test__.json file

This file describes the test to execute and the steps to execute. A basic example looks like:

{
  "args": "run main.js",
  "output": "main.out"
}

This will run deno run main.js then assert that the output matches the text in main.out.

Or another example that runs multiple steps:

{
  "tempDir": true,
  "steps": [{
    "args": "cache main.ts",
    "output": "cache.out"
  }, {
    "args": "run main.ts",
    "output": "error.out",
    "exitCode": 1
  }]
}

Top level properties

  • base - The base config to use for the test. Options:
    • jsr - Uses env vars for jsr.
    • npm - Uses env vars for npm.
  • tempDir (boolean) - Copy all the non-test files to a temporary directory and execute the command in that temporary directory.
    • By default, tests are executed with a current working directory of the test, but this may not be desirable for tests such as ones that create a node_modules directory.

Step properties

When writing a single step, these may be at the top level rather than nested in a "steps" array.

  • args - A string (that will be spilt on whitespace into an args array) or an array of arguments.
  • output - Path to use to assert the output.
  • clean (boolean) - Whether to empty the deno_dir before running the step.
  • exitCode (number) - Expected exit code.

.out files

.out files are used to assert the output when running a test or test step.

Within the file, you can use the following for matching:

  • [WILDCARD] - match any text at the wildcard
  • [WILDLINE] - match any text on the current line
  • [WILDCHARS(5)] - match any of the next 5 characters
  • [UNORDERED_START] followed by many lines then [UNORDERED_END] will match the lines in any order (useful for non-deterministic output)
  • [# example] - line comments start with [# and end with ]