1
0
Fork 0
mirror of https://github.com/denoland/deno.git synced 2024-12-11 10:07:54 -05:00
denoland-deno/tests/specs
João Baptista 0a104c2630
fix(fmt): return None if sql fmt result is the same (#27014)
Similar with https://github.com/denoland/deno/pull/25848, we need to
make `format_sql` to return `None` so we do not flag well formatted sql
files as being wrong.

Signed-off-by: m4rc3l05 <15786310+M4RC3L05@users.noreply.github.com>
2024-11-28 15:47:22 +01:00
..
add fix(add): better error message when adding package that only has pre-release versions (#26724) 2024-11-05 02:45:00 +00:00
bench fix(npm): ensure scoped package name is encoded in URLs (#26390) 2024-10-18 20:38:57 +02:00
bundle/removed BREAKING: remove deno bundle (#25339) 2024-09-02 17:27:37 +02:00
cache fix(npm): ensure scoped package name is encoded in URLs (#26390) 2024-10-18 20:38:57 +02:00
cert feat: add --allow-import flag (#25469) 2024-09-26 01:50:54 +00:00
check feat: Wasm module support (#26668) 2024-11-19 18:59:23 -05:00
clean/general feat(clean): add progress bar (#25026) 2024-08-14 13:04:07 +02:00
cli feat(runtime): remove public OTEL trace API (#26854) 2024-11-18 23:55:22 +00:00
compile fix(compile): correct buffered reading of assets and files (#27008) 2024-11-28 15:47:22 +01:00
coverage fix(coverage): ignore urls from doc testing (#25736) 2024-09-20 15:04:22 +09:00
doc chore: update url + idna (#26963) 2024-11-21 12:13:16 -05:00
eval feat(node): stabilize detecting if CJS via "type": "commonjs" in a package.json (#26439) 2024-11-13 15:10:09 +00:00
flags feat: add lowercase -v version flag (#23750) 2024-05-23 00:20:20 +00:00
fmt fix(fmt): return None if sql fmt result is the same (#27014) 2024-11-28 15:47:22 +01:00
future chore: upgrade to rust 1.82 and LLVM 19 (#26615) 2024-11-01 16:13:02 +05:30
import_map/import_map_config refactor: move importMap with imports/scopes diagnostic to deno_config (#24553) 2024-07-12 12:48:53 -04:00
info feat(info): show location for Web Cache (#26205) 2024-11-20 01:04:48 +00:00
init feat(init): add --npm flag to initialize npm projects (#26896) 2024-11-21 00:03:11 +00:00
install feat(node): stabilize detecting if CJS via "type": "commonjs" in a package.json (#26439) 2024-11-13 15:10:09 +00:00
jsr feat(lsp): quick fix for @deno-types="npm:@types/*" (#25954) 2024-10-01 22:55:02 +01:00
jupyter/install_command refactor(jupyter): use runtimelib for Jupyter structures and directory paths (#23826) 2024-05-21 22:35:21 +02:00
lint feat(lint): Add checked files list to the JSON output(#26936) 2024-11-20 20:59:43 +01:00
lockfile fix(lockfile): track dependencies specified in TypeScript compiler options (#26551) 2024-11-20 00:49:19 +00:00
node fix(ext/node): resolve exports even if parent module filename isn't present (#26553) 2024-10-31 10:02:31 -07:00
npm fix(node): regression where ts files were sometimes resolved instead of js (#26971) 2024-11-21 12:13:17 -05:00
permission feat(permission): support suffix wildcards in --allow-env flag (#25255) 2024-11-20 23:30:43 +00:00
publish fix(publish): improve error message when missing exports (#26945) 2024-11-20 01:14:49 +00:00
remove fix(install): better json editing (#26450) 2024-10-21 14:17:08 -04:00
repl/console_log fix(console/ext/repl): support using parseFloat() (#25900) 2024-10-14 15:04:18 -07:00
run chore(check): add test for Wasm memory and table (#26996) 2024-11-28 15:47:22 +01:00
serve feat(serve): Support second parameter in deno serve (#25606) 2024-09-12 23:32:28 +00:00
task fix(task): ensure root config always looks up dependencies in root (#26959) 2024-11-21 12:13:16 -05:00
test fix(cli): preserve comments in doc tests (#26828) 2024-11-13 21:04:32 -08:00
update feat: subcommand to view and update outdated dependencies (#26942) 2024-11-20 15:22:15 -08:00
upgrade Revert "perf(upgrade): cache downloaded binaries in DENO_DIR" (#26799) 2024-11-10 09:00:44 +05:30
vendor/removed BREAKING: remove deno vendor (#25343) 2024-09-03 17:00:57 +10:00
worker feat: add --allow-import flag (#25469) 2024-09-26 01:50:54 +00:00
workspaces fix: remove recently added deno.json node_modules aliasing (#25542) 2024-09-09 20:19:29 +00:00
mod.rs feat(node): stabilize detecting if CJS via "type": "commonjs" in a package.json (#26439) 2024-11-13 15:10:09 +00:00
README.md chore: support -- --nocapture in the spec tests (#24113) 2024-06-06 08:37:13 -04:00
schema.json feat(node): stabilize detecting if CJS via "type": "commonjs" in a package.json (#26439) 2024-11-13 15:10:09 +00:00

specs

These are integration tests that execute the deno binary. They supersede the itest macro found in the tests/integration folder and are the preferred way of writing tests that use the deno binary.

Structure

Tests must have the following directory structure:

tests/specs/<category_name>/<test_name>/__test__.json

Test filtering

To run a specific test, run:

cargo test specs::category_name::test_name

Or just the following, though it might run other tests:

cargo test test_name

To run showing the output of every test use -- --nocapture (note: this will cause tests to run sequentially instead of in parallel):

cargo test test_name -- --nocapture

__test__.json file

This file describes the test(s) to execute and the steps to execute. A basic example looks like:

{
  "args": "run main.js",
  "output": "main.out"
}

This will run deno run main.js then assert that the output matches the text in main.out.

Or another example that runs multiple steps:

{
  "tempDir": true,
  "steps": [{
    "args": "cache main.ts",
    "output": "cache.out"
  }, {
    "args": "run main.ts",
    "output": "error.out",
    "exitCode": 1
  }]
}

Or if you want to run several tests at the same time:

{
  "tests": {
    "ignore_dir": {
      "args": "run script.ts",
      "output": "script.out"
    },
    "some_other_test": {
      "args": "run other.ts",
      "output": "other.out"
    }
  }
}

Top level properties

  • repeat (number) - Number of times to repeat a test.
  • tempDir (boolean) - Copy all the non-test files to a temporary directory and execute the command in that temporary directory.
    • By default, tests are executed with a current working directory of the test, but this may not be desirable for tests such as ones that create a node_modules directory.

Step properties

When writing a single step, these may be at the top level rather than nested in a "steps" array or "tests" object.

  • args - A string (that will be spilt on whitespace into an args array) or an array of arguments.
  • output - Path to use to assert the output or text (must end with an .out extension) or text to pattern match against the output.
  • flaky - Step should be repeated until success a maximum of 3 times.
  • if ("windows", "linux", "mac", "unix") - Whether to run this step.
  • exitCode (number) - Expected exit code.

Auto-complete

To get auto-complete for these files, add the following to a local .vscode/settings.json file:

{
  "json.schemas": [{
    "fileMatch": [
      "__test__.jsonc"
    ],
    "url": "./tests/specs/schema.json"
  }]
}

.out files

.out files are used to assert the output when running a test or test step.

Within the file, you can use the following for matching:

  • [WILDCARD] - match any text at the wildcard
  • [WILDLINE] - match any text on the current line
  • [WILDCHAR] - match the next character
  • [WILDCHARS(5)] - match any of the next 5 characters
  • [UNORDERED_START] followed by many lines then [UNORDERED_END] will match the lines in any order (useful for non-deterministic output)
  • [# example] - line comments start with [# and end with ]