1
0
Fork 0
mirror of https://github.com/denoland/deno.git synced 2024-12-22 23:34:47 -05:00
denoland-deno/website/manual.md

1103 lines
31 KiB
Markdown
Raw Normal View History

2019-02-11 17:41:13 -05:00
# Deno Manual
[toc]
## Disclaimer
A word of caution: Deno is very much under development. We encourage brave early
adopters, but expect bugs large and small. The API is subject to change without
2019-02-12 23:54:08 -05:00
notice. [Bug reports](https://github.com/denoland/deno/issues) do help!
2019-02-11 17:41:13 -05:00
## Introduction
2019-03-05 00:01:32 -05:00
A secure JavaScript/TypeScript runtime built with V8, Rust, and Tokio
2019-02-11 17:41:13 -05:00
### Philosophy
2019-02-12 23:54:08 -05:00
Deno aims to be a productive and secure scripting environment for the modern
programmer.
2019-02-11 17:41:13 -05:00
It will always be distributed as a single executable - and that executable will
be sufficient software to run any deno program. Given a URL to a deno program,
2019-02-12 23:54:08 -05:00
you should be able to execute it with nothing more than the 50 megabyte deno
executable.
2019-02-11 17:41:13 -05:00
Deno explicitly takes on the role of both runtime and package manager. It uses a
standard browser-compatible protocol for loading modules: URLs.
Deno provides security guarantees about how programs can access your system with
the default being the most restrictive secure sandbox.
Deno provides <a href="https://github.com/denoland/deno_std">a set of reviewed
(audited) standard modules</a> that are guaranteed to work with Deno.
2019-02-12 23:54:08 -05:00
### Goals
2019-02-11 17:41:13 -05:00
- Support TypeScript out of the box.
- Like the browser, allows imports from URLs:
2019-03-11 23:39:46 -04:00
```ts
import * as log from "https://deno.land/std/log/mod.ts";
2019-02-11 17:41:13 -05:00
```
- Remote code is fetched and cached on first execution, and never updated until
the code is run with the `--reload` flag. (So, this will still work on an
airplane. See `~/.deno/src` for details on the cache.)
- Uses "ES Modules" and does not support `require()`.
- File system and network access can be controlled in order to run sandboxed
code. Access between V8 (unprivileged) and Rust (privileged) is only done via
serialized messages defined in this
2019-04-04 09:35:52 -04:00
[flatbuffer](https://github.com/denoland/deno/blob/master/cli/msg.fbs). This
2019-02-11 17:41:13 -05:00
makes it easy to audit. For example, to enable write access use the flag
`--allow-write` or for network access `--allow-net`.
- Only ship a single executable.
- Always dies on uncaught errors.
2019-02-12 23:54:08 -05:00
- Browser compatible: The subset of Deno programs which are written completely
in JavaScript and do not use the global `Deno` namespace (or feature test for
it), ought to also be able to be run in a modern web browser without change.
2019-02-11 17:41:13 -05:00
- [Aims to support top-level `await`.](https://github.com/denoland/deno/issues/471)
2019-03-27 02:26:03 -04:00
- Be able to serve HTTP efficiently.
2019-03-05 00:01:32 -05:00
([Currently it is relatively slow.](https://deno.land/benchmarks.html#req-per-sec))
2019-04-06 18:13:06 -04:00
- Provide useful tooling out of the box:
- command-line debugger
[not yet](https://github.com/denoland/deno/issues/1120)
- linter [not yet](https://github.com/denoland/deno/issues/1880)
- dependency inspector (`deno info`)
- code formatter (`deno fmt`),
2019-03-05 00:01:32 -05:00
2019-02-12 23:54:08 -05:00
### Non-goals
- No `package.json`.
- No npm.
2019-02-11 17:41:13 -05:00
2019-02-12 23:54:08 -05:00
- Not explicitly compatible with Node.
2019-02-11 17:41:13 -05:00
## Setup
### Binary Install
Deno works on OSX, Linux, and Windows. Deno is a single binary executable. It
has no external dependencies.
[deno_install](https://github.com/denoland/deno_install) provides convenience
scripts to download and install the binary.
Using Shell:
2019-06-27 11:30:59 -04:00
```shell
curl -fsSL https://deno.land/x/install/install.sh | sh
2019-02-11 17:41:13 -05:00
```
2019-04-01 20:38:03 -04:00
Using PowerShell:
2019-02-11 17:41:13 -05:00
2019-06-27 11:30:59 -04:00
```powershell
iwr https://deno.land/x/install/install.ps1 | iex
2019-02-11 17:41:13 -05:00
```
2019-04-01 20:38:03 -04:00
Using [Scoop](https://scoop.sh/) (windows):
2019-06-27 11:30:59 -04:00
```shell
2019-04-01 20:38:03 -04:00
scoop install deno
```
Using [Homebrew](https://brew.sh/) (mac):
2019-06-27 11:30:59 -04:00
```shell
brew install deno
```
2019-02-11 17:41:13 -05:00
Deno can also be installed manually, by downloading a tarball or zip file at
[github.com/denoland/deno/releases](https://github.com/denoland/deno/releases).
These packages contain just a single executable file. You will have to set the
executable bit on Mac and Linux.
2019-03-11 23:39:46 -04:00
Once it's installed and in your `$PATH`, try it:
2019-02-11 17:41:13 -05:00
2019-06-27 11:30:59 -04:00
```shell
deno run https://deno.land/welcome.ts
2019-02-11 17:41:13 -05:00
```
### Build from source
Clone on Linux or Mac:
2019-06-05 09:21:08 -04:00
```bash
2019-02-11 17:41:13 -05:00
git clone --recurse-submodules https://github.com/denoland/deno.git
2019-06-05 09:21:08 -04:00
```
On Windows, a couple extra steps are required to clone because we use symlinks
in the repository. First
[enable "Developer Mode"](https://www.google.com/search?q=windows+enable+developer+mode)
(otherwise symlinks would require administrator privileges). Then you must set
`core.symlinks=true` before the checkout is started.
2019-06-05 09:21:08 -04:00
```bash
git config --global core.symlinks=true
git clone --recurse-submodules https://github.com/denoland/deno.git
2019-06-05 09:21:08 -04:00
```
Now we can start the build:
2019-06-05 09:21:08 -04:00
```bash
2019-02-11 17:41:13 -05:00
cd deno
./tools/setup.py
# You may need to ensure that sccache is running.
# (TODO it's unclear if this is necessary or not.)
# prebuilt/mac/sccache --start-server
# Build.
./tools/build.py
# Run.
./target/debug/deno run tests/002_hello.ts
2019-02-11 17:41:13 -05:00
# Test.
./tools/test.py
# Format code.
./tools/format.py
2019-02-11 17:41:13 -05:00
```
#### Prerequisites
To ensure reproducible builds, deno has most of its dependencies in a git
submodule. However, you need to install separately:
2019-05-02 23:44:28 -04:00
1. [Rust](https://www.rust-lang.org/en-US/install.html) >= 1.34.1
2019-02-11 17:41:13 -05:00
2. [Node](https://nodejs.org/)
3. Python 2.
[Not 3](https://github.com/denoland/deno/issues/464#issuecomment-411795578).
Extra steps for Mac users: install [XCode](https://developer.apple.com/xcode/)
:(
2019-02-11 17:41:13 -05:00
Extra steps for Windows users:
1. Add `python.exe` to `PATH` (e.g. `set PATH=%PATH%;C:\Python27\python.exe`)
2. Get [VS Community 2017](https://www.visualstudio.com/downloads/) with
2019-03-11 23:39:46 -04:00
"Desktop development with C++" toolkit and make sure to select the following
2019-02-11 17:41:13 -05:00
required tools listed below along with all C++ tools.
- Windows 10 SDK >= 10.0.17134
- Visual C++ ATL for x86 and x64
- Visual C++ MFC for x86 and x64
- C++ profiling tools
2019-03-11 23:39:46 -04:00
3. Enable "Debugging Tools for Windows". Go to "Control Panel" → "Programs" →
"Programs and Features" → Select "Windows Software Development Kit - Windows
10" → "Change" → "Change" → Check "Debugging Tools For Windows" → "Change" ->
"Finish".
4. Make sure you are using git version 2.19.2.windows.1 or newer.
2019-02-11 17:41:13 -05:00
#### Other useful commands
```bash
2019-02-11 17:41:13 -05:00
# Call ninja manually.
./third_party/depot_tools/ninja -C target/debug
# Build a release binary.
./tools/build.py --release deno
2019-02-11 17:41:13 -05:00
# List executable targets.
./third_party/depot_tools/gn ls target/debug //:* --as=output --type=executable
# List build configuration.
./third_party/depot_tools/gn args target/debug/ --list
# Edit build configuration.
./third_party/depot_tools/gn args target/debug/
# Describe a target.
./third_party/depot_tools/gn desc target/debug/ :deno
./third_party/depot_tools/gn help
# Update third_party modules
git submodule update
# Skip downloading binary build tools and point the build
# to the system provided ones (for packagers of deno ...).
./tools/setup.py --no-binary-download
export DENO_BUILD_ARGS="clang_base_path=/usr clang_use_chrome_plugins=false"
DENO_GN_PATH=/usr/bin/gn DENO_NINJA_PATH=/usr/bin/ninja ./tools/build.py
2019-02-11 17:41:13 -05:00
```
Environment variables: `DENO_BUILD_MODE`, `DENO_BUILD_PATH`, `DENO_BUILD_ARGS`,
`DENO_DIR`, `DENO_GN_PATH`, `DENO_NINJA_PATH`.
2019-02-11 17:41:13 -05:00
## API reference
### deno types
2019-02-11 17:41:13 -05:00
To get an exact reference of deno's runtime API, run the following in the
command line:
2019-06-27 11:30:59 -04:00
```shell
$ deno types
2019-02-11 17:41:13 -05:00
```
[This is what the output looks like.](https://gist.github.com/ry/46da4724168cdefa763e13207d27ede5)
### Reference websites
[TypeScript Deno API](https://deno.land/typedoc/index.html).
If you are embedding deno in a Rust program, see
2019-05-03 15:02:14 -04:00
[Rust Deno API](https://docs.rs/deno).
The Deno crate is hosted on [crates.io](https://crates.io/crates/deno).
2019-02-11 17:41:13 -05:00
## Examples
### An implementation of the unix "cat" program
In this program each command-line argument is assumed to be a filename, the file
is opened, and printed to stdout.
```ts
(async () => {
for (let i = 1; i < Deno.args.length; i++) {
let filename = Deno.args[i];
let file = await Deno.open(filename);
await Deno.copy(Deno.stdout, file);
2019-02-11 17:41:13 -05:00
file.close();
}
})();
```
The `copy()` function here actually makes no more than the necessary kernel ->
userspace -> kernel copies. That is, the same memory from which data is read
from the file, is written to stdout. This illustrates a general design goal for
I/O streams in Deno.
Try the program:
2019-06-27 11:30:59 -04:00
```shell
$ deno run --allow-read https://deno.land/std/examples/cat.ts /etc/passwd
2019-02-11 17:41:13 -05:00
```
### TCP echo server
This is an example of a simple server which accepts connections on port 8080,
and returns to the client anything it sends.
```ts
const { listen, copy } = Deno;
2019-02-11 17:41:13 -05:00
(async () => {
const addr = "0.0.0.0:8080";
const listener = listen("tcp", addr);
console.log("listening on", addr);
while (true) {
const conn = await listener.accept();
copy(conn, conn);
}
})();
```
When this program is started, the user is prompted for permission to listen on
the network:
2019-06-27 11:30:59 -04:00
```shell
$ deno run https://deno.land/std/examples/echo_server.ts
2019-04-15 12:54:17 -04:00
⚠️ Deno requests network access to "listen". Grant? [a/y/n/d (a = allow always, y = allow once, n = deny once, d = deny always)]
2019-02-11 17:41:13 -05:00
```
For security reasons, deno does not allow programs to access the network without
explicit permission. To avoid the console prompt, use a command-line flag:
2019-06-27 11:30:59 -04:00
```shell
$ deno run --allow-net https://deno.land/std/examples/echo_server.ts
2019-02-11 17:41:13 -05:00
```
To test it, try sending a HTTP request to it by using curl. The request gets
written directly back to the client.
2019-06-27 11:30:59 -04:00
```shell
2019-03-11 23:39:46 -04:00
$ curl http://localhost:8080/
2019-02-11 17:41:13 -05:00
GET / HTTP/1.1
Host: localhost:8080
User-Agent: curl/7.54.0
Accept: */*
```
It's worth noting that like the `cat.ts` example, the `copy()` function here
also does not make unnecessary memory copies. It receives a packet from the
kernel and sends back, without further complexity.
### Inspecting and revoking permissions
Sometimes a program may want to revoke previously granted permissions. When a
program, at a later stage, needs those permissions, a new prompt will be
presented to the user.
```ts
const { permissions, revokePermission, open, remove } = Deno;
(async () => {
// lookup a permission
if (!permissions().write) {
throw new Error("need write permission");
}
const log = await open("request.log", "a+");
// revoke some permissions
revokePermission("read");
revokePermission("write");
// use the log file
2019-05-23 03:47:11 -04:00
const encoder = new TextEncoder();
await log.write(encoder.encode("hello\n"));
// this will prompt for the write permission or fail.
await remove("request.log");
})();
```
2019-02-11 17:41:13 -05:00
### File server
This one serves a local directory in HTTP.
2019-03-11 23:39:46 -04:00
```bash
alias file_server="deno run --allow-net --allow-read \
https://deno.land/std/http/file_server.ts"
2019-02-11 17:41:13 -05:00
```
Run it:
2019-06-27 11:30:59 -04:00
```shell
2019-03-11 23:39:46 -04:00
$ file_server .
Downloading https://deno.land/std/http/file_server.ts...
2019-02-11 17:41:13 -05:00
[...]
HTTP server listening on http://0.0.0.0:4500/
```
And if you ever want to upgrade to the latest published version:
2019-06-27 11:30:59 -04:00
```shell
2019-03-11 23:39:46 -04:00
$ file_server --reload
2019-02-11 17:41:13 -05:00
```
2019-05-16 10:39:19 -04:00
### Permissions whitelist
deno also provides permissions whitelist.
This is an example to restrict File system access by whitelist.
2019-06-27 11:30:59 -04:00
```shell
2019-05-16 10:39:19 -04:00
$ deno run --allow-read=/usr https://deno.land/std/examples/cat.ts /etc/passwd
⚠️ Deno requests read access to "/etc/passwd". Grant? [a/y/n/d (a = allow always, y = allow once, n = deny once, d = deny always)]
```
You can grant read permission under `/etc` dir
2019-06-27 11:30:59 -04:00
```shell
2019-05-16 10:39:19 -04:00
$ deno run --allow-read=/etc https://deno.land/std/examples/cat.ts /etc/passwd
```
`--allow-write` works same as `--allow-read`.
This is an example to restrict host.
```ts
(async () => {
const result = await fetch("https://deno.land/std/examples/echo_server.ts");
})();
```
2019-06-27 11:30:59 -04:00
```shell
2019-05-16 10:39:19 -04:00
$ deno run --allow-net=deno.land allow-net-whitelist-example.ts
```
### Run subprocess
2019-02-21 15:52:35 -05:00
[API Reference](https://deno.land/typedoc/index.html#run)
2019-02-21 15:52:35 -05:00
Example:
2019-02-21 15:52:35 -05:00
```ts
async function main() {
// create subprocess
const p = Deno.run({
args: ["echo", "hello"]
});
// await its completion
await p.status();
}
2019-02-21 15:52:35 -05:00
main();
```
2019-02-21 15:52:35 -05:00
Run it:
2019-06-27 11:30:59 -04:00
```shell
$ deno run --allow-run ./subprocess_simple.ts
2019-02-21 15:52:35 -05:00
hello
```
2019-03-02 16:24:33 -05:00
By default when you use `Deno.run()` subprocess inherits `stdin`, `stdout` and
2019-04-06 23:55:44 -04:00
`stderr` of parent process. If you want to communicate with started subprocess
you can use `"piped"` option.
2019-02-21 15:52:35 -05:00
```ts
async function main() {
const decoder = new TextDecoder();
2019-02-21 15:52:35 -05:00
const fileNames = Deno.args.slice(1);
2019-02-21 15:52:35 -05:00
const p = Deno.run({
args: [
"deno",
2019-05-23 03:47:11 -04:00
"run",
2019-02-21 15:52:35 -05:00
"--allow-read",
"https://deno.land/std/examples/cat.ts",
2019-02-21 15:52:35 -05:00
...fileNames
],
stdout: "piped",
stderr: "piped"
});
const { code } = await p.status();
2019-03-28 16:09:46 -04:00
if (code === 0) {
const rawOutput = await p.output();
2019-05-09 13:44:39 -04:00
await Deno.stdout.write(rawOutput);
2019-03-28 16:09:46 -04:00
} else {
const rawError = await p.stderrOutput();
2019-05-09 13:44:39 -04:00
const errorString = decoder.decode(rawError);
2019-04-15 12:54:17 -04:00
console.log(errorString);
2019-03-28 16:09:46 -04:00
}
2019-02-21 15:52:35 -05:00
Deno.exit(code);
}
2019-02-21 15:52:35 -05:00
main();
```
When you run it:
2019-06-27 11:30:59 -04:00
```shell
$ deno run --allow-run ./subprocess.ts <somefile>
[file content]
$ deno run --allow-run ./subprocess.ts non_existent_file.md
Uncaught NotFound: No such file or directory (os error 2)
2019-04-15 12:54:17 -04:00
at DenoError (deno/js/errors.ts:22:5)
at maybeError (deno/js/errors.ts:41:12)
at handleAsyncMsgFromRust (deno/js/dispatch.ts:27:17)
```
2019-02-11 17:41:13 -05:00
### Linking to third party code
In the above examples, we saw that Deno could execute scripts from URLs. Like
browser JavaScript, Deno can import libraries directly from URLs. This example
uses a URL to import a test runner library:
```ts
import { test, runIfMain } from "https://deno.land/std/testing/mod.ts";
import { assertEquals } from "https://deno.land/std/testing/asserts.ts";
2019-02-11 17:41:13 -05:00
test(function t1() {
assertEquals("hello", "hello");
2019-02-11 17:41:13 -05:00
});
test(function t2() {
assertEquals("world", "world");
2019-02-11 17:41:13 -05:00
});
2019-03-02 14:58:50 -05:00
runIfMain(import.meta);
2019-02-11 17:41:13 -05:00
```
Try running this:
2019-06-27 11:30:59 -04:00
```shell
$ deno run test.ts
2019-02-11 17:41:13 -05:00
running 2 tests
2019-03-02 14:58:50 -05:00
test t1 ... ok
test t2 ... ok
2019-02-11 17:41:13 -05:00
test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out
2019-03-02 14:58:50 -05:00
2019-02-11 17:41:13 -05:00
```
Note that we did not have to provide the `--allow-net` flag for this program,
and yet it accessed the network. The runtime has special access to download
imports and cache them to disk.
Deno caches remote imports in a special directory specified by the `$DENO_DIR`
environmental variable. It defaults to the system's cache directory if
`$DENO_DIR` is not specified. The next time you run the program, no downloads
will be made. If the program hasn't changed, it won't be recompiled either. The
default directory is:
- On Linux/Redox: `$XDG_CACHE_HOME/deno` or `$HOME/.cache/deno`
- On Windows: `%LOCALAPPDATA%/deno` (`%LOCALAPPDATA%` = `FOLDERID_LocalAppData`)
- On macOS: `$HOME/Library/Caches/deno`
- If something fails, it falls back to `$HOME/.deno`
2019-02-11 17:41:13 -05:00
**But what if `https://deno.land/` goes down?** Relying on external servers is
convenient for development but brittle in production. Production software should
always bundle its dependencies. In Deno this is done by checking the `$DENO_DIR`
into your source control system, and specifying that path as the `$DENO_DIR`
environmental variable at runtime.
**How do you import to a specific version?** Simply specify the version in the
URL. For example, this URL fully specifies the code being run:
`https://unpkg.com/liltest@0.0.5/dist/liltest.js`. Combined with the
aforementioned technique of setting `$DENO_DIR` in production to stored code,
one can fully specify the exact code being run, and execute the code without
network access.
**It seems unwieldy to import URLs everywhere. What if one of the URLs links to
a subtly different version of a library? Isn't it error prone to maintain URLs
everywhere in a large project?** The solution is to import and re-export your
2019-03-08 13:10:14 -05:00
external libraries in a central `deps.ts` file (which serves the same purpose as
Node's `package.json` file). For example, let's say you were using the above
2019-02-11 17:41:13 -05:00
testing library across a large project. Rather than importing
`"https://deno.land/std/testing/mod.ts"` everywhere, you could create a
2019-03-08 13:10:14 -05:00
`deps.ts` file the exports the third-party code:
2019-02-11 17:41:13 -05:00
```ts
export { test, assertEquals } from "https://deno.land/std/testing/mod.ts";
2019-02-11 17:41:13 -05:00
```
2019-03-08 13:10:14 -05:00
And throughout project one can import from the `deps.ts` and avoid having many
references to the same URL:
2019-02-11 17:41:13 -05:00
```ts
2019-03-08 13:10:14 -05:00
import { test, assertEquals } from "./deps.ts";
2019-02-11 17:41:13 -05:00
```
This design circumvents a plethora of complexity spawned by package management
software, centralized code repositories, and superfluous file formats.
2019-02-12 21:14:02 -05:00
### Testing if current file is the main program
2019-03-02 15:02:47 -05:00
To test if the current script has been executed as the main input to the program
check `import.meta.main`.
2019-02-12 21:14:02 -05:00
```ts
2019-03-02 15:02:47 -05:00
if (import.meta.main) {
2019-02-12 21:14:02 -05:00
console.log("main");
}
```
2019-02-11 17:41:13 -05:00
## Command line interface
### Flags
Use `deno help` to see the help text.
2019-04-06 18:13:06 -04:00
```
2019-04-06 18:13:06 -04:00
USAGE:
deno [FLAGS] [OPTIONS] [SUBCOMMAND]
2019-04-06 18:13:06 -04:00
FLAGS:
2019-06-05 13:44:46 -04:00
-A, --allow-all Allow all permissions
--allow-env Allow environment access
--allow-hrtime Allow high resolution time measurement
--allow-run Allow running subprocesses
-h, --help Prints help information
--no-prompt Do not use prompts
-r, --reload Reload source code cache (recompile TypeScript)
--v8-options Print V8 command line options
2019-04-06 18:13:06 -04:00
OPTIONS:
2019-06-05 13:44:46 -04:00
--allow-net=<allow-net> Allow network access
--allow-read=<allow-read> Allow file system read access
--allow-write=<allow-write> Allow file system write access
-c, --config <FILE> Load compiler configuration file
2019-06-09 09:08:20 -04:00
--importmap <FILE> Load import map file
2019-06-23 10:01:49 -04:00
-L, --log-level <log-level> Set log level [possible values: debug, info]
--seed <NUMBER> Seed Math.random()
2019-06-05 13:44:46 -04:00
--v8-flags=<v8-flags> Set V8 command line options
2019-04-06 18:13:06 -04:00
SUBCOMMANDS:
2019-06-26 06:02:13 -04:00
[SCRIPT] Script to run
bundle Bundle module and dependencies into single file
completions Generate shell completions
eval Eval script
fetch Fetch the dependencies
fmt Format files
help Prints this message or the help of the given subcommand(s)
info Show source file related info
install Install script as executable
run Run a program given a filename or url to the source code
types Print runtime TypeScript declarations
version Print the version
xeval Eval a script on text segments from stdin
2019-04-06 18:13:06 -04:00
ENVIRONMENT VARIABLES:
DENO_DIR Set deno's base directory
NO_COLOR Set to disable color
2019-02-11 17:41:13 -05:00
```
### Environmental variables
There are several env vars that control how Deno behaves:
`DENO_DIR` defaults to `$HOME/.deno` but can be set to any path to control where
generated and cached source code is written and read to.
`NO_COLOR` will turn off color output if set. See https://no-color.org/. User
code can test if `NO_COLOR` was set without having `--allow-env` by using the
2019-03-02 16:24:33 -05:00
boolean constant `Deno.noColor`.
2019-02-11 17:41:13 -05:00
2019-06-26 06:02:13 -04:00
### Shell completion
You can generate completion script for your shell using the
`deno completions <shell>` command. The command outputs to stdout so you should
redirect it to an appropriate file.
The supported shells are:
- zsh
- bash
- fish
- powershell
- elvish
Example:
2019-06-27 11:30:59 -04:00
```shell
2019-06-26 06:02:13 -04:00
deno completions bash > /usr/local/etc/bash_completion.d/deno.bash
source /usr/local/etc/bash_completion.d/deno.bash
```
2019-02-11 17:41:13 -05:00
### V8 flags
V8 has many many internal command-line flags, that you can see with
`--v8-options`.
[It looks like this.](https://gist.github.com/ry/1c5b080dcbdc6367e5612392049c9ee7)
Particularly useful ones:
```
--async-stack-trace
```
### Bundling
`deno bundle [URL]` will output a single JavaScript file, using
[AMD](https://en.wikipedia.org/wiki/Asynchronous_module_definition), which
includes all dependencies of the specified input.
```
> deno bundle https://deno.land/std/examples/colors.ts
Bundling "colors.bundle.js"
Emitting bundle to "colors.bundle.js"
9.2 kB emitted.
```
To run then bundle in Deno use
```
deno https://deno.land/std/bundle/run.ts colors.bundle.js
```
Bundles can also be loaded in the web browser with the assistance of
[RequireJS](https://requirejs.org/). Suppose we have a bundle called
`website.bundle.js`, then the following HTML should be able to load it:
```html
<script src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.6/require.min.js"></script>
<script src="website.bundle.js"></script>
<script>
requirejs(["website"], website => website.main());
</script>
```
Here we assume there's an exported function `main()` from `website.ts`.
```js
// website.ts
export main() {
console.log("hello from the web browser");
}
```
### Installing executable scripts
Deno provides ability to easily install and distribute executable code via
`deno install` command.
`deno install [EXE_NAME] [URL] [FLAGS...]` will install script available at
`URL` with name `EXE_NAME`.
This command is a thin wrapper that creates executable shell scripts which
invoke `deno` with specified permissions and CLI flags.
Example:
2019-06-27 11:30:59 -04:00
```shell
$ deno install file_server https://deno.land/std/http/file_server.ts --allow-net --allow-read
[1/1] Compiling https://deno.land/std/http/file_server.ts
✅ Successfully installed file_server.
/Users/deno/.deno/bin/file_server
```
By default scripts are installed at `$HOME/.deno/bin` and that directory must be
added to the path manually.
2019-06-27 11:30:59 -04:00
```shell
$ echo 'export PATH="$HOME/.deno/bin:$PATH"' >> ~/.bashrc
```
Installation directory can be changed using `-d/--dir` flag:
2019-06-27 11:30:59 -04:00
```shell
$ deno install --dir /usr/local/bin prettier https://deno.land/std/prettier/main.ts --allow-write --allow-read
```
When installing a script you can specify permissions that will be used to run
the script. They are placed after the script URL and can be mixed with any
additional CLI flags you want to pass to the script.
Example:
2019-06-27 11:30:59 -04:00
```shell
$ deno install format_check https://deno.land/std/prettier/main.ts --allow-write --allow-read --check --print-width 88 --tab-width 2
```
Above command creates an executable called `format_check` that runs `prettier`
with write and read permissions. When you run `format_check` deno will run
prettier in `check` mode and configured to use `88` column width with `2` column
tabs.
It is a good practice to use `import.meta.main` idiom for an entry point for
executable file. See
[Testing if current file is the main program](#testing-if-current-file-is-the-main-program)
section.
Example:
```ts
// https://example.com/awesome/cli.ts
async function myAwesomeCli(): Promise<void> {
-- snip --
}
if (import.meta.main) {
myAwesomeCli();
}
```
When you create executable script make sure to let users know by adding example
installation command to your repository:
2019-06-27 11:30:59 -04:00
```shell
# Install using deno install
$ deno install awesome_cli https://example.com/awesome/cli.ts
```
2019-06-09 09:08:20 -04:00
## Import maps
Deno supports [import maps](https://github.com/WICG/import-maps).
One can use import map with `--importmap=<FILE>` CLI flag.
Current limitations:
- single import map
- no fallback URLs
- Deno does not support `std:` namespace
- Does supports only `file:`, `http:` and `https:` schemes
Example:
```js
// import_map.json
{
"imports": {
"http/": "https://deno.land/std/http/"
}
}
```
```ts
// hello_server.ts
import { serve } from "http/server.ts";
async function main() {
const body = new TextEncoder().encode("Hello World\n");
for await (const req of serve(":8000")) {
req.respond({ body });
}
}
main();
```
2019-06-27 11:30:59 -04:00
```shell
2019-06-09 09:08:20 -04:00
$ deno run --importmap=import_map.json hello_server.ts
```
2019-02-11 17:41:13 -05:00
## Internal details
### Deno and Linux analogy
| **Linux** | **Deno** |
| ------------------------------: | :------------------------------- |
| Processes | Web Workers |
| Syscalls | Ops |
| File descriptors (fd) | [Resource ids (rid)](#resources) |
| Scheduler | Tokio |
| Userland: libc++ / glib / boost | deno_std |
2019-03-02 16:24:33 -05:00
| /proc/\$\$/stat | [Deno.metrics()](#metrics) |
| man pages | deno types |
#### Resources
Resources (AKA `rid`) are Deno's version of file descriptors. They are integer
values used to refer to open files, sockets, and other concepts. For testing it
would be good to be able to query the system for how many open resources there
are.
```ts
2019-03-02 16:24:33 -05:00
const { resources, close } = Deno;
console.log(resources());
// output like: { 0: "stdin", 1: "stdout", 2: "stderr", 3: "repl" }
// close resource by rid
close(3);
```
#### Metrics
Metrics is deno's internal counters for various statics.
2019-06-27 11:30:59 -04:00
```shell
> console.table(Deno.metrics())
┌──────────────────┬────────┐
│ (index) │ Values │
├──────────────────┼────────┤
│ opsDispatched │ 9 │
│ opsCompleted │ 9 │
│ bytesSentControl │ 504 │
│ bytesSentData │ 0 │
│ bytesReceived │ 856 │
└──────────────────┴────────┘
```
2019-02-11 17:41:13 -05:00
### Schematic diagram
<img src="images/schematic_v0.2.png">
2019-02-11 17:41:13 -05:00
### Profiling
To start profiling,
```sh
# Make sure we're only building release.
# Build deno and V8's d8.
./tools/build.py --release d8 deno
2019-02-11 17:41:13 -05:00
# Start the program we want to benchmark with --prof
./target/release/deno tests/http_bench.ts --allow-net --prof &
# Exercise it.
third_party/wrk/linux/wrk http://localhost:4500/
kill `pgrep deno`
```
V8 will write a file in the current directory that looks like this:
`isolate-0x7fad98242400-v8.log`. To examine this file:
```sh
D8_PATH=target/release/ ./third_party/v8/tools/linux-tick-processor
isolate-0x7fad98242400-v8.log > prof.log
# on macOS, use ./third_party/v8/tools/mac-tick-processor instead
```
`prof.log` will contain information about tick distribution of different calls.
To view the log with Web UI, generate JSON file of the log:
```sh
D8_PATH=target/release/ ./third_party/v8/tools/linux-tick-processor
isolate-0x7fad98242400-v8.log --preprocess > prof.json
```
2019-05-13 07:38:03 -04:00
Open `third_party/v8/tools/profview/index.html` in your browser, and select
2019-02-11 17:41:13 -05:00
`prof.json` to view the distribution graphically.
To learn more about `d8` and profiling, check out the following links:
- [https://v8.dev/docs/d8](https://v8.dev/docs/d8)
- [https://v8.dev/docs/profile](https://v8.dev/docs/profile)
### Debugging with LLDB
We can use LLDB to debug deno.
2019-06-27 11:30:59 -04:00
```shell
$ lldb -- target/debug/deno run tests/worker.js
2019-02-11 17:41:13 -05:00
> run
> bt
> up
> up
> l
```
To debug Rust code, we can use `rust-lldb`. It should come with `rustc` and is a
wrapper around LLDB.
2019-06-27 11:30:59 -04:00
```shell
$ rust-lldb -- ./target/debug/deno run --allow-net tests/http_bench.ts
2019-02-11 17:41:13 -05:00
# On macOS, you might get warnings like
# `ImportError: cannot import name _remove_dead_weakref`
# In that case, use system python by setting PATH, e.g.
# PATH=/System/Library/Frameworks/Python.framework/Versions/2.7/bin:$PATH
2019-05-02 23:44:28 -04:00
(lldb) command script import "/Users/kevinqian/.rustup/toolchains/1.34.1-x86_64-apple-darwin/lib/rustlib/etc/lldb_rust_formatters.py"
2019-02-11 17:41:13 -05:00
(lldb) type summary add --no-value --python-function lldb_rust_formatters.print_val -x ".*" --category Rust
(lldb) type category enable Rust
(lldb) target create "../deno/target/debug/deno"
Current executable set to '../deno/target/debug/deno' (x86_64).
(lldb) settings set -- target.run-args "tests/http_bench.ts" "--allow-net"
(lldb) b op_start
(lldb) r
```
2019-04-04 09:35:52 -04:00
### Deno Core
2019-02-11 17:41:13 -05:00
2019-04-04 09:35:52 -04:00
The core binding layer for Deno. It is released as a
[standalone crate](https://crates.io/crates/deno). Inside of core is V8 itself,
with a binding API called "libdeno". See the crate documentation for more
details.
2019-02-11 17:41:13 -05:00
### Flatbuffers
We use Flatbuffers to define common structs and enums between TypeScript and
Rust. These common data structures are defined in
2019-04-04 09:35:52 -04:00
[msg.fbs](https://github.com/denoland/deno/blob/master/cli/msg.fbs)
2019-02-11 17:41:13 -05:00
### Updating prebuilt binaries
2019-06-27 11:30:59 -04:00
```shell
2019-03-11 23:39:46 -04:00
$ ./third_party/depot_tools/upload_to_google_storage.py -b denoland \
2019-02-11 17:41:13 -05:00
-e ~/.config/gcloud/legacy_credentials/ry@tinyclouds.org/.boto `which sccache`
2019-03-11 23:39:46 -04:00
$ mv `which sccache`.sha1 prebuilt/linux64/
$ gsutil acl ch -u AllUsers:R gs://denoland/608be47bf01004aa11d4ed06955414e93934516e
2019-02-11 17:41:13 -05:00
```
### Continuous Benchmarks
2019-03-11 23:39:46 -04:00
See our benchmarks [over here](https://deno.land/benchmarks.html)
2019-02-11 17:41:13 -05:00
The benchmark chart supposes `//website/data.json` has the type
`BenchmarkData[]` where `BenchmarkData` is defined like the below:
2019-03-11 23:39:46 -04:00
```ts
2019-02-11 17:41:13 -05:00
interface ExecTimeData {
mean: number;
stddev: number;
user: number;
system: number;
min: number;
max: number;
}
interface BenchmarkData {
created_at: string;
sha1: string;
benchmark: {
[key: string]: ExecTimeData;
};
binarySizeData: {
[key: string]: number;
};
threadCountData: {
[key: string]: number;
};
syscallCountData: {
[key: string]: number;
};
}
```
### Logos
These Deno logos, like the Deno software, are distributed under the MIT license
(public domain and free for use)
2019-03-05 21:57:57 -05:00
- [A hand drawn one by @ry](https://github.com/denoland/deno/blob/master/website/images/deno_logo.png)
- [An animated one by @hashrock](https://github.com/denolib/animated-deno-logo/)
- [A high resolution SVG one by @kevinkassimo](https://github.com/denolib/high-res-deno-logo)
- [A pixelated animation one by @tanakaworld](https://github.com/denoland/deno/blob/master/website/images/deno_logo_4.gif)
2019-02-11 17:41:13 -05:00
## Contributing
[Style Guide](style_guide.html)
Progress towards future releases is tracked
[here](https://github.com/denoland/deno/milestones).
Please don't make [the benchmarks](https://deno.land/benchmarks.html) worse.
Ask for help in the [community chat room](https://gitter.im/denolife/Lobby).
If you are going to work on an issue, mention so in the issue comments _before_
you start working on the issue.
2019-02-11 17:41:13 -05:00
### Submitting a pull request
Before submitting, please make sure the following is done:
1. That there is a related issue and it is referenced in the PR text.
2. There are tests that cover the changes.
3. Ensure `./tools/test.py` passes.
4. Format your code with `tools/format.py`
5. Make sure `./tools/lint.py` passes.
2019-02-11 17:41:13 -05:00
### Changes to `third_party`
[`deno_third_party`](https://github.com/denoland/deno_third_party) contains most
of the external code that Deno depends on, so that we know exactly what we are
2019-03-27 02:26:03 -04:00
executing at any given time. It is carefully maintained with a mixture of manual
2019-02-11 17:41:13 -05:00
labor and private scripts. It's likely you will need help from @ry or
@piscisaureus to make changes.
### Adding Ops (aka bindings)
We are very concerned about making mistakes when adding new APIs. When adding an
Op to Deno, the counterpart interfaces on other platforms should be researched.
Please list how this functionality is done in Go, Node, Rust, and Python.
2019-03-02 16:24:33 -05:00
As an example, see how `Deno.rename()` was proposed and added in
2019-02-11 17:41:13 -05:00
[PR #671](https://github.com/denoland/deno/pull/671).
### Documenting APIs
It is important to document public APIs and we want to do that inline with the
code. This helps ensure that code and documentation are tightly coupled
together.
#### Utilize JSDoc
All publicly exposed APIs and types, both via the `deno` module as well as the
global/`window` namespace should have JSDoc documentation. This documentation is
parsed and available to the TypeScript compiler, and therefore easy to provide
further downstream. JSDoc blocks come just prior to the statement they apply to
and are denoted by a leading `/**` before terminating with a `*/`. For example:
```ts
/** A simple JSDoc comment */
export const FOO = "foo";
```