409 lines
11 KiB
Markdown
409 lines
11 KiB
Markdown
|
# :rocket: fast-glob
|
|||
|
|
|||
|
> Is a faster [`node-glob`](https://github.com/isaacs/node-glob) alternative.
|
|||
|
|
|||
|
## :bulb: Highlights
|
|||
|
|
|||
|
* :rocket: Fast by using Streams and Promises. Used [readdir-enhanced](https://github.com/BigstickCarpet/readdir-enhanced) and [micromatch](https://github.com/jonschlinkert/micromatch).
|
|||
|
* :beginner: User-friendly, since it supports multiple and negated patterns (`['*', '!*.md']`).
|
|||
|
* :vertical_traffic_light: Rational, because it doesn't read excluded directories (`!**/node_modules/**`).
|
|||
|
* :gear: Universal, because it supports Synchronous, Promise and Stream API.
|
|||
|
* :money_with_wings: Economy, because it provides `fs.Stats` for matched path if you wanted.
|
|||
|
|
|||
|
## Donate
|
|||
|
|
|||
|
If you want to thank me, or promote your Issue.
|
|||
|
|
|||
|
[![Donate](https://img.shields.io/badge/Donate-PayPal-green.svg)](https://paypal.me/mrmlnc)
|
|||
|
|
|||
|
> Sorry, but I have work and support for packages requires some time after work. I will be glad of your support and PR's.
|
|||
|
|
|||
|
## Install
|
|||
|
|
|||
|
```
|
|||
|
$ npm install --save fast-glob
|
|||
|
```
|
|||
|
|
|||
|
## Usage
|
|||
|
|
|||
|
#### Asynchronous
|
|||
|
|
|||
|
```js
|
|||
|
const fg = require('fast-glob');
|
|||
|
|
|||
|
fg(['src/**/*.js', '!src/**/*.spec.js']).then((entries) => console.log(entries));
|
|||
|
fg.async(['src/**/*.js', '!src/**/*.spec.js']).then((entries) => console.log(entries));
|
|||
|
```
|
|||
|
|
|||
|
#### Synchronous
|
|||
|
|
|||
|
```js
|
|||
|
const fg = require('fast-glob');
|
|||
|
|
|||
|
const entries = fg.sync(['src/**/*.js', '!src/**/*.spec.js']);
|
|||
|
console.log(entries);
|
|||
|
```
|
|||
|
|
|||
|
#### Stream
|
|||
|
|
|||
|
```js
|
|||
|
const fg = require('fast-glob');
|
|||
|
|
|||
|
const stream = fg.stream(['src/**/*.js', '!src/**/*.spec.js']);
|
|||
|
|
|||
|
const entries = [];
|
|||
|
|
|||
|
stream.on('data', (entry) => entries.push(entry));
|
|||
|
stream.once('error', console.log);
|
|||
|
stream.once('end', () => console.log(entries));
|
|||
|
```
|
|||
|
|
|||
|
## API
|
|||
|
|
|||
|
### fg(patterns, [options])
|
|||
|
### fg.async(patterns, [options])
|
|||
|
|
|||
|
Returns a `Promise` with an array of matching [entries](#entry).
|
|||
|
|
|||
|
### fg.sync(patterns, [options])
|
|||
|
|
|||
|
Returns an array of matching [entries](#entry).
|
|||
|
|
|||
|
### fg.stream(patterns, [options])
|
|||
|
|
|||
|
Returns a [`ReadableStream`](https://nodejs.org/api/stream.html#stream_readable_streams) when the `data` event will be emitted with [`Entry`](#entry).
|
|||
|
|
|||
|
#### patterns
|
|||
|
|
|||
|
* Type: `string|string[]`
|
|||
|
|
|||
|
This package does not respect the order of patterns. First, all the negative patterns are applied, and only then the positive patterns.
|
|||
|
|
|||
|
#### options
|
|||
|
|
|||
|
* Type: `Object`
|
|||
|
|
|||
|
See [options](#options-1) section for more detailed information.
|
|||
|
|
|||
|
### fg.generateTasks(patterns, [options])
|
|||
|
|
|||
|
Return a set of tasks based on provided patterns. All tasks satisfy the `Task` interface:
|
|||
|
|
|||
|
```ts
|
|||
|
interface Task {
|
|||
|
/**
|
|||
|
* Parent directory for all patterns inside this task.
|
|||
|
*/
|
|||
|
base: string;
|
|||
|
/**
|
|||
|
* Dynamic or static patterns are in this task.
|
|||
|
*/
|
|||
|
dynamic: boolean;
|
|||
|
/**
|
|||
|
* All patterns.
|
|||
|
*/
|
|||
|
patterns: string[];
|
|||
|
/**
|
|||
|
* Only positive patterns.
|
|||
|
*/
|
|||
|
positive: string[];
|
|||
|
/**
|
|||
|
* Only negative patterns without ! symbol.
|
|||
|
*/
|
|||
|
negative: string[];
|
|||
|
}
|
|||
|
```
|
|||
|
|
|||
|
## Entry
|
|||
|
|
|||
|
The entry which can be a `string` if the [`stats`](#stats) option is disabled, otherwise `fs.Stats` with two additional `path` and `depth` properties.
|
|||
|
|
|||
|
## Options
|
|||
|
|
|||
|
#### cwd
|
|||
|
|
|||
|
* Type: `string`
|
|||
|
* Default: `process.cwd()`
|
|||
|
|
|||
|
The current working directory in which to search.
|
|||
|
|
|||
|
#### deep
|
|||
|
|
|||
|
* Type: `number|boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
The deep option can be set to `true` to traverse the entire directory structure, or it can be set to a *number* to only traverse that many levels deep.
|
|||
|
|
|||
|
For example, you have the following tree:
|
|||
|
|
|||
|
```
|
|||
|
test
|
|||
|
└── one
|
|||
|
└── two
|
|||
|
└── index.js
|
|||
|
```
|
|||
|
|
|||
|
> :book: If you specify a pattern with some base directory, this directory will not participate in the calculation of the depth of the found directories. Think of it as a `cwd` option.
|
|||
|
|
|||
|
```js
|
|||
|
fg('test/**', { onlyFiles: false, deep: 0 });
|
|||
|
// -> ['test/one']
|
|||
|
fg('test/**', { onlyFiles: false, deep: 1 });
|
|||
|
// -> ['test/one', 'test/one/two']
|
|||
|
|
|||
|
fg('**', { onlyFiles: false, cwd: 'test', deep: 0 });
|
|||
|
// -> ['one']
|
|||
|
fg('**', { onlyFiles: false, cwd: 'test', deep: 1 });
|
|||
|
// -> ['one', 'one/two']
|
|||
|
```
|
|||
|
|
|||
|
#### ignore
|
|||
|
|
|||
|
* Type: `string[]`
|
|||
|
* Default: `[]`
|
|||
|
|
|||
|
An array of glob patterns to exclude matches.
|
|||
|
|
|||
|
#### dot
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Allow patterns to match filenames starting with a period (files & directories), even if the pattern does not explicitly have a period in that spot.
|
|||
|
|
|||
|
#### stats
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Return `fs.Stats` with two additional `path` and `depth` properties instead of a `string`.
|
|||
|
|
|||
|
#### onlyFiles
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
Return only files.
|
|||
|
|
|||
|
#### onlyDirectories
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Return only directories.
|
|||
|
|
|||
|
#### followSymlinkedDirectories
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
Follow symlinked directories when expanding `**` patterns.
|
|||
|
|
|||
|
#### unique
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
Prevent duplicate results.
|
|||
|
|
|||
|
#### markDirectories
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Add a `/` character to directory entries.
|
|||
|
|
|||
|
#### absolute
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Return absolute paths for matched entries.
|
|||
|
|
|||
|
> :book: Note that you need to use this option if you want to use absolute negative patterns like `${__dirname}/*.md`.
|
|||
|
|
|||
|
#### nobrace
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Disable expansion of brace patterns (`{a,b}`, `{1..3}`).
|
|||
|
|
|||
|
#### brace
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
The [`nobrace`](#nobrace) option without double-negation. This option has a higher priority then `nobrace`.
|
|||
|
|
|||
|
#### noglobstar
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Disable matching with globstars (`**`).
|
|||
|
|
|||
|
#### globstar
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
The [`noglobstar`](#noglobstar) option without double-negation. This option has a higher priority then `noglobstar`.
|
|||
|
|
|||
|
#### noext
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Disable extglob support (patterns like `+(a|b)`), so that extglobs are regarded as literal characters.
|
|||
|
|
|||
|
#### extension
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
The [`noext`](#noext) option without double-negation. This option has a higher priority then `noext`.
|
|||
|
|
|||
|
#### nocase
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Disable a [case-sensitive](https://en.wikipedia.org/wiki/Case_sensitivity) mode for matching files.
|
|||
|
|
|||
|
##### Examples
|
|||
|
|
|||
|
* File System: `test/file.md`, `test/File.md`
|
|||
|
* Case-sensitive for `test/file.*` pattern (`false`): `test/file.md`
|
|||
|
* Case-insensitive for `test/file.*` pattern (`true`): `test/file.md`, `test/File.md`
|
|||
|
|
|||
|
#### case
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `true`
|
|||
|
|
|||
|
The [`nocase`](#nocase) option without double-negation. This option has a higher priority then `nocase`.
|
|||
|
|
|||
|
#### matchBase
|
|||
|
|
|||
|
* Type: `boolean`
|
|||
|
* Default: `false`
|
|||
|
|
|||
|
Allow glob patterns without slashes to match a file path based on its basename. For example, `a?b` would match the path `/xyz/123/acb`, but not `/xyz/acb/123`.
|
|||
|
|
|||
|
#### transform
|
|||
|
|
|||
|
* Type: `Function`
|
|||
|
* Default: `null`
|
|||
|
|
|||
|
Allows you to transform a path or `fs.Stats` object before sending to the array.
|
|||
|
|
|||
|
```js
|
|||
|
const fg = require('fast-glob');
|
|||
|
|
|||
|
const entries1 = fg.sync(['**/*.scss']);
|
|||
|
const entries2 = fg.sync(['**/*.scss'], { transform: (entry) => '_' + entry });
|
|||
|
|
|||
|
console.log(entries1); // ['a.scss', 'b.scss']
|
|||
|
console.log(entries2); // ['_a.scss', '_b.scss']
|
|||
|
```
|
|||
|
|
|||
|
If you are using **TypeScript**, you probably want to specify your own type of the returned array.
|
|||
|
|
|||
|
```ts
|
|||
|
import * as fg from 'fast-glob';
|
|||
|
|
|||
|
interface IMyOwnEntry {
|
|||
|
path: string;
|
|||
|
}
|
|||
|
|
|||
|
const entries: IMyOwnEntry[] = fg.sync<IMyOwnEntry>(['*.md'], {
|
|||
|
transform: (entry) => typeof entry === 'string' ? { path: entry } : { path: entry.path }
|
|||
|
// Will throw compilation error for non-IMyOwnEntry types (boolean, for example)
|
|||
|
});
|
|||
|
```
|
|||
|
|
|||
|
## How to exclude directory from reading?
|
|||
|
|
|||
|
You can use a negative pattern like this: `!**/node_modules` or `!**/node_modules/**`. Also you can use `ignore` option. Just look at the example below.
|
|||
|
|
|||
|
```
|
|||
|
first/
|
|||
|
├── file.md
|
|||
|
└── second
|
|||
|
└── file.txt
|
|||
|
```
|
|||
|
|
|||
|
If you don't want to read the `second` directory, you must write the following pattern: `!**/second` or `!**/second/**`.
|
|||
|
|
|||
|
```js
|
|||
|
fg.sync(['**/*.md', '!**/second']); // ['first/file.txt']
|
|||
|
fg.sync(['**/*.md'], { ignore: '**/second/**' }); // ['first/file.txt']
|
|||
|
```
|
|||
|
|
|||
|
> :warning: When you write `!**/second/**/*` it means that the directory will be **read**, but all the entries will not be included in the results.
|
|||
|
|
|||
|
You have to understand that if you write the pattern to exclude directories, then the directory will not be read under any circumstances.
|
|||
|
|
|||
|
## How to use UNC path?
|
|||
|
|
|||
|
You cannot use UNC paths as patterns (due to syntax), but you can use them as `cwd` directory.
|
|||
|
|
|||
|
```ts
|
|||
|
fg.sync('*', { cwd: '\\\\?\\C:\\Python27' /* or //?/C:/Python27 */ });
|
|||
|
fg.sync('Python27/*', { cwd: '\\\\?\\C:\\' /* or //?/C:/ */ });
|
|||
|
```
|
|||
|
|
|||
|
## Compatible with `node-glob`?
|
|||
|
|
|||
|
Not fully, because `fast-glob` does not implement all options of `node-glob`. See table below.
|
|||
|
|
|||
|
| node-glob | fast-glob |
|
|||
|
| :----------: | :-------: |
|
|||
|
| `cwd` | [`cwd`](#cwd) |
|
|||
|
| `root` | – |
|
|||
|
| `dot` | [`dot`](#dot) |
|
|||
|
| `nomount` | – |
|
|||
|
| `mark` | [`markDirectories`](#markdirectories) |
|
|||
|
| `nosort` | – |
|
|||
|
| `nounique` | [`unique`](#unique) |
|
|||
|
| `nobrace` | [`nobrace`](#nobrace) or [`brace`](#brace) |
|
|||
|
| `noglobstar` | [`noglobstar`](#noglobstar) or [`globstar`](#globstar) |
|
|||
|
| `noext` | [`noext`](#noext) or [`extension`](#extension) |
|
|||
|
| `nocase` | [`nocase`](#nocase) or [`case`](#case) |
|
|||
|
| `matchBase` | [`matchbase`](#matchbase) |
|
|||
|
| `nodir` | [`onlyFiles`](#onlyfiles) |
|
|||
|
| `ignore` | [`ignore`](#ignore) |
|
|||
|
| `follow` | [`followSymlinkedDirectories`](#followsymlinkeddirectories) |
|
|||
|
| `realpath` | – |
|
|||
|
| `absolute` | [`absolute`](#absolute) |
|
|||
|
|
|||
|
## Benchmarks
|
|||
|
|
|||
|
**Tech specs:**
|
|||
|
|
|||
|
Server: [Vultr Bare Metal](https://www.vultr.com/pricing/baremetal)
|
|||
|
|
|||
|
* Processor: E3-1270v6 (8 CPU)
|
|||
|
* RAM: 32GB
|
|||
|
* Disk: SSD
|
|||
|
|
|||
|
You can see results [here](https://gist.github.com/mrmlnc/f06246b197f53c356895fa35355a367c) for latest release.
|
|||
|
|
|||
|
## Related
|
|||
|
|
|||
|
* [readdir-enhanced](https://github.com/BigstickCarpet/readdir-enhanced) – Fast functional replacement for `fs.readdir()`.
|
|||
|
* [globby](https://github.com/sindresorhus/globby) – User-friendly glob matching.
|
|||
|
* [node-glob](https://github.com/isaacs/node-glob) – «Standard» glob functionality for Node.js
|
|||
|
* [bash-glob](https://github.com/micromatch/bash-glob) – Bash-powered globbing for node.js.
|
|||
|
* [glob-stream](https://github.com/gulpjs/glob-stream) – A Readable Stream interface over node-glob that used in the [gulpjs](https://github.com/gulpjs/gulp).
|
|||
|
* [tiny-glob](https://github.com/terkelg/tiny-glob) – Tiny and extremely fast library to match files and folders using glob patterns.
|
|||
|
|
|||
|
## Changelog
|
|||
|
|
|||
|
See the [Releases section of our GitHub project](https://github.com/mrmlnc/fast-glob/releases) for changelogs for each release version.
|
|||
|
|
|||
|
## License
|
|||
|
|
|||
|
This software is released under the terms of the MIT license.
|