halkyon-days/pure-zstd
Watch
1
0
Fork
You've already forked pure-zstd
 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
pure-zstd/pubspec.yaml

29 lines
862 B
YAML
Raw Normal View History

Add a pure-Dart zstd decoder, as a benchmark A feasibility spike, standalone so it can move to its own repository. Not wired into the app and not a dependency of it. Decompression only, and only what our containers need: no dictionaries, no multi-frame, no streaming, and the content checksum is parsed but never verified. Native only, since the bit reader carries 56 bits in an int. It is correct on real data. The committed fixture decodes to the samples the generator wrote, and tool/oracle.py drives a byte-for-byte comparison against pyzstd over 32 containers and 2,615 blocks from both tiers, every thinned column count from 3601 to 361, and 88 S to 80 N. All identical. The numbers, AOT on this box, 131,072 bytes a block: 0.66 ms median against pyzstd's 0.175, so about 200 MB/s against 750. Across three tiles the range is 0.66 to 0.94 ms, and a 113 block sweep is 67 to 105 ms. The cost is the sequence loop and nothing else: a terrain block at level 19 carries around 1,700 literals and 14,400 sequences, so optimising the literal path bought nothing.
2026-09-21 21:37:56 -06:00
name: pure_zstd
Add the metadata pub.dev scores a package on description, repository, issue_tracker and topics, plus a changelog, which between them are most of a package's discoverability. The repository URLs are a guess at the new home and want checking before the first publish. publish_to stays none so an accidental publish from inside this checkout cannot succeed. Remove it in the new repository. Version 0.1.0 rather than 0.0.1: a published version can be retracted but never deleted, so the first one should mean something.
2026-09-21 23:45:05 -06:00
description: >-
A zstd decompressor written in plain Dart. Decodes RFC 8878 frames with no
native library and no platform channel, verified against libzstd.
version: 0.1.0
# Fill these in with the new repository before the first publish. pub.dev
# scores a package on having them and the score is most of its discoverability;
# a published version can be retracted but never deleted, so they are worth
# getting right the first time.
repository: https://github.com/tagadvance/pure_zstd
issue_tracker: https://github.com/tagadvance/pure_zstd/issues
# Remove this line to publish. It is here so an accidental `dart pub publish`
# from inside the original checkout cannot succeed.
Add a pure-Dart zstd decoder, as a benchmark A feasibility spike, standalone so it can move to its own repository. Not wired into the app and not a dependency of it. Decompression only, and only what our containers need: no dictionaries, no multi-frame, no streaming, and the content checksum is parsed but never verified. Native only, since the bit reader carries 56 bits in an int. It is correct on real data. The committed fixture decodes to the samples the generator wrote, and tool/oracle.py drives a byte-for-byte comparison against pyzstd over 32 containers and 2,615 blocks from both tiers, every thinned column count from 3601 to 361, and 88 S to 80 N. All identical. The numbers, AOT on this box, 131,072 bytes a block: 0.66 ms median against pyzstd's 0.175, so about 200 MB/s against 750. Across three tiles the range is 0.66 to 0.94 ms, and a 113 block sweep is 67 to 105 ms. The cost is the sequence loop and nothing else: a terrain block at level 19 carries around 1,700 literals and 14,400 sequences, so optimising the literal path bought nothing.
2026-09-21 21:37:56 -06:00
publish_to: none
Add the metadata pub.dev scores a package on description, repository, issue_tracker and topics, plus a changelog, which between them are most of a package's discoverability. The repository URLs are a guess at the new home and want checking before the first publish. publish_to stays none so an accidental publish from inside this checkout cannot succeed. Remove it in the new repository. Version 0.1.0 rather than 0.0.1: a published version can be retracted but never deleted, so the first one should mean something.
2026-09-21 23:45:05 -06:00
topics:
- zstd
- zstandard
- compression
- decompression
Add a pure-Dart zstd decoder, as a benchmark A feasibility spike, standalone so it can move to its own repository. Not wired into the app and not a dependency of it. Decompression only, and only what our containers need: no dictionaries, no multi-frame, no streaming, and the content checksum is parsed but never verified. Native only, since the bit reader carries 56 bits in an int. It is correct on real data. The committed fixture decodes to the samples the generator wrote, and tool/oracle.py drives a byte-for-byte comparison against pyzstd over 32 containers and 2,615 blocks from both tiers, every thinned column count from 3601 to 361, and 88 S to 80 N. All identical. The numbers, AOT on this box, 131,072 bytes a block: 0.66 ms median against pyzstd's 0.175, so about 200 MB/s against 750. Across three tiles the range is 0.66 to 0.94 ms, and a 113 block sweep is 67 to 105 ms. The cost is the sequence loop and nothing else: a terrain block at level 19 carries around 1,700 literals and 14,400 sequences, so optimising the literal path bought nothing.
2026-09-21 21:37:56 -06:00
environment:
sdk: ^3.8.0
dev_dependencies:
lints: ^6.0.0
test: ^1.25.0
Reference in a new issue Copy permalink