Skip to content

Actions: daulet/tokenizers

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
39 workflow runs
39 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

fix: update example to latest release
CI #39: Commit eafe2ce pushed by daulet
August 9, 2024 23:52 1m 20s main
August 9, 2024 23:52 1m 20s
fix: release image
CI #38: Commit f5ef49c pushed by daulet
August 9, 2024 23:20 1m 48s main
August 9, 2024 23:20 1m 48s
Update to huggingface/tokenizers v0.20.0 (#23)
CI #37: Commit 89e504d pushed by daulet
August 9, 2024 23:15 1m 16s main
August 9, 2024 23:15 1m 16s
Update to huggingface/tokenizers v0.20.0
CI #36: Pull request #23 opened by daulet
August 9, 2024 23:11 1m 24s daulet/v0.20
August 9, 2024 23:11 1m 24s
feat: add option to retrieve offsets from tokenizer (#21)
CI #35: Commit 7bb47dd pushed by daulet
August 9, 2024 21:38 6m 27s main
August 9, 2024 21:38 6m 27s
Add tiktoken vs tokenizers bench
CI #30: Commit d9aff87 pushed by daulet
July 14, 2024 05:39 2m 12s main
July 14, 2024 05:39 2m 12s
improve rust bench to exclude drop time
CI #29: Commit fce4681 pushed by daulet
July 10, 2024 15:24 1m 46s main
July 10, 2024 15:24 1m 46s
fix Bazel build
CI #28: Commit 867bf62 pushed by daulet
July 10, 2024 15:14 2m 24s main
July 10, 2024 15:14 2m 24s
upgrade to 0.19.1
CI #27: Commit 217df12 pushed by daulet
July 9, 2024 07:52 1m 51s main
July 9, 2024 07:52 1m 51s
update benchmarks before upgrade to 0.19.1
CI #26: Commit a735742 pushed by daulet
July 9, 2024 07:48 2m 19s main
July 9, 2024 07:48 2m 19s
update README with linker param requirement
CI #25: Commit ba0db9d pushed by daulet
July 9, 2024 07:44 6m 28s main
July 9, 2024 07:44 6m 28s
Update to allow for platform dependent libs in CGO (#18)
CI #24: Commit d503b5b pushed by daulet
June 12, 2024 01:36 4m 28s main
June 12, 2024 01:36 4m 28s
Update to allow for platform dependent libs in CGO
CI #23: Pull request #18 synchronize by jmoney
June 6, 2024 13:41 3m 9s jsm.pull-request
June 6, 2024 13:41 3m 9s
Update to allow for platform dependent libs in CGO
CI #22: Pull request #18 opened by jmoney
June 4, 2024 20:18 4m 18s jsm.pull-request
June 4, 2024 20:18 4m 18s
expose encodeSpecialTokens functionality
CI #21: Commit 3a615e6 pushed by daulet
April 10, 2024 23:25 52s main
April 10, 2024 23:25 52s
update to tokenizers v0.15.2
CI #20: Commit b14c306 pushed by daulet
April 10, 2024 17:22 4m 31s main
April 10, 2024 17:22 4m 31s
exclude release from bazel build as it is not compatible
CI #19: Commit 8531b2b pushed by daulet
January 7, 2024 00:37 4m 16s main
January 7, 2024 00:37 4m 16s
fix cross compilation: libc::c_char is platform dependent
CI #18: Commit 6e58579 pushed by daulet
January 7, 2024 00:24 2m 19s main
January 7, 2024 00:24 2m 19s
add contribution README
CI #16: Commit 4fd5a66 pushed by daulet
November 19, 2023 16:55 1m 19s main
November 19, 2023 16:55 1m 19s
support more attributes from the Encoding structure (#5)
CI #15: Commit 38a9a14 pushed by daulet
November 15, 2023 15:40 59s main
November 15, 2023 15:40 59s