KerfuffleV2/repugnant-pickle

Low effort scraping Python's pickle format in Rust. It is to complete pickle parsing as BeautifulSoup was to complete HTML parsing.

36
/ 100
Emerging

This is a Rust tool for extracting data from Python pickle files, including those embedded within PyTorch's `.pth` or `.pt` files. It helps developers who need to read Python data structures or PyTorch tensor metadata without embedding a Python interpreter in their Rust applications. Input is a pickle or PyTorch file, and the output is a structured representation of the data found inside.

No commits in the last 6 months.

Use this if you need to extract data, especially tensor metadata from PyTorch files, from Python pickle files within a Rust application without fully parsing the complex pickle format.

Not ideal if you require a complete, robust, and well-tested pickle parser, or if you can use existing Python libraries like `serde-pickle` for a simpler experience.

data-extraction machine-learning-engineering interoperability data-pipelines Rust-development
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 7 / 25
Maturity 16 / 25
Community 13 / 25

How are scores calculated?

Stars

26

Forks

4

Language

Rust

License

Apache-2.0

Last pushed

May 25, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/KerfuffleV2/repugnant-pickle"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.