loongson/pypi/: safetensors-0.3.2 metadata and description
Homepage
Simple index
Fast and Safe Tensor serialization
classifiers |
- Development Status :: 5 - Production/Stable
- Intended Audience :: Developers
- Intended Audience :: Education
- Intended Audience :: Science/Research
- License :: OSI Approved :: Apache Software License
- Operating System :: OS Independent
- Programming Language :: Python :: 3
- Programming Language :: Python :: 3.7
- Programming Language :: Python :: 3.8
- Programming Language :: Python :: 3.9
- Programming Language :: Python :: 3.10
- Topic :: Scientific/Engineering :: Artificial Intelligence
|
description_content_type |
text/markdown |
license |
Apache License 2.0 |
requires_dist |
- torch (>=1.10) ; extra == 'all'
- numpy (>=1.21.6) ; extra == 'all'
- tensorflow (==2.11.0) ; extra == 'all'
- jax (>=0.3.25) ; extra == 'all'
- flax (>=0.6.3) ; extra == 'all'
- jaxlib (>=0.3.25) ; extra == 'all'
- paddlepaddle (>=2.4.1) ; extra == 'all'
- black (==22.3) ; extra == 'all'
- isort (>=5.5.4) ; extra == 'all'
- flake8 (>=3.8.3) ; extra == 'all'
- click (==8.0.4) ; extra == 'all'
- setuptools-rust (>=1.5.2) ; extra == 'all'
- huggingface-hub (>=0.12.1) ; extra == 'all'
- pytest (>=7.2.0) ; extra == 'all'
- pytest-benchmark (>=4.0.0) ; extra == 'all'
- h5py (>=3.7.0) ; extra == 'all'
- torch (>=1.10) ; extra == 'dev'
- numpy (>=1.21.6) ; extra == 'dev'
- tensorflow (==2.11.0) ; extra == 'dev'
- jax (>=0.3.25) ; extra == 'dev'
- flax (>=0.6.3) ; extra == 'dev'
- jaxlib (>=0.3.25) ; extra == 'dev'
- paddlepaddle (>=2.4.1) ; extra == 'dev'
- black (==22.3) ; extra == 'dev'
- isort (>=5.5.4) ; extra == 'dev'
- flake8 (>=3.8.3) ; extra == 'dev'
- click (==8.0.4) ; extra == 'dev'
- setuptools-rust (>=1.5.2) ; extra == 'dev'
- huggingface-hub (>=0.12.1) ; extra == 'dev'
- pytest (>=7.2.0) ; extra == 'dev'
- pytest-benchmark (>=4.0.0) ; extra == 'dev'
- h5py (>=3.7.0) ; extra == 'dev'
- jax (>=0.3.25) ; extra == 'jax'
- flax (>=0.6.3) ; extra == 'jax'
- jaxlib (>=0.3.25) ; extra == 'jax'
- numpy (>=1.21.6) ; extra == 'numpy'
- paddlepaddle (>=2.4.1) ; extra == 'paddlepaddle'
- tensorflow (==2.11.0) ; extra == 'pinned-tf'
- black (==22.3) ; extra == 'quality'
- isort (>=5.5.4) ; extra == 'quality'
- flake8 (>=3.8.3) ; extra == 'quality'
- click (==8.0.4) ; extra == 'quality'
- tensorflow (>=2.11.0) ; extra == 'tensorflow'
- setuptools-rust (>=1.5.2) ; extra == 'testing'
- huggingface-hub (>=0.12.1) ; extra == 'testing'
- pytest (>=7.2.0) ; extra == 'testing'
- pytest-benchmark (>=4.0.0) ; extra == 'testing'
- h5py (>=3.7.0) ; extra == 'testing'
- numpy (>=1.21.6) ; extra == 'testing'
- torch (>=1.10) ; extra == 'torch'
|
Installation
pip install safetensors
Usage
Numpy
from safetensors.numpy import save_file, load_file
import numpy as np
tensors = {
"a": np.zeros((2, 2)),
"b": np.zeros((2, 3), dtype=np.uint8)
}
save_file(tensors, "./model.safetensors")
# Now loading
loaded = load_file("./model.safetensors")
Torch
from safetensors.torch import save_file, load_file
import torch
tensors = {
"a": torch.zeros((2, 2)),
"b": torch.zeros((2, 3), dtype=torch.uint8)
}
save_file(tensors, "./model.safetensors")
# Now loading
loaded = load_file("./model.safetensors")
Developing
# inside ./safetensors/bindings/python
pip install .[dev]
Should be enough to install this library locally.
Testing
# inside ./safetensors/bindings/python
pip install .[dev]
pytest -sv tests/