Metadata-Version: 2.1
Name: infinistore
Version: 0.1.101
Summary: A kvcache memory pool
Home-page: https://github.com/bd-iaas-us/infiniStore
Description-Content-Type: text/markdown
Requires-Dist: torch
Requires-Dist: uvloop
Requires-Dist: fastapi
Requires-Dist: pybind11
Requires-Dist: uvicorn

[![Run pre-commit checks](https://github.com/bd-iaas-us/infiniStore/actions/workflows/pre-commit.yml/badge.svg)](https://github.com/bd-iaas-us/infiniStore/actions/workflows/pre-commit.yml)

## pre-required

* CUDA dev toolkit https://developer.nvidia.com/cuda-toolkit
* kernel moduel nv_peer_mem https://github.com/Mellanox/nv_peer_memory


## install

```
pip install infinistore
```

## run

```
infinistore
```
or
```
python -m infinistore.server
```
## build

```
apt install libuv1-dev
apt install libgtest-dev
apt install libmsgpack-dev
apt install libspdlog-dev libfmt-dev
apt install ibverbs-utils libibverbs-dev
pip install -e .
pip install pre-commit
pre-commit install
```
## client example

check example code ```infinistore/example/client.py```


## unit test

```
pytest infinistore/test_infinistore.py
```

## pre-commit

```
pre-commit run --all-files
```
