Python Pandas使用modin加速 Windows版本

安装

Windows上的安装步骤，依顺序运行下面命令，因为有些依赖库下载较慢，所以使用豆瓣源进行加速。

pip install modin -i https://pypi.douban.com/simple

pip install modin[dask] -i https://pypi.douban.com/simple

pip install py -i https://pypi.douban.com/simple

pip install pyarrow -i https://pypi.douban.com/simple

pip install distributed -i https://pypi.douban.com/simple

使用

方法一

import os

os.environ["MODIN_ENGINE"] = "dask"  # Modin will use Dask

import modin.pandas as pd

方法二

from distributed import Client
client = Client(n_workers=6)  # Modin will connect to the Dask Client
import modin.pandas as pd

文档

https://modin.readthedocs.io/en/latest/index.html#

https://github.com/modin-project/modin