elastic/eland

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

71
/ 100
Verified

This project helps data scientists and analysts work with very large datasets stored in Elasticsearch as if they were standard Pandas DataFrames. You can perform data exploration, filtering, and aggregations on your Elasticsearch data directly, without loading it all into your local machine's memory. It also enables you to upload trained machine learning models (like scikit-learn, XGBoost, LightGBM) from Python into Elasticsearch for scalable inference.

694 stars. Used by 1 other package. Actively maintained with 2 commits in the last 30 days. Available on PyPI.

Use this if you need to analyze or perform machine learning with large datasets residing in Elasticsearch, but prefer the familiar Pandas or scikit-learn syntax in Python.

Not ideal if your data is not stored in Elasticsearch or if you require highly custom, low-level control over Elasticsearch queries that go beyond a DataFrame-like abstraction.

data-analysis large-scale-data machine-learning-ops data-exploration elastic-stack
Maintenance 13 / 25
Adoption 11 / 25
Maturity 25 / 25
Community 22 / 25

How are scores calculated?

Stars

694

Forks

107

Language

Python

License

Apache-2.0

Last pushed

Mar 13, 2026

Commits (30d)

2

Dependencies

5

Reverse dependents

1

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/elastic/eland"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.