estela

An elastic and scalable web scraping
open-source cluster


Check out the Repo

Our Solution


estela is an open-source elastic web scraping cluster running on Kubernetes. It provides mechanisms to deploy, run and scale web scraping spiders via a REST API and a web interface.

Clients and users interested in web scraping can orchestrate and run their spiders (e.g., Scrapy spiders). estela aims to be versatile, to the point that you can deploy it in-home.