estela is an open-source elastic web scraping cluster running on Kubernetes. It provides mechanisms to deploy, run and scale web scraping spiders via a REST API and a web interface.

Clients and users interested in web scraping can orchestrate and run their spiders (e.g., Scrapy spiders). estela aims to be versatile, to the point that you can deploy it in-home.