I want to monitor all Crawlee crawlers. To do this I looked for a dashboard to control the crawlers. I only found this distributed web crawler management platform: Crawlab (https://github.com/crawlab-team/crawlab).
In order to make a dashboard, you'd need a centralized location where you could store data about each crawler. A SQL or Mongo database would be great for this.
You could have a server hosted on one of your rasp pis that serves as an API for storing data about crawlers. When a new crawler is started, a new row could be added to the "crawlers" table by sending a request from the crawler to your API.
Then, you could create some sort of UI service with Electron or React Native that uses your API.
With this custom solution, you could make the dashboard as minimalistic or as robust as you like. You'd have full control. And everything would be hosted locally.