Infrastructure
Need to monitor Spark Streaming models?
Get a look at a prototype developed by Gauthier at dataroots.
He combined multiple open-source technologies (Kafka, Spark, Elasticsearch, ..) to offer near real-time monitoring of machine learning models through customizable dashboards!
It’s open-source and reproducible 🙂
Have a look at the GitHub repository and play around with the solution yourself: github.com/datarootsio/deploy-spark-streaming-ml