@arfonzo
Welp it's almost 5:30AM, but I'm done! Visor has gone from 1 -> 3 worker nodes. Nodes service the processing, categorization and taxonomy of OSINT news. I'm still working through the metrics but I have *ALMOST* achieved a 3X in feed processing ingestion in the queue, which is pretty fucking insane given the overhead in orchestrating workers... and shipping I/O between the workers' remote locations across the globe. I'm so fucking nerdy that I might spend the next week just talking about load balancing algos I architected for this. ๐ค๐๐๐
Absolutely chuffed with it. Ingestion rounds used to take on average over 3 minutes (~188s), and we're now down to ~64s median.
The TL;DR is that you get more news, faster.
Now that this is done, I will be looking at onboarding many more news sources, as feed processing and ingestion was a massive blocker--now unlocked!
It also means, I think, we're basically ready to open registrations to the public!
HUZZAH! ๐ป๐๏ธ๐๏ธ๐๏ธ