A tale of Goblins and Streams
At QCon 2014, LinkedIn gave a talk ( slides ) about their Gobblin projec t (as well as published a blog post ). Gobblin is a unified data ingestion system, aimed at providing Camus -like capabilities for sources other than Kafka. While Gobblin is a fascinating piece of engineering, what I find to be no less fascinating is the direction LinkedIn has chosen by going for a system like Gobbblin.