Posts

  • IoT 101 - Part 3: Dynamic Web Pages with AngularJS, Kafka and Flask

    In the last two episodes, we talked about creating a simple IoT-like service, using Kafka to produce and consume messages in real-time and Flask to create a REST API to allow us producing messages via HTTP and consume them using server-sent events (SSE). In the end, we managed to get our messages pushed to clients using SSE, and now it is time to have a closer look at the client code.

  • IoT 101 - Part 2: Kafka, Flask, and Server-Sent Events

    In the last episode, we wrote some simple code to produce messages in Apache Kafka via a RESTful API, implemented using the amazing Flask framework. If you have followed the post and written some code yourself, you might now want to put it into action. We assume you have Kafka fired up and written and started up a simple Flask app as described before.

  • IoT 101 - Flask and Kafka

    These days the internet of things (IoT) is virtually everywhere you look. And as it is often with things approaching the peak of the hype cycle, many seem to struggle to explain what the heck IoT really is. A common denominator seems to be that in the future our fridge will talk to our phone to remind us to buy milk once we are in the supermarket and your house will turn the heat up/AC on when you’re about to get home. Only that the future is now and that some of those technologies are here today (let’s leave out the discussion that companies really struggle to actually sell them to customers).

  • Grouping Conflicts in Africa, Spark Edition

    In the last two posts I did some exploration of a fascinating data set published by the Armed Conflict Location & Event Data Project (ACLED). You can find the code I used on github. The ACLED data lists incidents in armed conflicts all over Africa and some countries in South and Southeast Asia, since 1997 and in great detail.

  • Data Science For a Cause, Grouping Conflicts in Africa

    Last time we started looking at a fascinating data set from the Armed Conflict Location & Event Data Project (ACLED), that lists incidents in armed conflicts all over Africa and some countries in South and Southeast Asia, since 1997 and in great detail. Make sure you have a look, if you like you can download my code from github in order to get you started.

  • Armed Conflicts in Africa, Illustrated in R

    Sometimes (most of the time), a data scientist’s life may seem like fun and games. But sometimes, we have to deal with the graver topics in life. Like armed conflicts.

  • A Data Scientist's Toolbox, Part 3: Mock Your Data!

    After we’ve discussed the importance of testing, you probably have the feeling that it’s a good idea, on general grounds, but your code is really tough to test. You have all these dependencies and your app writes to a database, and you have to load your data. So, yea. Not doable. Or so you think.

subscribe via RSS