Data Engineering

Building scalable data-driven pipelines is crucial to get your Machine Learning model deployed in production. Grab our insights!

TensorFlow 1.0 is here. Let’s do some Deep Learning on the AWS!

After long development, Google released the first stable version of its Machine Learning library, TensorFlow The release is an important milestone in the development of a common Machine Learning toolkit. TensorFlow provides a set of primitives from which Machine Learning engineers and researchers can construct trainable models — as well as »

10+ Things I Wish I Knew About Elasticsearch

We have recently finished an innovative, data-driven project based on Elasticsearch. The aim was to find similarities between objects across sets. Sets were static, although they were a decent size (90+ million records) and there was a requirement that search was fast (nearly instant) - so Elasticsearch was the best »

My experience with Docker Swarm - when you may need it?

In this post I'm going to analyze Docker role in each stage of application lifecycle, and try to highlight cases when you should consider moving to Swarm. It's not a getting started tutorial, but I'll create one in future. Development with Docker Docker really made my life much easier. Let's »

Setting up SSL with NGINX and LetsEncrypt for your website

We all know that sweet green padlock in our browsers, meaning that our connection to a website is secure. Don't underestimate encrypted connection! Without it, all data is sent in plain text. It's very dangerous if your site handles secret data, like passwords or emails. Recently, my colleague from work »

Automatic code quality checks with git hooks

We all strive to achieve great quality code. Every language allows us to run some quality checks or automatic unit tests. But even best tests won't help, if they aren't run often. Remember! If something takes too much time or effort, people will avoid it! Solution? We can reverse that! »

PDF Forms: the smart way of filling them using Python

Recently at Sigmoidal we had a curious case of filling PDF forms for our users. They can print them out pre-filled by us and use. We had plenty of those forms to set up, so an efficient way of doing it was required. Solution 0 — Putting Texts In Python The »