Data Engineering

Building scalable data-driven pipelines is crucial to get your Machine Learning model deployed in production. Grab our insights!

TensorFlow 1.0 is here. Let’s do some Deep Learning on the AWS!

After long development, Google released the first stable version of its Machine Learning library, TensorFlow The release is an important milestone in the development of a common Machine Learning toolkit. TensorFlow provides a set of primitives from which Machine Learning engineers and researchers can construct trainable models — as well as »

My Experience with Docker Swarm - How to know when you might need it

In this post I'm going to analyze the role of Docker in each stage of the application lifecycle and try to highlight cases when you should consider moving to Swarm. It's not an introduction tutorial, but I'll create one in the future. Development with Docker Docker really made my life »

10+ Things I Wish I Knew About Elasticsearch

We have recently finished an innovative, data-driven project based on Elasticsearch. The aim was to find similarities between objects across sets. Sets were static, although they were a decent size (90+ million records) and there was a requirement that search was fast (nearly instant) - so Elasticsearch was the best »

Setting up SSL with NGINX and LetsEncrypt for your website

We all know that sweet green padlock in our browsers, meaning that our connection to a website is secure. Don't underestimate encrypted connection! Without it, all data is sent in plain text. It's very dangerous if your site handles secret data, like passwords or emails. Recently, my colleague from work »

Automatic code quality checks with git hooks

We all strive to achieve great quality code. Every language allows us to run some quality checks or automatic unit tests. But even best tests won't help, if they aren't run often. Remember! If something takes too much time or effort, people will avoid it! Solution? We can reverse that! »

PDF Forms: the smart way of filling them using Python

Recently at Sigmoidal we had a curious case of filling PDF forms for our users. They can print them out pre-filled by us and use. We had plenty of those forms to set up, so an efficient way of doing it was required. Solution 0 — Putting Texts In Python The »