Blog / Software Development

Setting up additional entropy for your Ubuntu VPS with haveged

June 28, 2020

We've recently ran into an issue with one of our staging servers where a scheduled cron job would occassionally hang for a few minutes before executing.  The issue turned out to be due to a low entopy (i.e. randomness) value in /proc/sys/kernel/random/entropy_avail.

Randomness in Linux is generated from hardware interrupts such as the keyboard, mouse, and disk/network IO.  This goes into a pool which then gets consumed by applications that require randomness for security, such as …

The Joy of Refactoring

October 4, 2019

I spent a good part of last month refactoring a decent portion of the codebase of our Shopify data exporter app, EZ Exporter.

There are 3 main motivations I decided to invest this much time in refactoring:

  • Optimization.
  • Preparing the codebase for new features.
  • Reduce maintenance cost/complexity/technical debt.

Refactoring is the process of improving the code's structure and design, which I actually quite enjoy. I'm a bit of a minimalist and I find cutting …

Easily convert XML data to a Python dict with xmltodict

September 1, 2019

I hate working with XML mainly because I find it difficult to read.

There's a popular Python package for parsing XML called lxml which is very flexible, but I found xmltodict much better suited and easier to use for what I needed to do.

We have a inventory management app for Shopify, EZ Inventory, and one of the features we've added recently is XML support. We have a few customers whose suppliers can only …

Dealing with datetime objects and time zones in Python 3

June 29, 2019

Working with datetime objects and time zones is one of those things I always struggle with when writing code in Python. I always have to look things up and double check the outputs (such as making sure daylight savings time was taken into account) to make sure I'm doing things correctly.

This blog post is really more of a reference for myself when making adjustments to datetime objects that involve time zones so I won't …

How to reset the primary key sequence in PostgreSQL with Django

March 19, 2019

I was working on some fairly big features involving new Django models for one of our apps and when I pushed to our staging environment, I got this error during deployment at the database migration step:

duplicate key value violates unique constraint "auth_permission_pkey" DETAIL: Key (id)=(55) already exists

It looks like new records were getting added to the auth_permission table. I was puzzled as I didn't make any changes related to the Django auth app. …

Older