An on-call developer’s worst nightmare (red indicates errors)

Member-only story

How I Scaled a Software System’s Performance By 35,000%

Dive into how I resolved a platform’s scaling, stability, and performance issues through caching, jobification, queue separation, and more.

Joseph Gefroh
Published in
21 min readJul 22, 2020

Processing over $20,000,000 in a single day

A previous company built payments systems and giving day software intended for massive giving days where we would receive tens of thousands of donations for a single campaign.

One of my responsibilities at that company was to scale the system and ensure it didn’t topple over. At its worst, it would crash on just 3–5 requests per second.

Due to a inefficient architectures, questionable technology choices, and rushed development, it had many constraints and was a patchwork of band-aids and gaping performance gaps. A combination of magical spells and incantations would keep the server running throughout the day.

By the time I was done with the platform, it had the potential to manage several thousand requests per second and run thousands of campaigns simultaneously, all for roughly the same operational cost.

How? I’ll tell you!

Analyzing the usage patterns

Create an account to read the full story.

The author made this story available to Medium members only.
If you’re new to Medium, create a new account to read this story on us.

Or, continue in mobile web

Already have an account? Sign in

The Startup
The Startup

Published in The Startup

Get smarter at building your thing. Follow to join The Startup’s +8 million monthly readers & +772K followers.

Joseph Gefroh
Joseph Gefroh

Written by Joseph Gefroh

VP of Product and Engineering @ HealthSherpa. Opinions my own. Moved to Substack. https://jgefroh.substack.com/

Responses (8)

What are your thoughts?

Nice read, a bit like a murder a mystery with plot twists’n’all. It also goes to show that there’s a lot more to coding than just solving the problem.

One of the best in-depth articles I read in a while. Thanks Joseph for sharing your journey. I enjoyed and learned a lot.

Excellent work Joseph...scaling systems and seeing them work is like bringing your own magic to life