Christoph Eicke

IP Authentication: A Tale of Performance Pitfalls and Challenges in Prod

They cached 72 million IPs to fix a performance bug, but the system kept failing. The real root cause was far more subtle.

IP Authentication: A Tale of Performance Pitfalls and Challenges in Prod
#1about 1 minute

The case against IP-based authentication for microservices

Migrating a PHP monolith to microservices revealed the fundamental problems with using IP-based authentication, a method you should avoid.

#2about 6 minutes

Understanding the mechanics and tradeoffs of IP authentication

IP authentication simplifies user access for large institutions by mapping an IP address to a user, but it creates issues with user tracking, licensing, and technical complexity.

#3about 3 minutes

Investigating initial deployment failures and performance issues

The first two production deployments failed due to massive error spikes, leading to an architectural change from a slow MySQL database lookup to a faster Redis cache.

#4about 2 minutes

Adopting a fail forward strategy to debug in production

After repeated failures, the team decided to stop rolling back and instead collaborated directly with customers in screen-sharing sessions to diagnose the issue live.

#5about 2 minutes

Discovering the root cause of the infinite redirect loop

The core problem was that legacy and new AWS accounts read the user's IP from different headers, causing a mismatch that sent cookieless bots into an infinite redirect loop.

#6about 2 minutes

How proxies and data entry errors break assumptions

The investigation revealed that academic and corporate proxies often rewrite URLs and strip cookies, and a simple data entry error in the CRM granted access to 1.5% of the internet.

#7about 1 minute

Lessons in collaborative problem-solving and architecture evolution

Using mob programming sessions during the crisis strengthened the team, and the final architecture evolved from Lambda to Fargate for cost and performance reasons.

Related jobs
Jobs that call for the skills explored in this talk.

test

Milly
Vienna, Austria

Intermediate

test

Milly
Vienna, Austria

Intermediate

Featured Partners

Related Articles

View all articles
CH
Chris Heilmann
Dev Digest 134 - Where pixels sing?
News and ArticlesWeAreDevelopers LIVE Data and Security Day is on Wednesday, 25/09/2024. Learn about OPC UA Updates, Best Practices for Using GitHub Secrets, Passwordless Web 1.5, Emerging AI Security Risks, Data Privacy in LLMs and get a chance to t...
Dev Digest 134 - Where pixels sing?
CH
Chris Heilmann
Dev Digest 116 - WWWAI?
This time, learn how to un-AI Google's search results, what's new on the web, avoid a new security hole and go back to BASICS with us. News and ArticlesWhat a week. Google, Microsoft, OpenAI and many others had their big flagship events announcing th...
Dev Digest 116 - WWWAI?
CH
Chris Heilmann
Dev Digest 138 - Are you secure about this?
Hello there! This is the 2nd "out of the can" edition of 3 as I am on vacation in Greece eating lovely things on the beach. So, fewer news, but lots of great resources. Many around the topic of security. Enjoy! News and ArticlesGoogle Pixel phones t...
Dev Digest 138 - Are you secure about this?

From learning to earning

Jobs that call for the skills explored in this talk.