Sergeyshinder

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Sergey Shinder

Nov 12

One finance report ran our database host out of memory and Postgres dropped every connection

#sergeyshinder #postgres #linux #sre

2 min read

Sergey Shinder

Nov 12

We removed replicas from our manifest for the autoscaler and checkout dropped to one pod

#sergeyshinder #kubernetes #autoscaling #deployment

2 min read

Sergey Shinder

Nov 12

RabbitMQ took our booking job back after thirty minutes and gave it to the other consumer

#sergeyshinder #rabbitmq #integration #messaging

2 min read

Sergey Shinder

Nov 11

Our latency alert summed away the bucket label and never returned a value

#sergeyshinder #prometheus #monitoring #observability

2 min read

Sergey Shinder

Nov 11

We moved our portal build to Vite and stopped type checking for four months

#sergeyshinder #cicd #typescript #vite

2 min read

Sergey Shinder

Nov 11

Ansible updated our servers five at a time and kept going after most of each batch failed

#sergeyshinder #ansible #iac #deployment

2 min read

Sergey Shinder

Nov 11

Our new Compose project took a carrier's address range and the host stopped reaching them

#sergeyshinder #docker #networking #containers

2 min read

Sergey Shinder

Nov 10

We gave our notification executor fifty threads and it sent everything on one

#sergeyshinder #java #spring #sre

2 min read

Sergey Shinder

Nov 10

Our request graph showed thousands of calls a second because gunicorn had four counters

#sergeyshinder #prometheus #python #observability

2 min read

Sergey Shinder

Nov 10

Our two person rule for production deploys let people approve their own runs

#sergeyshinder #cicd #githubactions #security

2 min read

Sergey Shinder

Nov 10

Our carrier rotated our API secret and the longer one broke our header in two

#sergeyshinder #integration #bash #http

2 min read

Sergey Shinder

Nov 10

We scaled our pricing service to twelve pods and the first four kept every request

#sergeyshinder #kubernetes #grpc #loadbalancing

2 min read

Sergey Shinder

Nov 9

Our uptime check stayed green for forty minutes because CloudFront was answering it

#sergeyshinder #monitoring #aws #observability

2 min read

Sergey Shinder

Nov 9

One slow report kept marking our web servers down for ten seconds at a time

#sergeyshinder #sre #nginx #reliability

2 min read

Sergey Shinder

Nov 9

Our largest partner's access token outgrew a header buffer and every call came back 400

#sergeyshinder #integration #api #nginx

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.