I looked at the node_modules folder today. It’s 400MB. For a landing page. We’re done playing games. Back in my day, we managed memory. We cared about the heap. We knew where every byte lived and, more importantly, when it died. Now? I walk into this “modern” repository and it’s like walking into a landfill. … Read more
text [!] The following Swift pods are not compatible with ‘React-Core’ because they do not include an umbrella header: – Folly (from ../node_modules/react-native/third-party-podspecs/Folly.podspec) – glog (from ../node_modules/react-native/third-party-podspecs/glog.podspec) /Users/admin/project/ios/Pods/Headers/Public/React-Core/React/RCTBridgeDelegate.h:12:9: error: ‘React/RCTJavaScriptLoader.h’ file not found import ^~~~~~~~~~~~~~~~~~~~~~~~~~~~ 1 error generated. ** BUILD FAILED ** The following build commands failed: CompileC /Users/admin/Library/Developer/Xcode/DerivedData/Project-abc/Build/Intermediates.noindex/Pods.build/Debug-iphonesimulator/React-Core.build/Objects-normal/x86_64/RCTBridge.o /Users/admin/project/node_modules/react-native/React/Base/RCTBridge.m normal x86_64 objective-c com.apple.compilers.llvm.objc.1_0.compiler (1 … Read more
Python in Production: Why Your “Best Practices” Are Killing My On-Call Rotation It was 3:15 AM on a Tuesday in 2019. I was staring at a Grafana dashboard that looked like a heart attack. Our main API, a Python service handling checkout flows for a major e-commerce client, was throwing 504s across three availability zones. … Read more
The Grave We Dug with Default Dockerfiles A Technical Post-Mortem and Remediation Guide $ docker build -t api-service:latest . [+] Building 412.4s (9/12) => [internal] load build definition from Dockerfile 0.1s => [internal] load .dockerignore 0.1s => [internal] load metadata for docker.io/library/node:latest 1.2s => [1/8] FROM docker.io/library/node:latest 0.0s => [2/8] WORKDIR /app 0.5s => [3/8] … Read more
text $ kubectl get pods -n prod-core NAME READY STATUS RESTARTS AGE api-gateway-7f5d8b9-x2k9l 0/1 CrashLoopBackOff 42 14m order-processor-0 0/1 Pending 0 72h order-processor-1 0/1 Pending 0 72h payment-service-5d4f9c8-m1n2b 0/1 CreateContainerConfigError 0 12m $ kubectl describe pod order-processor-0 Events: Type Reason Age From Message —- —— —- —- ——- Warning FailedScheduling 3m (x450 over 72h) default-scheduler … Read more
text $ npx react-native run-ios –scheme “FlagshipApp” info Found Xcode workspace “FlagshipApp.xcworkspace” info Building (fe) error Failed to build iOS project. We ran “xcodebuild” command but it exited with error code 65. To debug build logs further, consider building your app via Xcode.app directly. ** BUILD FAILED ** The following build commands failed: PhaseScriptExecution [CP-User]\ … Read more
Sit down, kid. We’re going to talk about why your “magic box” is just a fancy wrapper for a process. Stop looking at your watch. It’s 3:00 AM, the AC in this rack room has been dead since Tuesday, and that blinking amber light on the SAN is the only thing keeping me awake. You’ve … Read more
INTERNAL POST-MORTEM: INCIDENT #8842-BRAVO DATE: Monday, October 16, 2023 DURATION: 72 Hours, 14 Minutes TOTAL ESTIMATED LOSS: $85,422.19 (Infrastructure Egress + Compute Over-provisioning + Lost Revenue) STATUS: SEV-0 (Mitigated, Not Resolved) AUTHOR: Senior SRE (Platform Reliability Team) 1. THE INCIDENT SUMMARY TIMESTAMP: 2023-10-13 23:43:12 UTC The pager went off. I was three sips into a … Read more
json { “Version”: “2012-10-17”, “Statement”: [ { “Sid”: “ExplicitDenyAllExceptVPC”, “Effect”: “Deny”, “Principal”: ““, “Action”: “s3:“, “Resource”: [ “arn:aws:s3:::critical-prod-assets/“, “arn:aws:s3:::critical-prod-assets” ], “Condition”: { “StringNotEquals”: { “aws:SourceVpc”: “vpc-0a1b2c3d4e5f6g7h8” }, “Bool”: { “aws:PrincipalIsAWSService”: “false” } } }, { “Sid”: “AllowAppRoleAccess”, “Effect”: “Allow”, “Principal”: { “AWS”: “arn:aws:iam::123456789012:role/application-server-role” }, “Action”: [ “s3:GetObject”, “s3:PutObject” ], “Resource”: “arn:aws:s3:::critical-prod-assets/” } ] } The … Read more
TIMESTAMP: 2024-05-22 04:12:08 UTC STATUS: CRITICAL / DEGRADED INCIDENT ID: #8829-BETA-CASCADING-FAILURE OPERATOR: SRE_042 (COFFEE_LEVEL: CRITICAL) The hum of the data center fans is a sound I can hear even in my own apartment now. It’s a low-frequency vibration that lives in the base of my skull. I’ve been staring at a Grafana dashboard for forty-eight … Read more