Cloud405
Cloud + DevOps + Systems
Field notes on cloud infrastructure, DevOps automation, and systems engineering — by Josh Lewis.
- 39posts
- 3categories
- 5series
- 2024-02-232026-08-25
~/series/
Multi-part runs. Each one is listed below in part order, inside its category.
All posts by category
~/posts/Cloud/
10 entries- Ask Your AWS Account Anything: Building a Read-Only MCP Server It’s been a while since my last post, and the thing that’s changed most in that gap is how much of my day-to-day work now involves AI assistants. One pattern I keep running into: I’m in the middle of something and need a quick answer abo...
- Google Apps Script Real World Use Case If you’re like me and occasionally receive scanned documents or attachments that need to be stored safely, automating this process can save time and reduce manual effort. In this guide, I’ll walk you through how to automatically save att...
- Use the cloudposse/label Terraform Module Effective management of cloud infrastructure involves organizing and naming resources consistently. The cloudposse/label Terraform module simplifies the creation of standardized labels and tags for your resources, ensuring consistency ac...
- Terraform Drift Detection: Ensuring Your Infrastructure Stays in Sync In the dynamic world of cloud infrastructure, maintaining the desired state of your resources is crucial. Terraform, a powerful Infrastructure as Code (IaC) tool, helps manage your infrastructure declaratively. However, changes made outs...
- Serverless Basics with AWS Lambda + API Gateway Serverless architecture has become a popular way to build and deploy applications without having to manage the underlying infrastructure. AWS Lambda, combined with API Gateway, provides a robust platform for creating scalable, cost-effec...
- Exploring Azure Arc Azure Arc is a groundbreaking service from Microsoft that extends Azure’s management capabilities to resources across hybrid and multi-cloud environments. This includes servers, Kubernetes clusters, and data services located outside of A...
- Streamlining IaC: Why CDKtf Is The Better Choice As the demand for more sophisticated and scalable infrastructure management solutions increases, the tools and frameworks we use to manage these resources also evolve. The Cloud Development Kit for Terraform (CDKtf) is one such innovatio...
- Leveraging OIDC for Secure GitHub Actions Workflows In the realm of modern software development, Continuous Integration/Continuous Deployment (CI/CD) strategies play a crucial role in enabling rapid and reliable software delivery. However, the traditional approach of using static credenti...
- Mastering Terragrunt: Simplifying Terraform Management As Terraform grows in popularity for managing infrastructure as code, tools that enhance its usability and manageability become increasingly valuable. Terragrunt is one such tool, designed to work as a wrapper, providing extra tools and ...
- Harnessing the Power of Terraform Modules for AWS and Azure Terraform is an incredibly powerful tool for managing infrastructure as code. It not only supports multiple cloud providers such as Amazon Web Services (AWS) and Microsoft Azure but also allows you to create reusable components known as ...
~/posts/DevOps/
12 entries- The GPU Your Cluster Thinks Is Busy Most of the AI infrastructure writing I read is about getting GPUs. Quota requests, spot capacity, which instance family is actually available in your region this week. Very little of it is about the GPUs you already have and aren’t using.
- Streamlining Your Git Workflow As developers, we often face decision fatigue from the multitude of choices we need to make daily. Streamlining routine tasks like committing and pushing code changes can significantly reduce cognitive load and improve productivity. One ...
DevOps/
10 parts, in order
- DevOps part 1: IaC with Terraform and AWS In the realm of DevOps and cloud computing, the ability to automate the provisioning and management of infrastructure is a game-changer. Infrastructure as Code (IaC) has revolutionized how we deploy and manage our cloud resources, making...
- DevOps part 2: Setting Up Amazon EKS Following our setup of the foundational AWS infrastructure using Terraform, we now turn our attention to the heart of our cloud-native microservices architecture: Amazon Elastic Kubernetes Service (EKS). Amazon EKS simplifies the process...
- DevOps part 3: Managing Microservices with Helm As we dive deeper into our journey of building a scalable microservices architecture on Amazon EKS, we encounter the challenge of managing multiple microservices and their deployments efficiently. This is where Helm, the Kubernetes packa...
- DevOps part 4: Monitoring with Prometheus and Grafana As our microservices architecture on Amazon EKS matures, gaining visibility into its health, performance, and efficiency becomes indispensable. This is where an effective observability strategy comes into play, with Prometheus and Grafan...
- DevOps part 5: Istio for Advanced Traffic Management In the modern microservices landscape, managing communication and network traffic between services becomes increasingly complex. Istio, an open-source service mesh, addresses these challenges by providing a layer that sits between your s...
- DevOps part 6: CI/CD Pipelines for Kubernetes In the realm of cloud-native development, Continuous Integration and Continuous Deployment (CI/CD) stand out as crucial practices for achieving speed and efficiency in software delivery. As we progress with our Amazon EKS microservices a...
- DevOps part 7: Advanced Monitoring and Alerting with Prometheus Having established a basic observability framework with Prometheus and Grafana in our Amazon EKS environment, it’s time to leverage Prometheus’s full capabilities for advanced monitoring and alerting. This enables us to proactively manag...
- DevOps part 8: Security Best Practices for Kubernetes and Istio In the evolving landscape of cloud-native technologies, security remains a paramount concern, especially for applications deployed on Kubernetes clusters like Amazon EKS. As we dive into the eighth installment of our series, we focus on ...
- DevOps part 9: Implementing Auto-Scaling in Amazon EKS Efficiently managing application scalability in response to user demand is a critical aspect of cloud-native application development. Amazon Elastic Kubernetes Service (EKS) supports this through manual scaling and auto-scaling capabilit...
- DevOps part 10: Disaster Recovery and High Availability Strategies As we conclude my series on deploying and managing microservices on Amazon EKS, we turn our focus to the crucial aspects of disaster recovery (DR) and high availability (HA). Ensuring that your application can withstand and quickly recov...
~/posts/Systems/
17 entries- Real-World Database Management Understanding the theory behind Linux and database management is crucial, but seeing these concepts applied in real-world scenarios can be even more enlightening. This post will share case studies of real-world projects involving Linux a...
- Securing Your Databases Securing your databases is crucial to protect sensitive information and ensure the integrity and availability of your data. This post provides comprehensive security guidelines for PostgreSQL, MySQL, MongoDB, and Redis, covering aspects ...
- Advanced Linux Security and Automation As a systems engineer, mastering advanced Linux administration topics is crucial for ensuring the security, reliability, and efficiency of your servers. This post delves into essential aspects of advanced Linux administration, including ...
- Monitoring and Tuning Linux and Databases Ensuring optimal performance for your Linux systems and databases is crucial for maintaining the efficiency and reliability of your applications. This post will explore tools and techniques for monitoring Linux systems and databases, and...
Redis/
2 parts, in order
- Redis part 1: Installing and Configuring Redis is an open-source, in-memory data structure store that is widely used for its high performance, scalability, and versatility. It supports various data structures like strings, hashes, lists, sets, and more. This guide will walk you...
- Redis part 2: Key-Value Operations and Data Structures Redis Basics: Key-Value Operations and Data Structures
MongoDB/
2 parts, in order
- MongoDB part 1: Installation and Configuration MongoDB is a powerful, open-source NoSQL database known for its scalability, flexibility, and ease of use. Unlike traditional relational databases, MongoDB stores data in a flexible, JSON-like format called BSON (Binary JSON). This post ...
- MongoDB part 2: CRUD Operations and Indexing In the previous post, we covered the installation and basic configuration of MongoDB on a Linux server. Now, let’s delve deeper into MongoDB’s core functionalities by exploring CRUD (Create, Read, Update, Delete) operations and indexing ...
MySQL/
2 parts, in order
- MySQL part 1: Installation and Configuration MySQL is a popular open-source relational database management system (RDBMS) known for its reliability, scalability, and ease of use. This guide will walk you through the process of installing and configuring MySQL on a Linux server, cov...
- MySQL part 2: Essential Commands and Operations After setting up MySQL on your Linux server, the next step is to become proficient in managing your databases. This post will cover essential MySQL tasks, such as creating databases and tables, executing queries, and provide performance ...
PostgreSQL/
2 parts, in order
- PostgreSQL part 1: Setup and Configuration PostgreSQL is a powerful, open-source relational database management system (RDBMS) known for its robustness, extensibility, and SQL compliance. Whether you’re a developer, database administrator, or systems engineer, setting up PostgreS...
- PostgreSQL part 2: Basic Operations and Management After setting up PostgreSQL on your Linux server, the next step is to become proficient in performing basic operations and managing your databases. This post will guide you through essential PostgreSQL tasks, including creating databases...
- Understanding Databases: An Overview of SQL and NoSQL Databases are the backbone of modern applications, providing the necessary infrastructure to store, manage, and retrieve data efficiently. There are two primary types of databases: SQL (Structured Query Language) and NoSQL (Not Only SQL)...
- Automating with Bash In the previous post, we covered the basics of navigating and managing files in Linux. Now, it’s time to take your Linux skills to the next level by learning how to automate tasks using shell scripting. Bash, the Bourne Again Shell, is a...
- Linux Essentials Linux has become a cornerstone in the world of systems engineering, offering unmatched flexibility, security, and performance. Whether you’re managing servers, developing applications, or automating tasks, understanding Linux is crucial ...
- Create a URL Status Page for Any Network Monitoring the uptime and responsiveness of internal services is crucial for any organization relying on private networks for their operations. Leveraging open-source tools like Statsig-io’s Statuspage can provide a transparent and effic...
- Automating a Disconnected WSUS
total 39 — subscribe via RSS