With four more recommendations — Software Architecture is the activity of designing software components and interactions between them. Software is in constant evolution, an architect is responsible for conducting this evolution and maintaining the whole system's integrity. The following books are my top 5 as a software srchitect. There is a lot of valuable books…

Understand the basics of the underlying components and systems behind one of the most-used technologies for development — If you have arrived recently in the wonderful world of containers, or if you have been here for some time, probably it is not a bad idea to understand the underlying system and elements that work together to offer the huge benefits of Docker. Understanding the Basics Image or Container?

Kubernetes is an open source platform for deploying and managing containers. It provides a container runtime, container orchestration, container-centric infrastructure orchestration, self-healing mechanisms, service discovery and load balancing. It’s main applications are deployment, scaling, management, and composition of application containers across clusters of hosts. But Kubernetes is more than just…

Kelvin Jiang |Software Engineer; Keshava Subramanya | Engineering Manager; Yeming Shi | Software Engineer, Ads Intelligence Introduction Pinterest is a visual discovery engine that helps Pinners find inspirational ideas. Advertisers use Pinterest to connect with Pinners on these journeys to inspiration, and seek to promote products or services efficiently. The Ads…

Details of the application Overview PayPal is in the process of migrating its analytical workloads to Google Cloud Platform (GCP). As part of the migration, our team designed and developed a streaming application which consumes data from Kafka and streams it directly to BigQuery. This application is critical to PayPal as most of the…

Nikil Pancha | Software Engineer; Andrew Zhai | Software Engineer; Chuck Rosenberg | Head of Advanced Technologies Group; and Jure Leskovec | Chief Scientist, Advanced Technologies Group Pinterest surfaces billions of ideas to people every day, and the neural modeling of embeddings for content, users, and search queries are key…

From the moment I took over the role of technology architect, I’ve been wondering why certain decisions were made instead of other options. Visio diagrams are great, but they’re nothing but pictures. …

With fast-paced technology evolution, software architecture is evolving each day with new patterns and technology choices. This article summarizes the top 10 tips you should know as a modern software architect and the list is not limited but evolving. #1 — Be observant of frameworks providing acceleration towards Microservices Architecture (MSA) With Microservices Architecture in mainstream adoption, most of the frameworks either…

A disclaimer: There have been many articles written about becoming a Software Architect out there (some of my favourites when I started the role was this article “The Path to Becoming a Software Architect”). …

Co-Authored with: Vipul Sodha A scalable and feature-rich log management and exploration platform is imperative for the successful operations of any medium to large backend engineering team. It is one of the most important, but often neglected tool for infrastructure observability. …

Recently I was talking to one of the Senior Software Engineers I work with at RVU regarding how we can get him more involved in the planning of our system architecture. As part of this, I wanted to point him to some resources on system architecture, my focus was identifying…

We want to make it easy for Netflix members to find great content to fulfill their unique tastes. To do this, we follow a data-driven algorithmic approach based on machine learning, which we have described in past posts and other publications. We aspire to a day when anyone can sit…

When I hear someone say “we’re about to create new service X,” it’s often followed by: “it’ll use a simple CRUD interface for the V0.” While this design approach appealed to me once upon a time, increasingly I’ve started to feel like it’s not the best design fit. …

By Andrew Nguonly, Armando Magalhães, Obi-Ike Nwoke, Shervin Afshar, Sreyashi Das, Tongliang Liu, Wei Liu, Yucheng Zeng Background Over the next few years, most content on Netflix will come from Netflix’s own Studio. From the moment a Netflix film or series is pitched and long before it becomes available on Netflix…

After using Istio in production for almost 2 years, we’re saying goodbye to it. Learn why, as well as the current state of the Service Mesh Wars. — Let’s get some of the basics out of the way. Why use a service mesh? It provides traffic monitoring between your micro-services, including a map of service communication and http status codes occurring between them. Adding a service mesh enables you to add mTLS, or in other words, encrypted http…

Microservices architecture has been evolving a lot during the last couple of years and there are quite a few new concepts and patterns are emerging. ‘Service Mesh’ concept is getting quite popular. …