Awesome Microservices

A curated list of Microservice Architecture related principles and technologies.

Table of Contents

• Platforms
• Runtimes
• Service Toolkits
  • C
  • C++
  • D
  • Erlang VM
  • Go
  • Haskell
  • Java VM
  • Node.js
• Infrastructure
  • API Gateways / Edge Services
  • Configuration and Discovery
  • Security
  • Elasticity
  • Messaging
  • Serialization
  • Storage
  • Reactivity
  • Resilience
  • Monitoring and Debugging
  • Logging
• IT Automation / Provisioning
• Deployment and Continuous Integration
  • On-prem
  • Hosted
  • Lightweight
• Containers
• Documentation & Modeling
  • REST APIs
• Testing
• Standards / Recommendations
  • World Wide Web
  • HTTP/1.1
  • HTTP/2
  • RPC
  • Messaging
  • Security
  • Service Discovery
  • Data Formats
  • Unicode
• Real Life Stories
• Theory
  • Articles & Papers
  • Tutorials
  • Books
  • Sites
• Emerging Technologies
• License
• Contributing
• Acknowledgments

Platforms

• Cisco Microservices - Modern platform for rapidly deploying globally distributed services.
• Cocaine - A cloud platform enabling you to build your own PaaS clouds.
• Deis - Open-source application platform for public and private clouds.
• Fabric8 - Open-source integration platform for deep management of Java Containers (JVMs).
• H2 - Hailo's microservices platform.
• Hook.io - Open-source hosting platform for microservices.
• Netflix OSS - Netflix open-source software ecosystem.
• Spring Cloud Netflix - Provides Netflix OSS integrations for Spring Boot apps through autoconfiguration and binding to the Spring Environment and other Spring programming model idioms.
• VAMP - Build, deploy and manage microservices with power and ease.

Runtimes

• Akka - Toolkit and runtime for building highly concurrent, distributed, and resilient message-driven applications on the JVM.
• Erlang/OTP - Programming language used to build massively scalable soft real-time systems with requirements on high availability.
• Finagle - Extensible RPC system for the JVM, used to construct high-concurrency servers.
• Karyon - The nucleus or the base container for applications and services built using the NetflixOSS ecosystem.
• Microserver - Java 8 native, zero configuration, standards based, battle hardened library to run Java REST microservices.
• Orbit - Modern framework for JVM languages that makes it easier to build and maintain distributed and scalable online services.
• Service Fabric I/O - A microservices framework for the rapid development of distributed, resilient, reactive applications at scale.
• Vert.X - Toolkit for building reactive applications on the JVM.

Service Toolkits

C

• Kore - Easy to use web application framework for writing scalable web APIs in C.
• RIBS2 - Library which allows building high-performance internet serving systems.

C++

• AnyRPC - Provides a common system to work with a number of different remote procedure call standards, including: JSON-RPC, XML-RPC, MessagePack-RPC.
• C++ Micro Services - An OSGi-like C++ dynamic module system and service registry.

D

• Vibe.d - Asynchronous I/O that doesn’t get in your way, written in D.

Erlang VM

Elixir

• Phoenix - Framework for building HTML5 apps, API backends and distributed systems.
• Plug - A specification and conveniences for composable modules between web applications.

Erlang

• Cowboy - Small, fast, modular HTTP server written in Erlang.
• Gen Microservice - This library solves the problem of implementing microservices with Erlang.
• Mochiweb - Erlang library for building lightweight HTTP servers.

Go

• Gin - Web framework written in Golang.
• Gocraft - A toolkit for building web apps. Includes routing, middleware stacks, logging and monitoring.
• Go kit - Distributed programming toolkit for microservices in the modern enterprise.
• Kite - Microservices framework in Go.
• Martini - Classy web development in Go.
• Micro - A microservices toolchain in Go.
• Negroni - Idiomatic HTTP middleware for Golang.

Haskell

• Scotty - Micro web framework inspired by Ruby's Sinatra, using WAI and Warp.
• Yesod - The Haskell RESTful web framework.

Java VM

Clojure

• Compojure - A concise routing library for Ring/Clojure.
• Duct - Minimal framework for building web applications in Clojure, with a strong emphasis on simplicity.
• Liberator - Library that helps you expose your data as resources while automatically complying with all the relevant requirements of the HTTP specification.
• Modularity - JUXT's Clojure-based modular system.
• System - Built on top of Stuart Sierra's component library, offers a set of readymade components.
• Tesla - Common basis for some of Otto.de's Clojure microservices.

Java

• Airlift - Framework for building REST services in Java.
• Dropwizard - Java framework for developing ops-friendly, high-performance, RESTful web services.
• Jersey - RESTful Web Services in Java. JAX-RS (JSR 311 & JSR 339) Reference Implementation.
• Ratpack - Set of Java libraries that facilitate fast, efficient, evolvable and well tested HTTP applications. specific support for the Groovy language is provided.
• Restlet - Helps Java developers build web APIs that follow the REST architecture style.
• Spring Boot - Makes it easy to create stand-alone, production-grade Spring based applications.

Scala

• Colossus - I/O and microservice library for Scala.
• Finatra - Fast, testable, Scala HTTP services built on Twitter-Server and Finagle.
• Play - The high velocity web framework for Java and Scala.
• Scalatra - Simple, accessible and free web micro-framework.
• Skinny Micro - Micro-web framework to build servlet applications in Scala.
• Spray - Open-source toolkit for building REST/HTTP-based integration layers on top of Scala and Akka.

Node.js

• Actionhero - Multi-transport Node.js API server with integrated cluster capabilities and delayed tasks.
• Baucis - To build and maintain scalable HATEOAS/Level 3 REST APIs.
• Express - Fast, unopinionated, minimalist web framework for Node.js
• Hapi - A rich framework for building applications and services.
• Loopback - Node.js framework for creating APIs and easily connecting to backend data sources.
• Restify - Node.js module built specifically to enable you to build correct REST web services.
• Seneca - A microservices toolkit for Node.js

Infrastructure

API Gateways / Edge Services

• Camel - Empowers you to define routing and mediation rules in a variety of domain-specific languages, including a Java-based fluent API, Spring or Blueprint XML configuration files, and a Scala DSL.
• HAProxy - Reliable, high Performance TCP/HTTP load balancer.
• Kong - Open-source management layer for APIs.
• OpenResty - Fast web application server built on top of Nginx.
• Tengine - A distribution of Nginx with some advanced features.
• Tyk - Open-source, fast and scalable API gateway, portal and API management platform.
• Vulcand - Programmatic load balancer backed by Etcd.
• Zuul - An edge service that provides dynamic routing, monitoring, resiliency, security, and more.

Configuration and Discovery

• Consul - Service discovery and configuration made easy. Distributed, highly available, and datacenter-aware.
• Denominator - Portably control DNS clouds using java or bash.
• Etcd - Highly-available key-value store for shared configuration and service discovery.
• Eureka - REST based service that is primarily used in the AWS cloud for locating services for the purpose of load balancing and failover of middle-tier servers.
• SkyDNS - Distributed service for announcement and discovery of services built on top of etcd. It utilizes DNS queries to discover available services.
• [SmartStack] (https://github.com/airbnb/smartstack-cookbook) - Airbnb's automated service discovery and registration framework.
• Spring Cloud Config - Provides server and client-side support for externalized configuration in a distributed system.
• ZooKeeper - Open-source server which enables highly reliable distributed coordination.

Security

• Crtauth - A public key backed client/server authentication system.
• JWT - JSON Web Tokens are an open, industry standard RFC 7519 method for representing claims securely between two parties.
• OAuth - Provides specific authorization flows for web applications, desktop applications, mobile phones, and living room devices. Many implementations.
• OpenID Connect - Libraries, products, and tools implementing current OpenID specifications and related specs.
• SCIM - System for Cross-domain Identity Management.
• Vault - Secures, stores, and tightly controls access to tokens, passwords, certificates, API keys, and other secrets in modern computing.

Elasticity

• Chronos - Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules.
• Fenzo - Extensible scheduler for Mesos frameworks.
• Galaxy - Open-source high-performance in-memory data-grid.
• Grape - Realtime processing pipeline.
• Hazelcast - Open-source in-memory data-grid. Allows you to distribute data and computation across servers, clusters and geographies, and to manage very large data sets or high data ingest rates. Mature technology.
• Ignite - High-performance, integrated and distributed in-memory platform for computing and transacting on large-scale data sets in real-time, orders of magnitude faster than possible with traditional disk-based or flash technologies.
• Marathon - Deploy and manage containers (including Docker) on top of Apache Mesos at scale.
• Mesos - Abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively.
• Nomad - Distributed, highly available, datacenter-aware scheduler.
• Onyx - Distributed, masterless, high performance, fault tolerant data processing for Clojure.
• Ordasity - Designed to spread persistent or long-lived workloads across several machines.
• Redisson - Distributed and scalable Java data structures on top of Redis server.

Messaging

• ØMQ - Brokerless intelligent transport layer.
• ActiveMQ - Powerful open-source messaging and integration patterns server.
• Apollo - Faster, more reliable, easier to maintain messaging broker built from the foundations of the original ActiveMQ.
• Ascoltatori - Pub/sub library for Node.
• Beanstalk - Simple, fast work queue.
• Disque - Distributed message broker.
• Kafka - Publish-subscribe messaging rethought as a distributed commit log.
• Nanomsg - Socket library that provides several common communication patterns for building distributed systems.
• NATS - Open-source, high-performance, lightweight cloud messaging system.
• NSQ - A realtime distributed messaging platform.
• Qpid - Cross-platform messaging components built on AMQP.
• RabbitMQ - Open-source Erlang-based message broker that just works.

Serialization

• BooPickle - Binary serialization library for efficient network communication. For Scala and Scala.js
• CBOR - Implementations of the CBOR standard (RFC 7049) in many languages.
• Cereal - C++11 library for serialization.
• Cheshire - Clojure JSON and JSON SMILE encoding/decoding.
• Etch - Cross-platform, language and transport-independent framework for building and consuming network services.
• Fastjson - Fast JSON Processor.
• Ffjson - Faster JSON serialization for Go.
• FST - Fast java serialization drop in-replacemen.
• Jackson - A multi-purpose Java library for processing JSON data format.
• Jackson Afterburner - Jackson module that uses bytecode generation to further speed up data binding (+30-40% throughput for serialization, deserialization).
• Kryo - Java serialization and cloning: fast, efficient, automatic.
• MessagePack - Efficient binary serialization format.
• Protostuff - A serialization library with built-in support for forward-backward compatibility (schema evolution) and validation.
• SBinary - Library for describing binary formats for Scala types.
• Thrift - The Apache Thrift software framework, for scalable cross-language services development.

Storage

• Aerospike - High performance NoSQL database delivering speed at scale.
• Couchbase - A distributed database engineered for performance, scalability, and simplified administration.
• Datomic - Fully transactional, cloud-ready, distributed database.
• Elliptics - Fault tolerant distributed key/value storage.
• Reborn - Distributed database fully compatible with redis protocol.
• Tachyon - Memory-centric distributed storage system, enabling reliable data sharing at memory-speed across cluster frameworks.

Reactivity

• Reactive Kafka - Reactive Streams API for Apache Kafka.
• ReactiveX - API for asynchronous programming with observable streams. Available for idiomatic Java, Scala, C#, C++, Clojure, JavaScript, Python, Groovy, JRuby, and others.
• Simple React - Powerful future streams & asynchronous data structures for Java 8.

Resilience

• Hystrix - Latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex distributed systems where failure is inevitable.
• Raft Consensus - Consensus algorithm that is designed to be easy to understand. It's equivalent to Paxos in fault-tolerance and performance.
• Resilient HTTP - A smart HTTP client with super powers like fault tolerance, dynamic server discovery, auto balancing and reactive recovery, designed for distributed systems.
• Saboteur - Causing deliberate network mayhem for better resilience.
• Simian Army - Suite of tools for keeping your cloud operating in top form. Chaos Monkey, the first member, is a resiliency tool that helps ensure that your applications can tolerate random instance failures.

Monitoring and Debugging

• Grafana - An open-source, feature rich metrics dashboard and graph editor for Graphite, InfluxDB & OpenTSDB.
• Graphite - Scalable realtime graphing.
• Prometheus - An open-source service monitoring system and time series database.
• Riemann - Monitors distributed systems.
• Sensu - Monitoring for today's infrastructure.
• Trace - A visualised stack trace platform designed for microservices.
• Zabbix - Open-source enterprise-class monitoring solution.

Logging

• Fluentd - Open-source data collector for unified logging layer.
• Graylog - Fully integrated open-source log management platform.
• Kibana - Flexible analytics and visualization platform.
• Logstash - Tool for managing events and logs.
• Suro - Distributed data pipeline which enables services for moving, aggregating, routing, storing data.

IT Automation / Provisioning

• Ansible - Radically simple IT automation platform that makes your applications and systems easier to deploy.
• Chef - Automate how you build, deploy, and manage your infrastructure.
• Helios - Docker container orchestration platform.
• Otto - Development and deployment made easy.
• Packer - Tool for creating identical machine images for multiple platforms from a single source configuration.
• Puppet - From provisioning bare metal & launching containers to new ways to manage infrastructure as code.
• Salt - Infrastructure automation and management system.
• Terraform - Provides a common configuration to launch infrastructure, from physical and virtual servers to email and DNS providers.

Deployment and Continuous Integration

On-prem

• ION-Roller - AWS immutable deployment framework for web services.
• Janky - Continuous integration server built on top of Jenkins and Hubot.
• Jenkins - Extensible open-source continuous integration server.
• Nscale - Open toolkit supporting configuration, build and deployment of connected container sets.
• RPM Maven - Allows artifacts from one or more projects to be packaged in an RPM for distribution.

Hosted

• AWS CodeDeploy - Deployment service that enables developers to automate the deployment of applications to instances and to update the applications as required.
• AWS OpsWorks - Provides a simple and flexible way to create and manage stacks and applications.
• Codeship - Hosted continuous delivery platform that takes care of the testing and deployment process.
• Travis - Continuous integration and deployment service.

Lightweight

• Capsule - Packaging and deployment tool for JVM applications.
• Kafka Deploy - Automated deploy for a Kafka cluster on AWS.

Containers

• AWS ECS - Easily run and manage Docker-enabled applications across a cluster of Amazon EC2 instances.
• CoreOS - Open-source lightweight operating system based on the Linux kernel and designed for providing infrastructure to clustered deployments.
• Docker - Open platform for distributed applications for developers and sysadmins.
• Kubernetes - Open-source orchestration system for Docker containers.
• Linux Containers - The umbrella project behind LXC, LXD, LXCFS and CGManager.

Documentation & Modeling

REST APIs

• API Blueprint - Tools for your whole API lifecycle. Use it to discuss your API with others. Generate documentation automatically. Or a test suite. Or even some code.
• Apidoc - Beautiful documentation for REST services.
• RAML - RESTful API Modeling Language, a simple and succinct way of describing practically-RESTful APIs.
• Swagger - A simple yet powerful representation of your RESTful API.
• Spring REST Docs - Document RESTful services by combining hand-written documentation with auto-generated snippets produced with Spring MVC Test.

Testing

• Mountebank - Cross-platform, multi-protocol test doubles over the wire.
• VCR - Record your test suite's HTTP interactions and replay them during future test runs for fast, deterministic, accurate tests. See the list of ports for implementations in other languages.
• Wilma - Combined HTTP/HTTPS service stub and transparent proxy solution.
• WireMock - Flexible library for stubbing and mocking web services. Unlike general purpose mocking tools it works by creating an actual HTTP server that your code under test can connect to as it would a real web service.

Standards / Recommendations

World Wide Web

• W3C.REC-Webarch - Architecture of the World Wide Web, Volume One.
• RFC3986 - Uniform Resource Identifier (URI): Generic Syntax.
• RFC6570 - URI Template.
• RFC7320 - URI Design and Ownership.

HTTP/1.1

• RFC7230 - Message Syntax and Routing.
• RFC7231 - Semantics and Content.
• RFC7232 - Conditional Requests.
• RFC7233 - Range Requests.
• RFC7234 - Caching.
• RFC7235 - Authentication.

HTTP/2

• RFC7540 - Hypertext Transfer Protocol Version 2.

RPC

• BERT-RPC 1.0 - An attempt to specify a flexible binary serialization and RPC protocol that are compatible with the philosophies of dynamic languages.
• JSON-RPC 2.0 - A stateless, light-weight remote procedure call (RPC) protocol.

Messaging

• AMQP - Advanced Message Queuing Protocol.
• MQTT - MQ Telemetry Transport.
• STOMP - Simple Text Oriented Messaging Protocol.

Security

• RFC5246 - The Transport Layer Security (TLS) Protocol Version 1.2.
• RFC6066 - TLS Extensions.
• RFC6749 - The OAuth 2.0 authorization framework.
• RFC7515 - JSON Web Signature (JWS) represents content secured with digital signatures or Message Authentication Codes (MACs) using JSON-based data structures.
• RFC7519 - JSON Web Token (JWT) is a compact, URL-safe means of representing claims to be transferred between two parties.
• RFC7642 - SCIM: Definitions, overview, concepts, and requirements.
• RFC7643 - SCIM: Core Schema, provides a platform-neutral schema and extension model for representing users and groups.
• RFC7644 - SCIM: Protocol, an application-level, REST protocol for provisioning and managing identity data on the web.
• OIDCONN - OpenID Connect 1.0 is a simple identity layer on top of the OAuth 2.0 protocol. It allows clients to verify the identity of the end-user based on the authentication performed by an Authorization Server, as well as to obtain basic profile information about the end-user in an interoperable and REST-like manner.

Service Discovery

• HAL-DRAFT - The JSON Hypertext Application Language (HAL) is a standard which establishes conventions for expressing hypermedia controls, such as links, with JSON. ^DRAFT
• WADL - The Web Application Description Language specification.
• WSDL - The Web Services Description Language Version 2.0 spec.

Data Formats

• RFC4627 - JavaScript Object Notation (JSON).
• RFC7049 - Concise Binary Object Representation (CBOR).
• BSON - Bin­ary JSON (BSON).
• SMILE - JSON-compatible binary data format.
• MSGPACK - MessagePack Specification.

Unicode

• UNIV8 - The Unicode Consortium. The Unicode Standard, Version 8.0.0, (Mountain View, CA: The Unicode Consortium, 2015. ISBN 978-1-936213-10-8).
• RFC3629 - UTF-8, a transformation format of ISO 10646.

Real Life Stories

• Clean microservice architecture
• Failing at microservices
• How to talk to your friends about microservices
• How we build microservices at Karma
• How we ended up with microservices at SoundCloud
• Microservices: lessons from the frontline
• Monolith first
• Scaling microservices at Gilt with Scala, Docker and AWS

Theory

Articles & Papers

• AKF Scale Cube - Model depicting the dimensions to scale a service.
• CALM - Consistency as logical monotonicity. 🔸^PDF
• Canary Release - Technique to reduce the risk of introducing a new software version in production by slowly rolling out the change to a small subset of users before rolling it out to the entire infrastructure and making it available to everybody.
• CAP Theorem - States that it is impossible for a distributed computer system to simultaneously provide all three of the following guarantees: Consistency, Availability and Partition tolerance.
• Cloud Design Patterns - Contains twenty-four design patterns that are useful in cloud-hosted applications. Includes: Circuit Breaker, Competing Consumers, CQRS, Event Sourcing, Gatekeeper, Cache-Aside, etc.
• Hexagonal Architecture - Allows an application to equally be driven by users, programs, automated test or batch scripts, and to be developed and tested in isolation from its eventual run-time devices and databases.
• Microservice Architecture - Particular way of designing software applications as suites of independently deployable services.
• Microservices and SOA - Similarities, differences, and where we go from here.
• Microservices RefCard - Getting started with microservices.
• Microservices Trade-Offs - Guide to ponder costs and benefits of the mircoservices architectural style.
• Reactive Manifesto - Reactive systems definition.
• Reactive Streams - Initiative to provide a standard for asynchronous stream processing with non-blocking back pressure.
• ROCAS - Resource Oriented Computing for Adaptive Systems. 🔸^PDF
• SECO - Understanding software ecosystems: a strategic modeling approach. 🔸^PDF
• Testing Strategies in a Microservice Architecture - Approaches for managing the additional testing complexity of multiple independently deployable components.
• Your Server as a Function - Describes three abstractions which combine to present a powerful programming model for building safe, modular, and efficient server software: Composable futures, services and filters. 🔸^PDF

Tutorials

• Microservices in C#: Part 1, Part 2, Part 3, Part 4, Part 5.
• Using Packer and Ansible to build immutable infrastructure

Books

• Building Microservices - Building Microservices: Designing Fine-grained Systems. Sam Newman. Preview Edition. 🔸^PDF
• Migrating to Cloud Native Application Architectures - This O’Reilly report defines the unique characteristics of cloud native application architectures such as microservices and twelve-factor applications.
• The Art of Scalability - The Art of Scalability: Scalable Web Architecture, Processes, and Organizations for the Modern Enterprise. Martin L. Abbott, Michael T. Fisher.

Sites

• Microservices Resource Guide - Martin Fowler's choice of articles, videos, books, and podcasts that can teach you more about the microservices architectural style.
• Microservice Patterns - Microservice architecture patterns and best practices.

Emerging Technologies

• Blockchain ID - A unique identifier that is secured by a blockchain. Blockchain IDs are simultaneously secure, human-meaningful, and decentralized, thereby squaring Zooko's triangle.
• Blocknet - The Blocknet makes possible to deliver microservices over a blockchain-based P2P network architecture.

License

Contributing

To contribute, please, open an issue or create a pull request.

🌟 Additions, suggestions, and structural amendments are welcome.

Thank you!

Acknowledgments

Table of contents generated with DocToc