Awesome Microservices

A curated list of Microservice Architecture related principles and technologies.

Table of Contents

• Service Toolkits
  • JVM
  • Go
  • Node.js
  • C
  • D
  • Erlang
• Runtimes
• Platforms
• Infrastructure
  • API Gateway
  • Serialization
  • Messaging
  • Elastic Computing
  • Reactivity
  • Resilience
  • Configuration and Discovery
  • Monitoring
  • Logging
• IT Automation / Provisioning
• Deployment and Continuous Integration
  • On-prem
  • Hosted
  • Lightweight
• Containers
• Modeling
  • REST APIs
  • Systems & SPLs
• Standards / Recommendations
  • World Wide Web
  • HTTP/1.1
  • HTTP/2
  • Service Discovery
  • Unicode
• Real Life Stories
• Theory
  • Articles & Papers
  • Books
  • Sites
• License
• Contributing
• Acknowledgments

Service Toolkits

JVM

Clojure

• Compojure - A concise routing library for Ring/Clojure.
• Duct - Minimal framework for building web applications in Clojure, with a strong emphasis on simplicity.
• Liberator - Library that helps you expose your data as resources while automatically complying with all the relevant requirements of the HTTP specification.
• Modularity - JUXT's Clojure-based modular system.
• System - Built on top of Stuart Sierra's component library, offers a set of readymade components.
• Tesla - Common basis for some of otto.de's clojure microservices.

Java

• Dropwizard - Java framework for developing ops-friendly, high-performance, RESTful web services.
• Finagle - Extensible RPC system for the JVM, used to construct high-concurrency servers.
• Jersey - RESTful Web Services in Java. JAX-RS (JSR 311 & JSR 339) Reference Implementation.
• Ratpack - Set of Java libraries that facilitate fast, efficient, evolvable and well tested HTTP applications. Specific support for the Groovy language is provided.
• Restlet - Helps Java developers build web APIs that follow the REST architecture style.
• Spring Boot - Makes it easy to create stand-alone, production-grade Spring based Applications that you can "just run".

Scala

• Play - The high velocity web framework for Java and Scala.
• Spray - Open-source toolkit for building REST/HTTP-based integration layers on top of Scala and Akka.

Go

• Gin - Web framework written in Golang.
• Kite - Microservice framework in Go.
• Martini - Classy web development in Go.
• Negroni - Idiomatic HTTP Middleware for Golang.

Node.js

• Actionhero - Multi-transport Node.js API Server with integrated cluster capabilities and delayed tasks.
• Baucis - To build and maintain scalable HATEOAS/Level 3 REST APIs.
• Express - Fast, unopinionated, minimalist web framework for Node.js
• Hapi - A rich framework for building applications and services.
• Loopback - Node.js framework for creating APIs and easily connecting to backend data sources.
• Restify - Node.js module built specifically to enable you to build correct REST web services.
• Seneca - A Micro-Services toolkit for Node.js

C

• Kore - Easy to use web application framework for writing scalable web APIs in C.

D

• Vibe.d - Asynchronous I/O that doesn’t get in your way, written in D.

Erlang

• Gen_microservice - This library solves the problem of implementing microservices with Erlang.
• Mochiweb - Erlang library for building lightweight HTTP servers.

Runtimes

• Akka - Toolkit and runtime for building highly concurrent, distributed, and resilient message-driven applications on the JVM.
• Erlang/OTP - Programming language used to build massively scalable soft real-time systems with requirements on high availability.
• Karaf - Small OSGi based runtime which provides a lightweight container.
• Orbit - Modern framework for JVM languages that makes it easier to build and maintain distributed and scalable online services.
• Vert.X - Toolkit for building reactive applications on the JVM.

Platforms

• Cisco Microservices - Modern platform for rapidly deploying globally distributed services.
• Fabric8 - Open-source integration platform for deep management of Java Containers (JVMs).
• VAMP - Build, deploy and manage microservices with power and ease.

Infrastructure

API Gateway

• Camel - Empowers you to define routing and mediation rules in a variety of domain-specific languages, including a Java-based Fluent API, Spring or Blueprint XML Configuration files, and a Scala DSL.
• HAProxy - The Reliable, High Performance TCP/HTTP Load Balancer.
• Kong - Open-source management layer for APIs.
• OpenResty - Fast web app server by extending Nginx.
• Tengine - A distribution of Nginx with some advanced features.
• Tyk - Open-source, fast and scalable API gateway, portal and API management platform.

Serialization

• BooPickle - Binary serialization library for efficient network communication. For Scala and Scala.js
• CBOR - Implementations of the CBOR standard (RFC 7049) in many languages.
• Cereal - C++11 library for serialization.
• Cheshire - Clojure JSON and JSON SMILE encoding/decoding.
• Fastjson - Fast JSON Processor.
• FST - Fast java serialization drop in-replacemen.
• Jackson - A multi-purpose Java library for processing JSON data format.
• Jackson Afterburner - Jackson module that uses bytecode generation to further speed up data binding (+30-40% throughput for serialization, deserialization).
• Kryo - Java serialization and cloning: fast, efficient, automatic.
• MessagePack - Efficient binary serialization format.
• Protostuff - A serialization library with built-in support for forward-backward compatibility (schema evolution) and validation.
• SBinary - Library for describing binary formats for Scala types.

Messaging

• ØMQ - Brokerless intelligent transport layer.
• ActiveMQ - Powerful open source messaging and integration patterns server.
• Apollo - Faster, more reliable, easier to maintain messaging broker built from the foundations of the original ActiveMQ.
• Beanstalk - Simple, fast work queue.
• Disque - Distributed message broker.
• Kafka - Publish-subscribe messaging rethought as a distributed commit log.
• Nanomsg - Socket library that provides several common communication patterns for building distributed systems.
• NATS - Open-source, high-performance, lightweight cloud messaging system.
• Qpid - Cross-platform messaging components built on AMQP.
• RabbitMQ - Open source Erlang-based message broker that just works.

Elastic Computing

• Chronos - Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules.
• Galaxy - Open-source high-performance in-memory data-grid.
• Hazelcast - Open source in-memory data-grid. Allows you to distribute data and computation across servers, clusters and geographies, and to manage very large data sets or high data ingest rates. Mature technology.
• Ignite - High-performance, integrated and distributed in-memory platform for computing and transacting on large-scale data sets in real-time, orders of magnitude faster than possible with traditional disk-based or flash technologies.
• Ordasity - Designed to spread persistent or long-lived workloads across several machines.
• Marathon - Deploy and manage containers (including Docker) on top of Apache Mesos at scale.
• Mesos - Abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively.

Reactivity

• Reactive Kafka - Reactive Streams API for Apache Kafka.
• ReactiveX - API for asynchronous programming with observable streams. Available for idiomatic Java, Scala, C#, C++, Clojure, JavaScript, Python, Groovy, JRuby, and others.

Resilience

• Hystrix - Latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex distributed systems where failure is inevitable.
• Raft Consensus - Consensus algorithm that is designed to be easy to understand. It's equivalent to Paxos in fault-tolerance and performance.
• Resilient HTTP - A smart HTTP client with super powers like fault tolerance, dynamic server discovery, auto balancing and reactive recovery, designed for distributed systems.
• Simian Army - Suite of tools for keeping your cloud operating in top form. Chaos Monkey, the first member, is a resiliency tool that helps ensure that your applications can tolerate random instance failures.

Configuration and Discovery

• Consul - Service discovery and configuration made easy. Distributed, highly available, and datacenter-aware.
• Denominator - Portably control DNS clouds using java or bash.
• Etcd - Highly-available key-value store for shared configuration and service discovery.
• Eureka - REST based service that is primarily used in the AWS cloud for locating services for the purpose of load balancing and failover of middle-tier servers.
• SkyDNS - Distributed service for announcement and discovery of services built on top of etcd. It utilizes DNS queries to discover available services.
• Vault - Secures, stores, and tightly controls access to tokens, passwords, certificates, API keys, and other secrets in modern computing.
• ZooKeeper - Open-source server which enables highly reliable distributed coordination.

Monitoring

• Graphite - Scalable realtime graphing.
• Riemann - Monitors distributed systems.

Logging

• Fluentd - Open source data collector for unified logging layer.
• Graylog - Fully integrated open source log management platform.
• Kibana - Flexible analytics and visualization platform.
• Logstash - Tool for managing events and logs.
• Suro - Distributed data pipeline which enables services for moving, aggregating, routing, storing data.

IT Automation / Provisioning

• Ansible - Radically simple IT automation platform that makes your applications and systems easier to deploy.
• Chef - Automate how you build, deploy, and manage your infrastructure.
• Packer - Tool for creating identical machine images for multiple platforms from a single source configuration.
• Puppet - From provisioning bare metal & launching containers to new ways to manage infrastructure as code.
• Terraform - Provides a common configuration to launch infrastructure, from physical and virtual servers to email and DNS providers.

Deployment and Continuous Integration

On-prem

• Jenkins - Extensible open source continuous integration server.
• Nscale - Open toolkit supporting configuration, build and deployment of connected container sets.
• RPM Maven - Allows artifacts from one or more projects to be packaged in an RPM for distribution.

Hosted

• AWS CodeDeploy - Deployment service that enables developers to automate the deployment of applications to instances and to update the applications as required.
• AWS OpsWorks - Provides a simple and flexible way to create and manage stacks and applications.
• Codeship - Hosted continuous delivery platform that takes care of the testing and deployment process.
• Travis - Continuous integration and deployment service.

Lightweight

• Capsule - Packaging and deployment tool for JVM applications.
• Kafka Deploy - Automated deploy for a Kafka cluster on AWS.

Containers

• AWS ECS - Easily run and manage Docker-enabled applications across a cluster of Amazon EC2 instances.
• CoreOS - Open source lightweight operating system based on the Linux kernel and designed for providing infrastructure to clustered deployments.
• Docker - Open platform for distributed applications for developers and sysadmins.
• Kubernetes - Open source orchestration system for Docker containers.

Modeling

REST APIs

• API Blueprint - Tools for your whole API lifecycle. Use it to discuss your API with others. Generate documentation automatically. Or a test suite. Or even some code.
• RAML - RESTful API Modeling Language, a simple and succinct way of describing practically-RESTful APIs.
• Swagger - A simple yet powerful representation of your RESTful API.

Systems & SPLs

• FAMILIAR - A language for importing, exporting, composing, decomposing, editing, configuring, computing "diffs", refactoring, reverse engineering, testing, and reasoning about feature models.
• SoaML - OMG Service Oriented Architecture Modeling Language.
• SysML - OMG Systems Modeling Language.

Standards / Recommendations

World Wide Web

• W3C.REC-Webarch - Architecture of the World Wide Web, Volume One.
• RFC3986 - Uniform Resource Identifier (URI): Generic Syntax.
• RFC6570 - URI Template.
• RFC7320 - URI Design and Ownership.

HTTP/1.1

• RFC7230 - Message Syntax and Routing.
• RFC7231 - Semantics and Content.
• RFC7232 - Conditional Requests.
• RFC7233 - Range Requests.
• RFC7234 - Caching.
• RFC7235 - Authentication.

HTTP/2

• RFC7540 - Hypertext Transfer Protocol Version 2.

Security

• RFC5246 - The Transport Layer Security (TLS) Protocol Version 1.2.
• RFC6066 - TLS Extensions.

Service Discovery

• HAL-DRAFT - The JSON Hypertext Application Language (HAL) is a standard which establishes conventions for expressing hypermedia controls, such as links, with JSON (draft).
• WADL - The Web Application Description Language specification.
• WSDL - The Web Services Description Language Version 2.0 spec.

Data Formats

• RFC4627 - JavaScript Object Notation (JSON).
• RFC7049 - Concise Binary Object Representation (CBOR).
• BSON - Bin­ary JSON (BSON).
• SMILE - JSON-compatible binary data format.
• MSGPACK - MessagePack Specification.

Unicode

• UNIV8 - The Unicode Consortium. The Unicode Standard, Version 8.0.0, (Mountain View, CA: The Unicode Consortium, 2015. ISBN 978-1-936213-10-8).
• RFC3629 - UTF-8, a transformation format of ISO 10646.

Real Life Stories

• Clean Micro-service Architecture
• Failing at Microservices
• How to Talk To Your Friends About MicroServices
• How we build microservices at Karma
• Microservices: Lessons from the Frontline
• Monolith First

Theory

Articles & Papers

• AKF Scale Cube - Model depicting the dimensions to scale a service.
• CALM - Consistency as logical monotonicity.
• CAP Theorem - States that it is impossible for a distributed computer system to simultaneously provide all three of the following guarantees: Consistency, Availability and Partition tolerance.
• Cloud Design Patterns - Contains twenty-four design patterns that are useful in cloud-hosted applications. Includes: Circuit Breaker, Competing Consumers, CQRS, Event Sourcing, Gatekeeper, Cache-Aside, etc.
• Hexagonal Architecture - Allows an application to equally be driven by users, programs, automated test or batch scripts, and to be developed and tested in isolation from its eventual run-time devices and databases.
• Microservice Architecture - Particular way of designing software applications as suites of independently deployable services.
• Microservice Trade-Offs - Guide to ponder costs and benefits of the mircoservices architectural style.
• Reactive Manifesto - Reactive systems definition.
• Reactive Streams - Initiative to provide a standard for asynchronous stream processing with non-blocking back pressure.
• SECO - Understanding Software Ecosystems: A Strategic Modeling Approach.

Books

• Building Microservices - Building Microservices: Designing Fine-grained Systems. Sam Newman. Preview Edition.
• The Art of Scalability - The Art of Scalability: Scalable Web Architecture, Processes, and Organizations for the Modern Enterprise. Martin L. Abbott, Michael T. Fisher.

Sites

• Microservice Patterns - Microservice architecture patterns and best practices.
• OSGi Alliance - OSGi technology facilitates the componentization of software modules and applications and assures remote management and interoperability of applications and services over a broad variety of devices.

License

Contributing

To contribute, please, open an issue or create a pull request.

🌟 Additions, suggestions, and structural amendments are welcome.

Thank you!

Acknowledgments

Table of contents generated with DocToc