python/README.md

Awesome Python

A curated list of awesome Python frameworks, libraries and resources. Inspired by awesome-php.

• Awesome Python
  • Environment Management
  • Package Management
  • Files
  • Date and Time
  • Text Processing
  • Natural Language Processing
  • Command-line Tools
  • Documentation
  • Imagery
  • Audio
  • Video
  • Geolocation
  • HTTP
  • Database Drivers
  • ORM
  • Web Frameworks
  • CMS
  • RESTful API
  • Authentication and OAuth
  • Template Engine
  • Queue
  • Search
  • Asset Management
  • Caching
  • Email
  • URL Manipulation
  • HTML Manipulation
  • Web Crawling
  • Web Content Extracting
  • Networking
  • GUI
  • Logging
  • Testing
  • Code Analysis and Linter
  • Science and Data Aanalysis
  • Machine Learning
  • Third-party APIs
  • Miscellaneous
• Resources
  • Books
  • Websites
  • Articles

Environment Management

Libraries for Python version and environment management.

• pyenv - Simple Python version management.
• virtualenv - A tool to create isolated Python environments.
• virtualenvwrapper - A set of extensions to virtualenv

Package Management

Libraries for package and dependency management.

• pip / Python Package Index - The package and dependency manager.
• wheel - The new standard of python distribution and are intended to replace eggs.

Files

• mimetypes - (Python standard library) Map filenames to MIME types.
• imghdr - (Python standard library) Determine the type of an image.
• python-magic - A Python interface to the libmagic file type identification library.
• path.py - A module wrapper for os.path.
• watchdog - API and shell utilities to monitor file system events.

Date and Time

• arrow - Better dates & times for Python.
• dateutil - Extensions to the standard Python datetime module.
• delorean - A library for clearing up the inconvenient truths that arise dealing with datetimes in Python.
• when.py - Providing user-friendly functions to help perform common date and time actions.
• moment - A Python library for dealing with dates/times. Inspired by Moment.js.

Text Processing

• difflib - (Python standard library) Helpers for computing deltas.
• Levenshtein - Fast computation of Levenshtein distance and string similarity.
• fuzzywuzzy - Fuzzy String Matching.
• esmre - Regular expression accelerator.
• phonenumbers - Library for parsing, formatting, storing and validating international phone numbers.
• python-user-agents - Browser user agent parser.
• shortuuid - A generator library for concise, unambiguous and URL-safe UUIDs.
• tablib - A module for Tabular Datasets in XLS, CSV, JSON, YAML.
• sqlparse - A non-validating SQL parser. It provides support for parsing, splitting and formatting SQL statements.
• Pygments - A generic syntax highlighter.
• python-slugify - A Python slugify library that handles unicode.
• unicode-slugify - A slugifier that generates unicode slugs. Developed by Mozilla.
• unidecode - ASCII transliterations of Unicode text.
• chardet - Python 2/3 compatible character encoding detector.
• xpinyin - A library to translate chinese hanzi (漢字) to pinyin (拼音).
• pangu.py - Spacing texts.
• xlwt / xlrd - A package is for writing and reading data and formatting information from Excel files.
• XlsxWriter - A Python module for creating Excel .xlsx files.

Natural Language Processing

• NLTK - A leading platform for building Python programs to work with human language data.
• TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks.
• jieba - Chinese Words Segementation Utilities.
• snownlp - A library for processing Chinese text.
• loso - Another Chinese segmentation library.

Command-line Tools

• click - A package for creating beautiful command line interfaces in a composable way.
• clint - Python Command-line Application Tools.
• docopt - Pythonic command line arguments parser.
• colorama - Cross-platform colored terminal text.

Documentation

• Sphinx - Python Documentation generator.

Imagery

• pillow - Pillow is the friendly PIL fork. PIL is the Python Imaging Library.
• thumbor - A smart imaging service. It enables on-demand crop, resizing and flipping of images.
• imgSeek - A project for searching a collection of images using visual similarity.
• python-qrcode - A pure Python QR Code generator.
• pygram - Instagram-like image filters.
• Quads - Computer art based on quadtrees.

Audio

• django-elastic-transcoder - Django + AWS Elastic Transcoder.
• beets - A music library manager and MusicBrainz tagger.
• pyechonest - Python client for the Echo Nest API.
• dejavu - Audio fingerprinting and recognition.
• pydub - Manipulate audio with a simple and easy high level interface.
• audioread - Cross-library (GStreamer + Core Audio + MAD + FFmpeg) audio decoding.
• mutagen - A Python module to handle audio metadata.
• tinytag - A library for reading music meta data of MP3, OGG, FLAC and Wave files.

Video

• moviepy - A module for script-based movie editing with many formats, including animated GIFs.
• shorten.tv - Video summarization.
• youtube-dl - A small command-line program to download videos from YouTube.

Geolocation

• GeoDjango - A world-class geographic web framework.
• geopy - Python Geocoding Toolbox.

HTTP

• requests - HTTP Requests for Humans™.
• httpie - A command line HTTP client, a user-friendly cURL replacement.

Database Drivers

• mysql-python - MySQL database connector for Python.
• psycopg2 - The most popular PostgreSQL adapter for the Python.
• PyMongo - The official Python client for MongoDB.
• redis-py - Redis Python Client.

ORM

• Relational Databases
  • SQLAlchemy - The Python SQL Toolkit and Object Relational Mapper.
  • peewee - A small, expressive ORM.
• NoSQL Databases
  • MongoEngine - A Python Object-Document-Mapper for working with MongoDB.
  • redisco - A Python Library for Simple Models and Containers Persisted in Redis.

Web Frameworks

• Django - A high-level Python Web framework that encourages rapid development and clean, pragmatic design.
• Flask - A microframework for Python.
• Bottle - A fast, simple and lightweight WSGI micro web-framework.
• Pyramid - A small, fast, down-to-earth, open source Python web framework.

CMS

• Mezzanine - A powerful, consistent, and flexible content management platform. Built using the Django framework.
• Wagtail - A Django content management system
• django-oscar - An open-source ecommerce framework for Django.

RESTful API

• django-rest-framework - A powerful and flexible toolkit that makes it easy to build Web APIs.
• django-tastypie - Creating delicious APIs for Django apps.
• flask-api - An implementation of the same web browsable APIs that django-rest-framework provides.
• flask-restful - An extension for Flask that adds support for quickly building REST APIs.
• falcon - A high-performance Python framework for building cloud APIs and web app backends.

Authentication and OAuth

• python-social-auth - An easy-to-setup social authentication mechanism with support for several frameworks and auth providers.
• django-oauth-toolkit - OAuth2 goodies for the Djangonauts.
• django-oauth2-provider - Providing OAuth2 access to Django app.
• python-oauth2 - A fully tested, abstract interface to creating OAuth clients and servers.

Template Engine

• Jinja2 - A modern and designer friendly templating language.

Queue

• celery - An asynchronous task queue / job queue based on distributed message passing.
• rq - Simple job queues for Python.

Search

• django-haystack - Modular search for Django.
• elasticsearch-py - The official low-level Python client for Elasticsearch.
• solrpy - A Python client for solr.
• Whoosh - A fast, pure Python search engine library.

Asset Management

• TODO

Caching

• TODO

Email

• imbox - Python IMAP for Humans.
• django-celery-ses - Django email backend with AWS SES and Celery.

Internationalization

• TODO

URL Manipulation

• furl - A small Python library that makes manipulating URLs simple.
• purl - A simple, immutable URL class with a clean API for interrogation and manipulation.

HTML Manipulation

• BeautifulSoup - Providing Pythonic idioms for iterating, searching, and modifying HTML or XML.
• lxml - A very fast, easy-to-use and versatile library for handling HTML and XML.
• html5lib - A standards-compliant library for parsing and serializing HTML documents and fragments.
• pyquery - A jQuery-like library for parsing HTML.
• cssutils - A CSS library for Python.
• MarkupSafe - Implements a XML/HTML/XHTML Markup safe string for Python.
• bleach - A whitelist-based HTML sanitization and text linkification library.

Web Crawling

• Scrapy - A fast high-level screen scraping and web crawling framework.
• portia - Visual scraping for Scrapy.
• feedparser - Universal feed parser.
• RoboBrowser - A simple, Pythonic library for browsing the web without a standalone web browser.

Web Content Extracting

• newspaper - News extraction, article extraction and content curation in Pythom.
• html2text - Convert HTML to Markdown-formatted text.
• python-goose - HTML Content / Article Extractor.
• lassie - Web Content Retrieval for Humans.
• micawber - A small library for extracting rich content from URLs.
• sumy - A module for automatic summarization of text documents and HTML pages.
• Haul - An Extensible Image Crawler.
• python-readability - Fast Python port of arc90's readability tool.

Forms

• django-crispy-forms - A Django app which lets you create beautiful forms in a very elegant and DRY way.
• WTForms - A flexible forms validation and rendering library.

Networking

• gevent - A coroutine-based Python networking library that uses greenlet.
• Twisted - An event-driven networking engine.
• Tornado - A Web framework and asynchronous networking library.

DevOps Tools

• OpenStack - Open source software for building private and public clouds.
• Ansible - An IT automation tool.
• SaltStack - Infrastructure automation and management system.
• Fabric - Tool for streamlining the use of SSH for application deployment or systems administration tasks.
• Fabtools - Tools for writing awesome Fabric files.
• Supervisor - A Process Control System.
• psutil - A cross-platform process and system utilities module.

GUI

• PySide - Python bindings for the Qt cross-platform application and UI framework
• wxPython - A blending of the wxWidgets C++ class library with the Python.

Logging

• logging - (Python standard library) Logging facility for Python
• Sentry - A realtime logging and aggregation server.
• Raven - A Python client for Sentry.

Testing

• Testing Frameworks
  • unittest - (Python standard library) Unit testing framework.
  • nose - nose extends unittest.
  • pytest - A mature full-featured Python testing tool.
• Mock
  • mock - A Python Mocking and Patching Library for Testing.
  • responses - A utility library for mocking out the requests Python library.
• Fake Data
  • faker - A Python package that generates fake data.
  • model_mommy - Creating random fixtures for testing in Django.
• Code Coverage
  • coverage - Code coverage measurement.

Code Analysis and Linter

• Flake8 - The modular source code checker: pep8, pyflakes and co.
• Pylint - A source code analyzer.

Science and Data Aanalysis

• SciPy - A Python-based ecosystem of open-source software for mathematics, science, and engineering.
• NumPy - A fundamental package for scientific computing with Python.
• matplotlib - A Python 2D plotting library.
• NetworkX - A high-productivity software for complex networks.
• Pandas - A library providing high-performance, easy-to-use data structures and data analysis tools.
• PyMC - A module for Bayesian statistical modeling and model fitting which focuses on advanced Markov chain Monte Carlo fitting algorithms.

Machine Learning

• scikit-learn - A Python module for machine learning built on top of SciPy.
• pattern - Web mining module for Python.
• NuPIC - Numenta Platform for Intelligent Computing.
• Pylearn2 - A Machine Learning library based on Theano.
• PyBrain - Another Python Machine Learning Library.
• Crab - A flexible, fast recommender engine.
• python-recsys - A Python library for implementing a Recommender System.

MapReduce

• PySpark - The Spark Python API.
• dpark - Python clone of Spark, a MapReduce alike framework in Python.

Third-party APIs

• boto - Python interface to Amazon Web Services.
• s3cmd - A command line tool for managing Amazon S3 and CloudFront.
• twython - A Python wrapper for the Twitter API.

Development Tools

• TODO

Miscellaneous

• IPython - IPython provides a rich toolkit to help you make the most out of using Python interactively.

Resources

Books

• TODO

Websites

• r/Python - News about Python.
• pyvideo.org - Python related video indexed so you can find it.
• The Hitchhiker's Guide to Python! - The answer to life, the universe, and everything.
• Python 3 Wall of Superpowers - Too many popular Python packages don't support Python 3.
• Trending Python repositories on GitHub today - Good place to find new Python libraries.
• Django Packages - A directory of reusable apps, sites, tools, and more for Django projects.

Articles

• TODO

Contributing

Your contributions are always welcome!