Java A list of useful Java frameworks, libraries, software and videos
Useful Java links
It's fork of awesome link with new structure, add licenses info and github's star info for every link, add a lot of new links (all non-mobile github projects with 390 or more star) and so on. The russian version is in this place.
Spring framework The Spring Framework provides a comprehensive programming and configuration model for modern Java-based enterprise applications -- on any kind of deployment platform. A key element of Spring is infrastructural support at the application level: Spring focuses on the "plumbing" of enterprise applications so that teams can focus on application-level business logic, without unnecessary ties to specific deployment environments. License: Apache 2 , github's star - 5921, stackoverflow - more 100 000 questions.
Google Guava The Guava project contains several of Google's core libraries that we rely on in our Java-based projects: collections, caching, primitives support, concurrency libraries, common annotations, string processing, I/O, and so forth.Requires JDK 1.6 or higher (as of 12.0). License: Apache 2 , github's star - 3813.
Apache Commons - Apache Commons is an Apache project focused on all aspects of reusable Java components.Commons Proper is dedicated to one principal goal: creating and maintaining reusable Java components. License: Apache 2.
Spring Boot — Spring Boot makes it easy to create Spring-powered, production-grade applications and services with absolute minimum fuss. It takes an opinionated view of the Spring platform so that new and existing users can quickly get to the bits they need. License: Apache 2 , github's star - 2386.
Lombok Very spicy additions to the Java programming language. Project Lombok makes java a spicier language by adding 'handlers' that know how to build and compile simple, boilerplate-free, not-quite-java code. License: MIT , github's star - 1540.
Puniverse Quasar Fibers, Channels and Actors for the JVM. License: Eclipse Public v1.0/GNU Lesser 3, github's star - 1091.
Rootbeer GPU CompilerThe Rootbeer GPU Compiler lets you use GPUs from within Java. License: MIT , github's star - 972.
Oblac Jodd Jodd is set of open-source Java micro frameworks and tools; floppy size! Jodd = tools + ioc + mvc + db + aop + tx + json + html < 1.5 Mb. License: BSD 2, github's star - 912.
Google Jimfs An in-memory file system for Java 7+. License: Apache 2 , github's star - 752.
Spring batch Spring Batch is a framework for writing offline and batch applications using Spring and Java. License: Apache 2 , github's star - 448.
Greenrobot common General purpose utilities and hash functions for Android and Java (aka java-common). License: Apache 2 , github's star - 419.
Kilim Lightweight threads for Java, with message passing, nio, http and scheduling support. License: MIT , github's star - 517.
Apache Isis Apache Isis is a framework for rapidly developing domain-driven apps in Java. Write your business logic in entities, domain services and repositories, and the framework dynamically (at runtime) generates a representation of that domain model as a webapp or as a RESTful API. For prototyping or production. License: Apache 2.
Apache Zest Apache Zest is a community based effort exploring Composite Oriented Programming for domain centric application development. This includes evolved concepts from Aspect Oriented Programming, Dependency Injection and Domain Driven Design. License: Apache 2.
Play Framework The Play Framework combines productivity and performance making it easy to build scalable web applications with Java and Scala. https://www.playframework.com/ . License: Apache 2 , github's star - 6771.
Spark Spark - a Sinatra inspired web framework. License: Apache 2 , github's star - 2596.
Atmosphere - Realtime Client Server Framework for the JVM, supporting WebSockets with Cross-Browser Fallbacks. License: CDDL1 / Apache 2 , github's star - 2235.
Grails - Grails is a framework used to build web applications with the Groovy programming language. The core framework is very extensible and there are numerous plugins available that provide easy integration of add-on features. https://grails.org/ License: Apache 2 , github's star - 1386.
Electronicarts Orbit — Orbit - Virtual actor framework for building distributed systems. License: BSD 3, github's star - 741.
Ratpack Ratpack is a simple, capable, toolkit for creating high performance web applications. Ratpack is built on Java and the Netty event-driven networking engine. The API is optimized for Groovy and Java 8.. http://ratpack.io/ License: Apache 2 , github's star - 662.
Vaadin — Vaadin is a Java framework for building modern web applications that look great, perform well and make you and your users happy.https://vaadin.com/ License: Apache 2 , github's star - 398.
ZK framework ZK is a highly productive Java framework for building amazing enterprise web and mobile applications. License: GNU Lesser, github's star - 161.
Apache Tapestry - A component-oriented framework for creating highly scalable web applications in Java. License: Apache 2.
Apache Wicket - Open Source Java web framework that powers thousands of web applications and web sites for governments, stores, universities, cities, banks, email providers, and more. License: Apache 2.
Google Web Toolkit - GWT is used by many products at Google, including Google AdWords and Google Wallet. It's open source, completely free, and used by thousands of enthusiastic developers around the world. License: Apache 2.
Pippo - It's an open source micro web framework in Java, with minimal dependencies and a quick learning curve.The goal of this project is to create a micro web framework in Java that should be easy to use and hack. Pippo can be used in small and medium applications and also in applications based on micro services architecture. License: Apache 2.
Spring MVC - Spring MVC web application and RESTful web service framework. License: Apache 2.
JavaServer Faces - JavaServer™ Faces technology simplifies building user interfaces for JavaServer applications. License: GNU 2 or CDDL 1.0
JavaServer Pages - This project provides a container independent implementation of JSP 2.1. License: GNU 2 or CDDL 1.0
Apache Cocoon Web development framework: separation of concerns, component-based. License: Apache 2.
Apache Struts Apache Struts is a free open-source framework for creating Java web applications. License: Apache 2.
Apache MyFaces The first free open source JavaServer(tm) Faces implementation. License: Apache 2.
Apache Pivot Apache Pivot is an open-source platform for building installable Internet applications (IIAs) [rich Internet application]. License: Apache 2.
Apache Turbine Turbine is a servlet based framework that allows Java developers to quickly build web applications. License: Apache 2.
Apache OODT Apache OODT software is component based, and offers a software architecture beyond simple science applications. License: Apache 2.
Libraries for web development
Tobie ua-parser A multi-language port of Browserscope's user agent parser. License: Apache 2/MIT/Perl, github's star - 1497.
Ghost Driver Ghost Driver is an implementation of the Remote WebDriver Wire protocol, using PhantomJS as back-end. License: BSD 2, github's star - 1179.
B3log Solo - A blogging system written in Java, feel free to create your or your team own blog. License: Apache 2 , github's star - 519.
Baasbox BaasBox is an Open Source project that aims to provide a backend for mobile and web apps. License: ?, github's star - 499.
Gargl - Record web requests as they happen and turn them into reusable code in any programming language. Gargl - Generic API Recorder and Generator Lite. Pronounced "Gargle." Automate any website. Record web requests as they happen and turn them into reusable code in any programming language. License: MIT , github's star - 462.
Liferay plugins - The liferay-plugins repository is part of the Liferay Portal project. Liferay Portal is an open source enterprise web platform for building business solutions that deliver immediate results and long-term value. License: GNU Lesser 2.1, github's star - 444.
Netflix Ribbon Ribbon is a Inter Process Communication (remote procedure calls) library with built in software load balancers. The primary usage model involves REST calls with various serialization scheme support. License: Apache 2 , github's star - 410.
Gwt bootstrap A GWT Library that provides the widgets of Bootstrap, from Twitter. License: Apache 2 , github's star - 409.
Netflix Zuul Zuul is an edge service that provides dynamic routing, monitoring, resiliency, security, and more. License: Apache 2 , github's star - 407.
PrimeFaces - PrimeUI is a pure CSS-JS library designed to work with any server side and client side technology featuring 50+ jQuery Widgets, Web Components, Premium Layouts-Themes and more. PrimeUI is an offspring project of the mighty PrimeFaces. License: Apache 2.
Spring Boot - Spring Boot makes it easy to create Spring-powered, production-grade applications and services with absolute minimum fuss. It takes an opinionated view of the Spring platform so that new and existing users can quickly get to the bits they need. License: Apache 2.
CSSEmbed A tool for embedding data URIs in CSS files. License: MIT , github's star - 407.
Athou commafeed Google Reader inspired self-hosted RSS reader. License: Apache 2 , github's star - 1226.
Apache Any23 Anything To Triples (Any23) is a library, a web service and a command line tool that extracts structured data in RDF format from a variety of Web. License: Apache 2.
Apache Forrest Apache Forrest software is a publishing framework that transforms input from various sources into a unified presentation in one or more output formats. License: Apache 2.
Template Engine
Apache Velocity - Velocity is a project of the Apache Software Foundation, charged with the creation and maintenance of open-source software related to the Apache Velocity Engine (templating engine). License: Apache 2.
Apache FreeMarker - Apache FreeMarker is a template engine: a Java library to generate text output (HTML web pages, e-mails, configuration files, source code, etc.) based on templates and changing data. License: Apache 2.
Handlebars.java - Logic-less and semantic templates with Java, github's star - 451. License: Apache 2.
Thymeleaf - It is a template engine capable of processing and generating HTML, XML, JavaScript, CSS and text, and can work both in web and non-web environments. It is better suited for serving the view layer of web applications, but it can process files in many formats, even in offline environments. License: Apache 2.
Mustache.java - Implementation of mustache.js (web application templating system) for Java. License: Apache 2 , github's star - 733.
Apache Tiles Apache Tiles is a templating framework built to simplify the development of web application user interfaces. License: Apache 2.
Apache JSPWiki A feature-rich and extensible WikiWiki engine built around the standard J2EE components (Java, servlets, JSP). icense: Apache 2.
Apache Portals The Apache Portals project provides various software products, including Apache Jetspeed-2, Apache Pluto, and Apache Portals Applications. License: Apache 2.
Apache Roller Apache Roller is a full-featured, multi-user and group blog server suitable for blog sites large and small. License: Apache 2.
Apache Chemistry Apache Chemistry provides open source implementations of the Content Management Interoperability Services (CMIS) specification. License: Apache 2.
3. GUI
JavaFX - JavaFX is the next step in the evolution of Java as a rich client platform. It is designed to provide a lightweight, hardware-accelerated Java UI platform for enterprise business applications. License: Oracle, proprietary.
Scene Builder - JavaFX Scene Builder is a visual layout tool that lets users quickly design JavaFX application user interfaces, without coding. Users can drag and drop UI components to a work area, modify their properties, apply style sheets, and the FXML code for the layout that they are creating is automatically generated in the background. The result is an FXML file that can then be combined with a Java project by binding the UI to the application’s logic. License: Oracle, proprietary. , but see Gluon Scene Builder.
[Gluon Scene Builder] - Scene Builder is free and open source JavaFX Scene Builder, but is backed by Gluon. Commercial support offerings are available, including training and custom consultancy services. License: BSD.
SWT -SWT is an open source widget toolkit for Java designed to provide efficient, portable access to the user-interface facilities of the operating systems on which it is implemented. License: Eclipse Public License v1.0.
Lanterna - Lanterna is a Java library allowing you to write easy semi-graphical user interfaces in a text-only environment, very similar to the C library curses but with more functionality. License: LGPL 2.1.
Gephi - Gephi is an award-winning open-source platform for visualizing and manipulating large graphs. It runs on Windows, Mac OS X and Linux. Localization is available in French, Spanish, Japanese, Russian, Brazilian Portuguese, Chinese and Czech. License: GNU 3 or CDDL 1.0.
Activiti Activiti is a light-weight workflow and Business Process Management (BPM) Platform targeted at business people, developers and system admins. Its core is a super-fast and rock-solid BPMN 2 process engine for Java. License: Apache 2 , github's star - 861.
Liferay Portal Liferay Portal is an open source enterprise web platform for building business solutions that deliver immediate results and long-term value. Liferay Portal started out as a personal development project in 2000 and was open sourced in 2001. License: GNU Lesser 2.1, github's star - 739.
Broadleaf Commerce - Broadleaf Commerce - Enterprise eCommerce framework based on Spring. License: Apache 2 , github's star - 518.
Droolsjbpm Drools Drools Expert is the rule engine and Drools Fusion does complex event processing (CEP). License: Apache 2 , github's star - 421.
Spring Roo — Spring Roo is a next-generation rapid application development tool for Java developers. It focuses on higher productivity, stock-standard Java APIs, high usability, avoiding engineering trade-offs and facilitating easy Roo removal. License: Apache 2 , github's star - 399.
Apache OFBiz Apache OFBiz (The Apache Open For Business Project) is an open source enterprise automation software project. License: Apache 2.
Apache Portals The Apache Portals project provides various software products, including Apache Jetspeed-2, Apache Pluto, and Apache Portals Applications. License: Apache 2.
Apache ODE Apache ODE is a WS-BPEL implementation that supports web services orchestration using flexible process definitions. License: Apache 2.
Jetserver Jetserver is a high speed nio socket based multiplayer java game server written using Netty and Mike Rettig's Jetlang.It is specifically tuned for network based multiplayer games and supports TCP and UDP network protocols. License: MIT , github's star - 484.
Ardor3D - JogAmp’s Ardor3D Continuation is a general-purpose, professionally oriented, open source, scenegraph based 3D Java engine for desktop and embedded environments, using JOGL for its hardware graphics acceleration. Fork of jMonkeyEngine 2.0. Cross-platform. License: zlib.
DimensioneX Multiplayer Engine - Produces browser games with pseudo-3D views. Games can be turned into Facebook Apps. Intended for beginners. 2.5D. Cross-platform. Notable games: Underworld Online. License: GPL
PlayN A Java game development framework that deploys to Windows, Linux, HTML5, Android and iOS. Notable games: Angry Birds Chrome. Cross-platform. License: Apache 2.0. github star - 97.
Env3D - 3D game engine that creates an interface for dynamically adding EnvObjects. Built on jMonkeyEngine 2.0. Cross-platform License: GPL
Jake2 Java port of the Quake II game engine. 2D. Cross-platform License: GPL
Jogre - JOGRE (Java Online Gaming Real-time Engine) which is an open-source, online, real-time gaming engine and API programmed entirely in Java. License: GPL
Elflight Engine - Targeted for web based games. License: Proprietary
Google Guava The Guava project contains several of Google's core libraries that we rely on in our Java-based projects: collections, caching, primitives support, concurrency libraries, common annotations, string processing, I/O, and so forth.Requires JDK 1.6 or higher (as of 12.0). License: Apache 2 , github's star - 3813.
Apache Commons Collections - Commons-Collections seek to build upon the JDK classes by providing new interfaces, implementations and utilities. License: Apache 2.
Gs collections A supplement or replacement for the Java Collections Framework. License: Apache 2 , github's star - 1201.
Eclipse Collections Eclipse Collections is a collections framework for Java. It has JDK-compatible List, Set and Map implementations with a rich API, additional types not found in the JDK like Bags, Multimaps and set of utility classes that work with any JDK compatible Collections, Arrays, Maps or Strings. The iteration protocol was inspired by the Smalltalk collection framework.Eclipse Collections started off as an open source project on GitHub called GS Collections. GS Collections has been presented at the JVM Language Summit in 2012 and JavaOne in 2014. License: Eclipse Public 1.0. , github's star - 1201.
javatuples - javatuples is one of the simplest java libraries ever made. Its aim is to provide a set of java classes that allow you to work with tuples.A tuple is just a sequence of objects that do not necessarily relate to each other in any way. For example: [23, "Saturn", java.sql.Connection@li734s] can be considered a tuple of three elements (a triplet) containing an Integer, a String, and a JDBC Connection object. License: Apache 2.
Immutables - Java annotation processors to generate simple, safe and consistent value objects. Do not repeat yourself, try Immutables, the most comprehensive tool in this field. License: Apache 2.
fastutil - fastutil extends the Java™ Collections Framework by providing type-specific maps, sets, lists and queues with a small memory footprint and fast access and insertion; provides also big (64-bit) arrays, sets and lists, and fast, practical I/O classes for binary and text files. It requires Java 7 or newer. License: Apache 2.
HPPC - HPPC provides template-generated implementations of typical collections, such as lists, sets and maps, for all Java primitive types. The primary driving force behind HPPC is optimization for highest performance and memory efficiency. License: Apache 2.
Koloboke - Java Collections till the last breadcrumb of memory and performance . This library is a carefully designed and efficient extension of the Java Collections Framework with primitive specializations and more. Java 6+. License: Apache 2.
Trove - The Trove library provides high speed regular and primitive collections for Java. License: GNU Lesser 2.1.
Date and Time
Almanac Converter - An easy-to-use Java-based calendar converter - able to convert between various known calendars. License: Apache 2.
Joda-Time - Joda-Time provides a quality replacement for the Java date and time classes. License: Apache 2, github's star - 1442.
ThreeTenBP - Backport of functionality based on JSR-310 to Java SE 6 and 7. This is NOT an implementation of JSR-310. License: BSD 3.
Time4J - Advanced date, time and interval library for Java. License: GNU Lesser 2.1.
Ocpsoft Prettytime Social Style Date and Time Formatting for Java.PrettyTime is an OpenSource time formatting library. Completely customizable, it creates human readable, relative timestamps like those seen on Digg, Twitter, and Facebook. Get started “right now!” and in over 30 languages! License: Apache 2 , github's star - 394.
Dependency Injection and AOP frameworks
Spring Framework The Spring Framework provides a comprehensive programming and configuration model for modern Java-based enterprise applications -- on any kind of deployment platform. A key element of Spring is infrastructural support at the application level: Spring focuses on the "plumbing" of enterprise applications so that teams can focus on application-level business logic, without unnecessary ties to specific deployment environments. License: Apache 2 , github's star - 5921.
Google Guice - Guice (pronounced 'juice') is a lightweight dependency injection framework for Java 6 and above, brought to you by Google. License: Apache 2, github's star - 1881.
Apache DeltaSpike - DeltaSpike consists of a number of portable CDI extensions that provide useful features for Java application developers. We will also ensure true portability! We are testing DeltaSpike on different CDI implementations like Apache OpenWebBeans and JBoss Weld, and also on different Java EE servers like Apache Tomcat and TomEE, JBoss AS7, WildFly 8.x and 9.x, Oracle GlassFish 3.1+ and 4.x+, IBM WebSphere 8.x, Oracle WebLogic Server 12c, Jetty, and others. License: Apache 2
HK2 - A light-weight and dynamic dependency injection framework. GNU 2/ CDDL 1.0.
Eclipse AspectJ - AspectJ is a seamless aspect-oriented extension to the Java programming language, Java platform compatible, easy to learn and use. License: Eclipse Public 1.0.
Jline JLine is a Java library for handling console input. It is similar in functionality to BSD editline and GNU readline. People familiar with the readline/editline capabilities for modern shells (such as bash and tcsh) will find most of the command editing features of JLine to be familiar. License: BSD 4, github's star - 396.
args4j - args4j is a small Java class library that makes it easy to parse command line options/arguments in your CUI application. License: MIT
CRaSH - The shell for the Java Platform Open source and open minde. License: GNU Lesser 2.1
Functional Programming
Libraries that facilitate functional programming.
Cyclops react - A comprehensive functional reactive platform for JDK8. Future & functional based programming via JDK compatible extensions for Java 8 and above. License: MIT
derive4j - Java 8 annotation processor and framework for deriving algebraic data types constructors, pattern-matching, morphisms, (near future: optics and typeclasses). License: GNU 3.
Fugue -Java 8 has standardised some of the basic function interfaces, but does not include quite a few more tools that a functional programmer may expect to be available. This library attempts to fill in some of the gaps when using Java 8. In particular it provides Option and Either types as well as a Pair. There also additional helper classes for common Function, Supplier, and Iterable operations. License: Apache 2.
Functional Java - Functional Java is an open source library facilitating functional programming in Java. The library implements numerous basic and advanced programming abstractions that assist composition oriented development. Functional Java also serves as a platform for learning functional programming concepts by introducing these concepts using a familiar language. License: BSD 3, github's star - 478.
Javaslang - Javaslang core is a functional library for Java 8+. It helps to reduce the amount of code and to increase the robustness. A first step towards functional programming is to start thinking in immutable values. Javaslang provides immutable collections and the necessary functions and control structures to operate on these values. License: Apache 2.
jOOλ - jOOλ - The Missing Parts in Java 8 jOOλ improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams. License: Apache 2.
Retrolambda Backport of Java 8's lambda expressions to Java 7, 6 and 5. License: Apache 2 , github's star - 1059.
TotallyLazy Another functional library for Java , License: Apache 2, github's star - 76.
Reactive Programming
Libraries for developing reactive applications.
ReactiveX RxJava RxJava – Reactive Extensions for the JVM – a library for composing asynchronous and event-based programs using observable sequences for the Java VM. License: Apache 2 , github's star - 6279, stackoverflow - 1814 questions.
Eclipse Vert.x Vert.x is a tool-kit for building reactive applications on the JVM . License: Eclipse Public 1 / Apache 2 , github's star - 3743, stackoverflow - 728 questions.
Reactive Streams - The purpose of Reactive Streams is to provide a standard for asynchronous stream processing with non-blocking backpressure. License: Public Domain (CC0), github's star - 769.
Reactor - Reactor is a second-generation Reactive library for building non-blocking applications on the JVM based on the Reactive Streams Specification. License: Apache 2.
Security and Authentication
Libraries that handle security, authentication, authorization or session management.Up
Scribe Java - Simple OAuth library for Java. License: MIT , github's star - 2731.
Spring security oauth - Support for adding OAuth1(a) and OAuth2 features (consumer and provider) for Spring web applications. License: Apache 2 , github's star - 916.
Jasig CAS (Central Authentication Service) - Apereo CAS - Single Sign On for the Web.The Central Authentication Service (CAS) is the standard mechanism by which web applications should authenticate users. License: Apache 2 , github's star - 740.
Spring security — Spring Security provides security services for the Spring IO Platform. Spring Security 3.1 requires Spring 3.0.3 as a minimum and also requires Java 5. License: Apache 2 , github's star - 732.
Play Authenticate - An authentication plugin for Play Framework 2.x (Java). License: Apache 2 , github's star - 646.
Apache Shiro - Apache Shiro is a powerful and easy-to-use Java security framework that performs authentication, authorization, cryptography, and session management. With Shiro’s easy-to-understand API, you can quickly and easily secure any application – from the smallest mobile applications to the largest web and enterprise applications. License: Apache 2.
Bouncy Castle - Legion of the Bouncy Castle Java cryptography APIs.A lightweight cryptography API. License: MIT.
Cryptomator - Free client-side encryption for your cloud files. Open source software: No backdoors, no registration. License: MIT.
Keycloak - Integrated SSO and IDM for browser apps and RESTful web services. Built on top of the OAuth 2.0, Open ID Connect, JSON Web Token (JWT) and SAML 2.0 specifications. Keycloak has tight integration with a variety of platforms and has a HTTP security proxy service where we don't have tight integration. Options are to deploy it with an existing app server, as a black-box appliance, or as an Openshift cloud service and/or cartridge. License: Apache 2.
PicketLink - Simplified Security and Identity management for Java Applications PicketLink is an umbrella project for security and identity management for Java Applications. It is licensed under a friendly Apache v2 license. License: Apache 2.
Santuario Library implementing XML Digital Signature Specification & XML Encryption Specification. License: Apache 2.
Apache Oltu Apache Oltu is an OAuth protocol implementation in Java. License: Apache 2.
Apache Syncope Apache Syncope is an Open Source system for managing digital identities in enterprise environments. License: Apache 2.
High Performance
Everything about high performance computation, from collections to specific libraries.Up
Agrona - High Performance data structures and utility methods for Java and C++, License: Apache 2.
fastutil - fastutil extends the Java Collections Framework by providing type-specific maps, sets, lists and queues with a small memory footprint and fast access and insertion; provides also big (64-bit) arrays, sets and lists, and fast, practical I/O classes for binary and text files. License: Apache 2.
Eclipse Collections (older GS Collections) - Eclipse Collections is a collections framework for Java. It has JDK-compatible List, Set and Map implementations with a rich API and set of utility classes that work with any JDK compatible Collections, Arrays, Maps or Strings. The iteration protocol was inspired by the Smalltalk collection framework. The library modules in GS Collections are compatible with Java 5. License: Apache 2.
HPPC -HPPC provides template-generated implementations of typical collections, such as lists, sets and maps, for all Java primitive types. The primary driving force behind HPPC is optimization for highest performance and memory efficiency. License: Apache 2.
Javolution - ibrary for real-time and embedded systems. License: BSD 2.
JCTools - Concurrency tools currently missing from the JDK. License: Apache 2.
Apache BVal Apache BVal delivers an implementation of the Java Bean Validation (JSR303) Specification which is TCK compliant, works on Java SE 5 or later. License: Apache 2.
7. Imagery and Video
Libraries that assist with the creation, evaluation or manipulation of graphical images or video.Up
Facebook Rebound A Java library that models spring dynamics and adds real world physics to your app. License: BSD, github's star - 2219.
Processing Source code for the Processing Development Environment (PDE) . License: GNU 2, github's star - 1896.
JavaCV JavaCV uses wrappers from the JavaCPP Presets of commonly used libraries by researchers in the field of computer vision (OpenCV, FFmpeg, libdc1394, PGR FlyCapture, OpenKinect, videoInput, ARToolKitPlus, and flandmark), and provides utility classes to make their functionality easier to use on the Java platform, including Android. License: Apache 2 , github's star - 503.
imgscalr Simple Java image-scaling library implementing Chris Campbell's incremental scaling algorithm as well as Java2D's "best-practices" image-scaling techniques. License: Apache 2 , github's star - 451.
webcam-capture Project goal is to give users possibility to access build-in or connected via USB webcams or remote IP / network cameras directly from Java code. Using provided libraries user is able to read camera images and detect motion. License: MIT , github's star - 437.
Thumbnailator - Thumbnailator's fluent interface can be used to perform fairly complicated thumbnail processing task in one simple step.
zxing ZXing ("zebra crossing") is an open-source, multi-format 1D/2D barcode image processing library implemented in Java, with ports to other languages. License: Apache 2 , github's star - 5314.
8. Code generation and changing byte code
Libraries to manipulate bytecode programmatically.Up
Google Auto - A collection of source code generators for Java. License: Apache 2 , github's star - 1442.
Square Javapoet - JavaPoet is a Java API for generating .java source files. License: Apache 2 , github's star - 1057.
ASM - ASM is an all purpose Java bytecode manipulation and analysis framework. It can be used to modify existing classes or dynamically generate classes, directly in binary form. Provided common transformations and analysis algorithms allow to easily assemble custom complex transformations and code analysis tools. License: BSD 3 / License: Apache 2.
Byteman - Byteman is a tool which makes it easy to trace, monitor and test the behaviour of Java application and JDK runtime code. It injects Java code into your application methods or into Java runtime methods without the need for you to recompile, repackage or even redeploy your application. License: LGPL 2.1.
Javassist -Javassist (Java Programming Assistant) makes Java bytecode manipulation simple. It is a class library for editing bytecodes in Java; it enables Java programs to define a new class at runtime and to modify a class file when the JVM loads it. License: Apache 2 or LGPL or later 2.1 or Mozilla Public License 1.1..
ADT4J - This library implements Algebraic Data Types for Java. ADT4J provides annotation processor for @GenerateValueClassForVisitor annotation. ADT4J generates new class for each @GenerateValueClassForVisitor annotation. License: BSD 3.
Auto - A collection of source code generators for Java. License: Apache 2.
JHipster - Hipster stack for Java developers. Spring Boot + AngularJS in one handy generator. License: Apache 2.
cglib - cglib - Byte Code Generation Library is high level API to generate and transform Java byte code. It is used by AOP, testing, data access frameworks to generate dynamic proxy objects and intercept field access. License: Apache 2.
9. Distributed Applications
Libraries and frameworks for writing distributed and fault-tolerant applications.Up
Akka - Akka is a toolkit and runtime for building highly concurrent, distributed, and resilient message-driven applications on the JVM. License: Apache 2.
Apache Storm - Apache Storm is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing. Storm is simple, can be used with any programming language, and is a lot of fun to use! License: Apache 2.
Apache ZooKeeper - ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. All of these kinds of services are used in some form or another by distributed applications. License: Apache 2.
Alibaba Dubbo Dubbo is a distributed service framework empowers applications with service import/export capability with high performance RPC. License: Apache 2 , github's star - 1917.
Netflix Curator ZooKeeper client wrapper and rich ZooKeeper framework. License: Apache 2 , github's star - 1158.
Axon Framework - The axon framework is focussed on making life easier for developers that want to create a java application based on the CQRS principles. The framework is used in a lot of environments. License: Apache 2.
Hazelcast - The Leading Open Source In-Memory Data Grid: Distributed Computing, Simplified. License: Apache 2.
Netflix Hystrix - Hystrix is a latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex distributed systems where failure is inevitable, github's star - 3571. License: Apache 2.
JGroups - JGroups is a toolkit for reliable messaging. It can be used to create clusters whose nodes can send messages to each other. License: Apache 2.
Orbit - Orbit is a modern framework for JVM languages that makes it easier to build and maintain distributed and scalable online services. It was developed by BioWare, a division of Electronic Arts. License: BSD 3.
Quasar - Quasar is an open source JVM library that greatly simplifies the creation of highly concurrent software that is very easy to write and reason about, performant, and fault tolerant. License: Eclipse Public License v1.0 or LGPL 3.0.
Storm contrib A collection of spouts, bolts, serializers, DSLs, and other goodies to use with Storm. License: Eclipse Public 1.0, github's star - 504.
JADE - JADE (Java Agent DEvelopment Framework) is a software Framework fully implemented in the Java language. It simplifies the implementation of multi-agent systems through a middle-ware that complies with the FIPA specifications and through a set of graphical tools that support the debugging and deployment phases. License: GNU Lesser 2.0.
Apache River Apache River software provides a standards-compilani JINI service. License: Apache 2.
Apache Tuscany Apache Tuscany simplifies the task of developing SOA solutions by providing a comprehensive infrastructure for SOA development and management that is based on Service Component Architecture (SCA) standard. License: Apache 2.
Libraries for scientific computing and analysis.Up
DataMelt - DataMelt is a free mathematics software for scientists, engineers and students. It can be used for numeric computation, statistics, symbolic calculations, data analysis and data visualization. License: GNU 3.
JGraphT - JGraphT is a free Java class library that provides mathematical graph-theory objects and algorithms. It runs on Java 2 Platform (requires JDK 1.7 or later). License: Eclipse Public License or LGPL 2.1.
JScience - Provides a set of classes to work with scientific measurements and units. License: BSD 2.
Michael Thomas Flanagan's Java Scientific Library General classes of a Java scientific and numerical library written by Michael Thomas Flanagan to support both his own research and his undergraduate programming courses and projects. License: only for non-commercial use.
11. OSGI
ACE Apache ACE is a software distribution framework that allows you to centrally manage and distribute software components, configuration data and other artifacts to target systems. It is built using OSGi and can be deployed in different topologies. The target systems are usually also OSGi based, but don't have to be. License: Apache 2.
Aries The Aries project consists of a set of pluggable Java components enabling an enterprise OSGi application programming model. License: Apache 2.
Felix OSGi framework implementation and related technologies. License: Apache 2.
Karaf Apache Karaf is an OSGi distribution for server-side applications. License: Apache 2.
Equinox OSGI framework implementation and related technologies. License: EPL
Eclipse Virgo OSGI based server that is designed to run enterprise Java applications and Spring-powered applications. License: EPL
II. Databases, search engines, big data and machine learning
1. Databases and storages
Everything which simplifies interactions with the database.Up
Thinkaurelius Titan - Titan is a highly scalable graph database optimized for storing and querying large graphs with billions of vertices and edges distributed across a multi-machine cluster. Titan is a transactional database that can support thousands of concurrent users, complex traversals, and analytic graph queries. License: Apache 2 , github's star - 2846.
Apache Cassandra - Cassandra is a partitioned row store. Rows are organized into tables with a required primary key. License: Apache 2 , github's star - 2155.
Orientdb OrientDB is the first Multi-Model DBMS with Document & Graph engine. OrientDB can run distributed (Multi-Master), supports SQL, ACID Transactions, Full-Text indexing, Reactive Queries and has a small memory footprint. OrientDB is licensed with Apache 2 license and the development is driven by OrientDB LTD and a worldwide Open Source community. License: Apache 2/CDDL 1/Eclipse Distribution 1.0, github's star - 1880.
Neo4j — Neo4j is the world’s leading Graph Database. It is a high performance graph store with all the features expected of a mature and robust database, like a friendly query language and ACID transactions. License: GNU 3/ GNU AGPLv3, github's star - 1787.
Mapdb MapDB provides concurrent Maps, Sets and Queues backed by disk storage or off-heap-memory. It is a fast and easy to use embedded Java database engine. http://www.mapdb.org/. License: Apache 2 , github's star - 1484.
Voldemort An open source clone of Amazon's Dynamo. Voldemort is a distributed key-value storage system. License: Apache 2 , github's star - 1480.
Opentsdb A scalable, distributed Time Series Database. License: GNU 3, github's star - 1336.
Hazelcast Open Source In-Memory Data Grid. License: Apache 2 , github's star - 1167.
Tinkerpop Blueprints A Property Graph Model Interface. It provides implementations, test suites, and supporting extensions. Graph databases and frameworks that implement the Blueprints interfaces automatically support Blueprints-enabled applications. Likewise, Blueprints-enabled applications can plug-and-play different Blueprints-enabled graph backends. License: BSD 3, github's star - 1083.
Apache Lucene solr Apache Lucene/Solr. Lucene is a search engine library Solr is a search engine server that uses lucene. License: Apache 2 , github's star - 1069.
Java Chronicle Java Indexed Record Chronicle — This library is an ultra low latency, high throughput, persisted, messaging and event driven in memory database. License: Apache 2 , github's star - 970.
Torodb ToroDB - Open source NoSQL database that runs on top of a RDBMS. Compatible with MongoDB protocol and APIs, but with support for native SQL, atomic operations and reliable and durable backends like PostgreSQL. License: GNU AGPLv3, github's star - 951.
Crate Crate.IO: The fast, scalable, easy to use SQL database with native full text search. https://crate.io/ .License: Apache 2 , github's star - 925.
Linkedin Pinot A realtime distributed OLAP datastore. Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. License: Apache 2 , github's star - 854.
Solandra Solandra is a real-time distributed search engine built on Apache Solr and Apache Cassandra. License: Apache 2 , github's star - 808.
Voltdb VoltDB is a horizontally-scalable, in-memory SQL RDBMS designed for applications that have extremely high read and write throughput requirements. License: GNU AGPLv3, github's star - 586.
Leveldb This is a rewrite (port) of LevelDB in Java. This goal is to have a feature complete implementation that is within 10% of the performance of the C++ original and produces byte-for-byte exact copies of the C++ code.. License: Apache 2 , github's star - 525.
Kairosdb KairosDB is a fast distributed scalable time series database written on top of Cassandra. License: Apache 2 , github's star - 485.
Linkedin Sensei Sensei is a distributed, elastic realtime searchable database. License: Apache 2 , github's star - 464.
Elephantdb Distributed database specialized in exporting key/value data from Hadoop. License: BSD 3, github's star - 464.
Apache Drill Apache Drill is a distributed MPP query layer that supports SQL and alternative query languages against NoSQL and Hadoop data storage systems. License: Apache 2 , github's star - 448.
Tinkerpop Rexster Rexster is a graph server that exposes any Blueprints graph through HTTP/REST and a binary protocol called RexPro. Extensions support standard traversal goals such as search, score, rank, and, in concert, recommendation. License: BSD 3, github's star - 402.
Embulk Embulk is a parallel bulk data loader that helps data transfer between various storages, databases, NoSQL and cloud services. License: Apache 2 , github's star - 394.
H2 - Welcome to H2, the Java SQL database. The main features of H2 are: Very fast, open source, JDBC API, Embedded and server modes; in-memory databases, Browser based Console application,Small footprint: around 1.5 MB jar file size License: Mozilla Public License 1.1. and Eclipse Public License v1.0.
Apache Empire-db Apache Empire-db is a lightweight relational database abstraction layer and data persistence component. License: Apache 2.
Apache Ignite Apache Ignite is an In-Memory Data Fabric providing in-memory data caching, partitioning, processing, and querying components. License: Apache 2.
Distributed Databases.
Databases in a distributed system that appear to applications as a single data source.
Apache Cassandra - The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. License: Apache 2 , github's star - 2155.
Apache HBase - Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable: A Distributed Storage System for Structured Data by Chang et al. License: Apache 2.
Druid - Druid is a fast column-oriented distributed data store. License: Apache 2, github's star - 1846.
Infinispan - Infinispan is a distributed in-memory key/value data store with optional schema. It can be used both as an embedded Java library and as a language-independent service accessed remotely over a variety of protocols (HotRod, REST, Memcached and WebSockets). License: Apache 2.
OpenTSDB - The Scalable Time Series Database Store and serve massive amounts of time series data without losing granularity.License: GNU 3, github's star - 1336.
2. Data structures
Efficient and specific data structures.
Apache Avro - Apache Avro is a data serialization system. License: Apache 2.
Apache Orc - The smallest, fastest columnar storage for Hadoop workloads. License: Apache 2.
Apache Parquet - Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language. License: Apache 2.
Apache Thrift -The Apache Thrift software framework, for scalable cross-language services development, combines a software stack with a code generation engine to build services that work efficiently and seamlessly between C++, Java, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, JavaScript, Node.js, Smalltalk, OCaml and Delphi and other languages. License: Apache 2.
Persistent Collection - PCollections serves as a persistent and immutable analogue of the Java Collections Framework. License: MIT.
Protobuf - Protocol Buffers (a.k.a., protobuf) are Google's language-neutral, platform-neutral, extensible mechanism for serializing structured data. License: BSD 3.
Elasticsearch analysis ik The IK Analysis plugin integrates Lucene IK analyzer into elasticsearch, support customized dictionary. License: ?, github's star - 395.
Apache ManifoldCF Open-source software for transferring content between repositories or search indexes License: Apache 2.
Lemur Project The Lemur Project develops search engines, browser toolbars, text analysis tools, and data resources that support research and development of information retrieval and text mining software, including the Indri search engine and ClueWeb09 dataset. License: BSD License
YaCy - The YaCy Search Engine application, github's star - 127. License: GNU Lesser and GNU
Facebook Presto Distributed SQL query engine for big data (Cassandra, Hive, Kafka, MySQL, PostgreSQL and so on). License: Apache 2 , github's star - 3603.
Jedis A blazingly small and sane redis java client. License: MIT , github's star - 2495.
Tinkerpop Gremlin A Graph Traversal Language. Gremlin is a domain specific language for traversing property graphs. Gremlin makes use of Pipes to perform complex graph traversals. This language has application in the areas of graph query, analysis, and manipulation. License: BSD 3 , github's star - 1370.
Mongodb Java Driver The Java driver for MongoDB. License: Apache 2 / Creative Commons Attribution , github's star - 1276.
Yahoo Mysql_perf_analyzer MySQL Performance Analyzer is an open source project for MySQL performance monitoring and analysis. License: Apache 2 , github's star - 1082.
Liquibase Liquibase — source control for your database, supports multiple developers, database types and so on. http://www.liquibase.org/ . License: Apache 2 , github's star - 734.
Mongodb Morphia MongoDB object-document mapper in Java based on. License: Apache 2 , github's star - 725.
Couchdb lucene Enables full-text searching of CouchDB documents using Lucene. License: Apache 2 , github's star - 639.
Forcedotcom Phoenix Phoenix is a SQL skin over HBase, delivered as a client-embedded JDBC driver, powering the HBase use cases at Salesforce.com. Phoenix targets low-latency queries (milliseconds), as opposed to batch operation via map/reduce. License: BSD 3 , github's star - 507.
Variety A schema analyzer for MongoDB. License: MIT , github's star - 505.
Spring data mongodb Provide support to increase developer productivity in Java when using MongoDB. Uses familiar Spring concepts such as a template classes for core API usage and lightweight repository style data access. License: Apache 2 , github's star - 394.
Apache Phoenix - Apache Phoenix enables OLTP and operational analytics in Hadoop for low latency applications by combining the best of both worlds, License: Apache 2.
FlexyPool - FlexyPool adds metrics and failover strategies to a given Connection Pool, allowing it to resize on demand. License: Apache 2.
LightAdmin - Pluggable data administration UI library for Java web applications. License: Apache 2.
JOOQ OOQ is an innovative solution for a better integration of Java applications with popular databases like Oracle, Microsoft SQL Server, IBM DB2, or SAP Sybase. http://www.jooq.org/ . License: Apache 2 , github's star - 830.
Querydsl Querydsl is a framework which enables the construction of type-safe SQL-like queries for multiple backends including JPA, MongoDB and SQL in Java. http://www.querydsl.com/ . License: Apache 2 , github's star - 570.
Kundera A JPA 2.1 compliant Polyglot Object-Datastore Mapping Library for NoSQL Datastores. License: Apache 2 , github's star - 490.
Spring data jpa Simplifies the development of creating a JPA-based data access layer. License: Apache 2 , github's star - 459.
Jdbi jDBI is designed to provide convenient tabular data access in Java(tm). It uses the Java collections framework for query results, provides a convenient means of externalizing sql statements, and provides named parameter support for any database being used. http://jdbi.org/ .License: Apache 2 , github's star - 458.
ActiveJDBC ActiveJDBC is a fast and lean Java ORM. License: Apache 2 , github's star - 230.
Vibur DBCP - Concurrent, fast, and fully-featured JDBC connection pool, which provides a non-starvation guarantee for application threads, statement caching, slow SQL queries detection and logging, and Hibernate integration, among other features. License: Apache 2.
Ebean - Ebean ORM for Java/Kotlin.Fast and simple data access on the JVM. License: Apache 2.
OrmLite - Object Relational Mapping Lite (ORM Lite) provides some simple, lightweight functionality for persisting Java objects to SQL databases while avoiding the complexity and overhead of more standard ORM packages. License: ISC.
Apache MetaModel With MetaModel you get a uniform connector and query API to many very different datastore types, including: Relational (JDBC) databases, CSV files, Excel spreadsheets, XML files, JSON files, Fixed width files, MongoDB, Apache CouchDB, Apache HBase, Apache Cassandra, ElasticSearch, OpenOffice.org databases, Salesforce.com, SugarCRM and even collections of plain old Java objects (POJOs). License: Apache 2.
Storm - Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more. License: Apache 2 , github's star - 8636.
OpenRefine — OpenRefine is a free, open source power tool for working with messy data and improving it. License: BSD , github's star - 2939.
Addthis Stream lib - Stream summarizer and cardinality estimator. License: Apache 2 , github's star - 1145.
HdrHistogram (A High Dynamic Range (HDR) Histogram ) — HdrHistogram: A High Dynamic Range (HDR) Histogram: HdrHistogram supports the recording and analyzing of sampled data value counts across a configurable integer value range with configurable value precision within the range. License: BSD 2 , github's star - 672.
HazyResearch DeepDive DeepDive is a system to extract value from dark data. Like dark matter, dark data is the great mass of data buried in text, tables, figures, and images, which lacks structure and so is essentially unprocessable by existing software. License: Apache 2 , github's star - 531.
Apache Incubator Zeppelin Zeppelin, a web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL, Scala and more. License: Apache 2 , github's star - 463.
Seldon Server Enterprise machine learning platform for prediction and recommendation on Apache Spark. License: Apache 2 , github's star - 453.
Pulsar - Realtime analytics, this includes the core components of Pulsar pipeline. License: GNU 2.0, github's star - 435.
Suro: Netflix's Data Pipeline — Suro: Netflix's Data Pipeline. Suro is a data pipeline service for collecting, aggregating, and dispatching large volume of application events including log data. License: Apache 2 , github's star - 405.
Apache UIMA Annotator components and a scalable integration and deployment framework for Unstructured Information analysis. License: Apache 2.
Apache Storm - Storm is a distributed realtime computation system. Similar to how Hadoop provides a set of general primitives for doing batch processing, Storm provides a set of general primitives for doing realtime computation.License: Apache 2 , github's star - 2098.
H2o h2o = fast statistical, machine learning & math runtime for bigdata. License: Apache 2 , github's star - 1725.
Cloudera Oryx The Oryx open source project provides simple, real-time large-scale machine learning / predictive analytics infrastructure. It implements a few classes of algorithm commonly used in business applications: collaborative filtering / recommendation, classification / regression, and clustering. License: Apache 2 , github's star - 1142.
Twitter Elephant bird - Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code. License: Apache 2 , github's star - 861.
Apache Hadoop - The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. License: Apache 2 , github's star - 803.
Google Mr4c MR4C is an implementation framework that allows you to run native code within the Hadoop execution framework. License: GNU Lesser 3, github's star - 702.
Alibaba Jstorm — JStorm is a distributed and fault-tolerant realtime computation system. Inspired by Apache Storm, JStorm has been completely rewritten in Java and provides many more enhanced features. JStorm has been widely used in many enterprise environments and proved robust and stable. License: Apache 2 , github's star - 654.
Etsy Oculus Oculus is the anomaly correlation component of Etsy's Kale system. License: MIT , github's star - 618.
Linkedin Datafu Apache DataFu is a collection of libraries for working with large-scale data in Hadoop. The project was inspired by the need for stable, well-tested libraries for data mining and statistics. License: Apache 2 , github's star - 570.
Linkedin Gobblin Universal data ingestion framework for Hadoop. License: Apache 2 , github's star - 547.
Apache Flink - Apache Flink is an open source stream processing framework with powerful stream- and batch-processing capabilities. License: Apache 2 , github's star - 475.
Oryx 2 - Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning. License: Apache 2 , github's star - 456.
Apache Flume Apache Flume is a distributed, reliable, and available system for efficiently collecting, aggregating and moving large amounts of log data from many different sources to a centralized data store. License: Apache 2.
Apache Tajo Tajo is an open source big data warehouse system in Hadoop for processing web-scale data sets. License: Apache 2.
Apache Tez Apache Tez is an effort to develop a generic application framework which can be used to process arbitrarily complex directed-acyclic graphs (DAGs) of data-processing tasks and also a re-usable set of data-processing primitives which can be used by other projects. License: Apache 2.
Apache REEF Apache REEF (Retainable Evaluator Execution Framework) is a scale-out computing fabric that eases the development of Big Data applications on top of resource managers such as Apache YARN and Mesos. License: Apache 2.
Apache Pig Apache Pig is a platform for analyzing large data sets on Hadoop. License: Apache 2.
Data store, database, search or SQL-like query engine for big data.
Druid Column oriented distributed data store ideal for powering interactive applications. License: Apache 2 , github's star - 1846.
Apache Hive - The Apache Hive data warehouse software facilitates querying and
managing large datasets residing in distributed storage. Built on top
of Apache Hadoop. https://hive.apache.org/ .License: Apache 2 , github's star - 619.
Apache Kylin Apache Kylin is an open source Distributed Analytics Engine to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets. License: Apache 2 , github's star - 504.
Elasticsearch hadoop - Elasticsearch real-time search and analytics natively integrated with Hadoop. License: Apache 2 , github's star - 457.
Facebook Presto Presto is a distributed SQL query engine for big data. License: Apache 2 , github's star - 3603.
Apache MetaModel With MetaModel you get a uniform connector and query API to many very different datastore types, including: Relational (JDBC) databases, CSV files, Excel spreadsheets, XML files, JSON files, Fixed width files, MongoDB, Apache CouchDB, Apache HBase, Apache Cassandra, ElasticSearch, OpenOffice.org databases, Salesforce.com, SugarCRM and even collections of plain old Java objects (POJOs). License: Apache 2.
Apache Accumulo Apache Accumulo is based on Google’s BigTable design and is built on top of Apache Hadoop, Zookeeper, and Thrift. Apache Accumulo features a few novel improvements on the BigTable design in the form of cell-based access control and a server-side programming mechanism that can modify key/value pairs at various points in the data management process. License: Apache 2.
Apache Gora provides an in-memory data model and persistence for big data. Gora supports persisting to column stores, key value stores, document stores and RDBMSs, and analyzing the data with extensive Apache Hadoop MapReduce support. License: Apache 2.
[Apache Sqoop] Apache Sqoop(TM) is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.(http://sqoop.apache.org) License: Apache 2.
Giraph Apache Giraph is an iterative graph processing system built for high scalability. For example, it is currently used at Facebook to analyze the social graph formed by users and their connections. Лицензия: Apache 2.
Monitoring, testing and managing tools for big data
Twitter Ambrose A platform for visualization and real-time monitoring of data workflows. License: Apache 2 , github's star - 1024.
Umongo - Desktop app to browse and administer your MongoDB cluster. License: Apache 2 , github's star - 495.
Apache Ambari The Apache Ambari project is aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoring Apache Hadoop clusters. Ambari provides an intuitive, easy-to-use Hadoop management web UI backed by its RESTful APIs. License: Apache 2.
Apache Chukwa Chukwa is an open source data collection system for monitoring large distributed systems. Chukwa is built on top of the Hadoop Distributed File System (HDFS) and Map/Reduce framework and inherits Hadoop’s scalability and robustness. Chukwa also includes a flexible and powerful toolkit for displaying, monitoring and analyzing results to make the best use of the collected data. License: Apache 2.
Apache Bigtop Bigtop is an Apache Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the leading open source big data components. License: Apache 2.
Apache BookKeeper BookKeeper is a replicated log service which can be used to build replicated state machines. A log contains a sequence of events which can be applied to a state machine. BookKeeper guarantees that each replica state machine will see all the same entries, in the same order. License: Apache 2.
Apache Crunch Provides a framework for writing, testing, and running MapReduce pipelines. License: Apache 2.
Apache MRUnit Apache MRUnit is a Java library that helps developers unit test Apache Hadoop map reduce jobs. License: Apache 2.
Apache Oozie Oozie is a workflow scheduler system to manage Apache Hadoop jobs. License: Apache 2.
8. Machine Learning
Tools that provide specific statistical algorithms which allow learning from data.Up
Airbnb Aerosolve A machine learning library designed from the ground up to be human friendly. License: Apache 2 , github's star - 1672.
Smile Smile (Statistical Machine Intelligence and Learning Engine) is a set of pure Java libraries of various state-of-art machine learning algorithms. Smile is self contained and requires only Java standard library. License: Apache 2 , github's star - 1519.
Deeplearning4j Deeplearning4J is an Apache 2.0-licensed, open-source, distributed neural net library written in Java and Scala. http://deeplearning4j.org/ .License: Apache 2 , github's star - 1172.
Libsvm Libsvm is a simple, easy-to-use, and efficient software for SVM classification and regression. It solves C-SVM classification, nu-SVM classification, one-class-SVM, epsilon-SVM regression, and nu-SVM regression. License: BSD 3, github's star - 812.
Neuralnetworks java deep learning algorithms and deep neural networks with gpu acceleration. License: MIT , github's star - 583.
Datumbox framework Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications. License: Apache 2 , github's star - 525.
Apache Mahout The Apache Mahout project's goal is to build an environment for quickly creating scalable performant machine learning applications. https://mahout.apache.org/ .License: Apache 2 , github's star - 492.
Encog java core Encog is an advanced machine learning framework that supports a variety of advanced algorithms, as well as support classes to normalize and process data. Machine learning algorithms such as Support Vector Machines, Artificial Neural Networks, Genetic Programming, Bayesian Networks, Hidden Markov Models, Genetic Programming and Genetic Algorithms are supported. License: Apache 2 , github's star - 394.
Apache Flink - Apache Flink is an open source stream processing framework with powerful stream- and batch-processing capabilities. https://flink.apache.org/ Subproject: FlinkML - FlinkML is the Machine Learning (ML) library for Flink. License: Apache 2 , github's star - 475.
Apache Hadoop - The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. http://hadoop.apache.org/ License: Apache 2 , github's star - 803.
Apache Spark - Apache Spark™ is a fast and general engine for large-scale data processing. Subproject: MLlib. License: Apache 2.
DeepDive - DeepDive is a system to extract value from dark data. Like dark matter, dark data is the great mass of data buried in text, tables, figures, and images, which lacks structure and so is essentially unprocessable by existing software. License: Creative Commons Attribution 4.0.
H2o h2o = fast statistical, machine learning & math runtime for bigdata. http://h2o.ai/ License: Apache 2 , github's star - 1725.
JSAT - Java Statistical Analysis Tool, a Java library for Machine Learning. License: GNU 3.
Weka - Weka is a collection of machine learning algorithms for data mining tasks. The algorithms can either be applied directly to a dataset or called from your own Java code. Weka contains tools for data pre-processing, classification, regression, clustering, association rules, and visualization. It is also well-suited for developing new machine learning schemes. License: GNU.
Protégé - A free, open-source ontology editor and framework for building intelligent systems. License: BSD 2.
EvA2 - A Java based framework for Evolutionary Algorithms -- formerly known as JavaEvA/EvA. License: GNU LESSER 3.
htm.java - Hierarchical Temporal Memory implementation in Java - an official Community-Driven Java port of the Numenta Platform for Intelligent Computing (NuPIC). License: GNU AFFERO 3.
JAVA-ML - Java Machine Learning Library (Java-ML). License: GNU 2.
JSAT - Numerous Machine Learning algorithms for classification, regression, and clustering. License: GNU 3.
Meka - An open source implementation of methods for multi-label classification and evaluation (extension to Weka). License: GNU.
wAlnut - Object oriented model of partial human brain with 1 theorized common learning algorithm. Work in progress towards a strong emotional AI. License: GNU 3
Semantic Web and Linked Data
The Semantic Web provides a common framework that allows data to be shared and reused across application, enterprise, and community boundaries
Apache Jena A framework for developing Semantic Web and Linked Data applications in Java. License: Apache 2.
Constraint Satisfaction Problem Solver
Libraries that help on implementing optimization and satisfiability problems.
Choco - Choco is a Free and Open-Source Software dedicated to Constraint Programming. It aims at describing hard combinatorial problems in the form of Constraint Satisfaction Problems and solving them with Constraint Programming techniques. License: BSD.
OptaPlanner - OptaPlanner is a constraint satisfaction solver. It optimizes business resource planning. Every organization faces scheduling puzzles: assign a limited set of constrained resources (employees, assets, time and money) to provide products or services to customers. License: Apache 2.
Sat4J - Sat4j is a java library for solving boolean satisfaction and optimization problems. It can solve SAT, MAXSAT, Pseudo-Boolean, Minimally Unsatisfiable Subset (MUS) problems. License: GNU Lesser 3 and Eclipse Public 1.0.
Natural Language Processing (NLP) and Speech Recognition
Stanfordnlp CoreNLP Stanford CoreNLP provides a set of natural language analysis tools written in Java. License: GNU 2, github's star - 871.
Apache OpenNLP - The Apache OpenNLP library is a machine learning based toolkit for the processing of natural language text. License: Apache 2.
LingPipe - LingPipe is tool kit for processing text using computational linguistics. License: AGPL or License: proprietary. or
Mallet - MALLET is a Java-based package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text. License: Eclipse Public License v1.0.
Twitter Text Libraries - This repo is a collection of libraries and conformance tests to standardize parsing of tweet text. It synchronizes development, testing, creating issues, and pull requests for twitter-text's implementations and specification. License: Apache 2.
NLP4J The NLP4J project (formerly known as ClearNLP) provides a NLP toolkit for JVM languages. This project is currently developed by the NLP Research Group at Emory University. License: Apache 2.
Joshua Joshua is an open-source statistical machine translation decoder for phrase-based (new in 6.0), hierarchical, and syntax-based machine translation, written in Java. It is developed at the Human Language Technology Center of Excellence at Johns Hopkins University. License: BSD 2.
ClearTK - ClearTK is a framework for developing machine learning and natural language processing components within the Apache Unstructured Information Management Architecture, github star: 34. License: Apache 2.
Apache cTAKES - Apache cTAKES™ is a natural language processing system for extraction of information from electronic medical record clinical free-text. License: Apache 2.
Apache Tika The Apache Tika toolkit detects and extracts metadata and structured text content from various documents using existing parser libraries. License: Apache 2.
Apache Tomcat - Robust all-round server for Servlet and JSP. License: Apache 2 , github's star - 531.
Nginx clojure - Nginx module for embedding Clojure or Java or Groovy programs, typically those Ring based handlers. License: BSD 3 , github's star - 514.
Apache James The Apache Java Enterprise Mail Server (a.k.a. Apache James) is a 100% pure Java SMTP and POP3 Mail server and NNTP News server. We have designed James to be a complete and portable enterprise mail engine solution based on currently available open protocols. License: Apache 2.
Socket.io java client Socket.IO Client Implementation in Java. License: MIT , github's star - 688.
Socket.io client.java Full-featured Socket.IO Client Library for Java, which is compatible with Socket.IO v1.0 and later. License: MIT , github's star - 603.
EsotericSoftware Kryonet TCP/UDP client/server library for Java, based on Kryo. License: BSD 3, github's star - 539.
Undertow - Web server providing both blocking and non-blocking API’s based on NIO. Used as a network layer in WildFly. License: Apache 2.
Apache MINA Apache MINA is a network application framework which helps users develop high performance and high scalability network applications easily. It provides an abstract, event-driven, asynchronous API over various transports such as TCP/IP and UDP/IP via Java NIO. License: Apache 2.
Apache HttpComponents project is responsible for creating and maintaining a toolset of low level Java components focused on HTTP and associated protocols. HTTP transport library including support for asynchronous execution based on Java NIO. License: Apache 2.
3. Message, message broker and message queue
Tools that help to send messages between clients in order to ensure protocol independency.Up
Apache Synapse Apache Synapse is a lightweight ESB engine and XML router. License: Apache 2.
Apache ServiceMix Apache ServiceMix is a flexible, open-source integration container that unifies the features and functionality of Apache ActiveMQ, Camel, CXF, and Karaf into a powerful runtime platform you can use to build your own integrations solutions. It provides a complete, enterprise ready ESB exclusively powered by OSGi. License: Apache 2.
Square Okhttp An HTTP+HTTP/2 client for Android and Java applications. License: Apache 2 , github's star - 5022.
AsyncHttpClient Asynchronous Http and WebSocket Client library for Java. License: Apache 2 , github's star - 2149.
Http request Java HTTP Request Library. License: MIT . , github's star - 1477.
Nanohttpd Tiny, easily embeddable HTTP server in Java. License: BSD 3, github's star - 1184.
Http kit Hhttp-kit is a minimalist, event-driven, high-performance Clojure HTTP server/client library with WebSocket and asynchronous support. License: Apache 2 , github's star - 1172.
Dropwizard Opinionated framework for setting up modern web applications with Jetty, Jackson, Jersey and Metrics. License: Apache 2 , github's star - 3427.
Swagger Swagger is a specification and complete framework implementation for describing, producing, consuming, and visualizing RESTful web services. http://swagger.io/ License: Apache 2 , github's star - 2657.
Generator jhipster Hipster stack for Java developers. Spring Boot + AngularJS in one handy generator. License: Apache 2 , github's star - 2352.
Jersey JAX-RS reference implementation. License: CDDL 1.0, github's star - 864.
Linkedin Rest.li Rest.li is a REST+JSON framework for building robust, scalable service architectures using dynamic discovery and simple asynchronous APIs. License: Apache 2 , github's star - 825.
Spring hateoas Spring HATEOAS - Library to support implementing representations for hyper-text driven REST web services. License: Apache 2 , github's star - 456.
Feign - HTTP client binder inspired by Retrofit, JAXRS-2.0, and WebSocket. License: Apache 2.
RESTEasy - Fully certified and portable implementation of the JAX-RS specification. License: Apache 2.
RestExpress - Thin wrapper on the JBOSS Netty HTTP stack to provide scaling and performance. License: Apache 2.
RestX - Framework based on annotation processing and compile-time source generation. License: Apache 2.
Apache Wink RESTFul web services based on JAX-RS specification. License: Apache 2.
Apache Olingo Apache Olingo is a Java and JavaScript library that implements the Open Data Protocol (OData). Open Data Protocol (OData) is an open protocol which allows the creation and consumption of queryable and interoperable RESTful APIs in a simple and standard way. License: Apache 2.
Rapidoid - A simple, secure and extremely fast framework consisting of embedded HTTP server, GUI components and dependency injection. License: Apache 2, github's star - 566.
Jmxtrans This is effectively the missing connector between speaking to a JVM via JMX on one end and whatever logging / monitoring / graphing package that you can dream up on the other end. License: ?, github's star - 708.
Apache Camel Apache Camel is a powerful open source integration framework based on known Enterprise Integration Patterns with powerful Bean Integration. License: Apache 2 , github's star - 490.
Apache CXF Apache CXF is an open source services framework. CXF helps you build and develop services using frontend programming APIs, like JAX-WS and JAX-RS. These services can speak a variety of protocols such as SOAP, XML/HTTP, RESTful HTTP, or CORBA and work over a variety of transports such as HTTP, JMS or JBI. License: Apache 2.
Sparklemotion Nokogiri Nokogiri is an HTML, XML, SAX, and Reader parser with XPath and CSS selector support. License: Apache 2 , github's star - 3323.
Jsoup Scrapes, parses, manipulates and cleans HTML. http://jsoup.org/ License: MIT , github's star - 2006.
Webmagic A scalable web crawler framework. License: Apache 2 , github's star - 1089.
Antlr4 ANTLR (ANother Tool for Language Recognition) is a powerful parser generator for reading, processing, executing, or translating structured text or binary files. License: BSD 3, github's star - 836.
Parboiled Elegant parsing in Java and Scala - lightweight, easy-to-use, powerful. License: Apache 2 , github's star - 775.
Pegdown A pure-Java Markdown processor based on a parboiled PEG parser supporting a number of extensions. License: Apache 2 , github's star - 692.
Apache Nutch - Highly extensible, highly scalable web crawler for production environment. License: Apache 2.
JSON java A reference implementation of a JSON package in Java. License: ?, github's star - 1561.
Jsonschema2pojoGenerates Java types from JSON Schema (or example JSON) and annotates those types for data-binding with Jackson 1.x or 2.x, Gson, etc. License: Apache 2 , github's star - 914.
Square Moshi A modern JSON library for Android and Java. License: Apache 2 , github's star - 765.
FasterXML Jackson core Core part of Jackson that defines Streaming API as well as basic shared abstractions. License: Apache 2 , github's star - 682.
FasterXML Jackson databind Core part of Jackson that defines Streaming API as well as basic shared abstractions. License: Apache 2 , github's star - 640.
Json schema validator A JSON Schema validation implementation in pure Java, which aims for correctness and performance, in that order. License: GNU Lesser 3/Apache 2, github's star - 411.
Genson -Powerful and easy to use Java to JSON conversion library. License: Apache 2.
Gson - Serializes objects to JSON and vice versa. Good performance with on-the-fly usage. License: Apache 2.
Jackson - Similar to GSON but has performance gains if you need to instantiate the library more often. License: Apache 2.
LoganSquare - JSON parsing and serializing library based on Jackson's streaming API. Outpeforms GSON & Jackson's library. License: Apache 2.
9. CSV
Frameworks and libraries that simplify reading/writing CSV data.Up
opencsv - Simple CSV parser with a commercial-friendly license. License: Apache 2.
Super CSV - Powerful CSV parser with support for Dozer, Joda-Time and Java 8. License: Apache 2.
uniVocity-parsers - One of the fastest and most feature-complete CSV. Also comes with parsers for TSV and fixed width records. License: Apache 2.
Twitter Zipkin Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in microservice architectures. License: Apache 2 , github's star - 2442.
Twitter4j Twitter4J is an open-sourced, mavenized and Google App Engine safe Java library for the Twitter API. License: Apache 2 , github's star - 1551.
Netflix Ice AWS (Amazon Web Services) Usage Tool. License: Apache 2 , github's star - 1358.
Twitter Commons Twitter common libraries for python and the JVM. License: Apache 2 , github's star - 964.
Alibaba RocketMQ RocketMQ is a fast, reliable, scalable, easy to use message oriented middleware breeding from alibaba massive messaging business. License: Apache 2 , github's star - 627.
Twitter Hbc A Java HTTP client for consuming Twitter's Streaming API. License: Apache 2 , github's star - 498.
Spring social Allows you to connect your applications with SaaS providers such as Facebook and Twitter. License: Apache 2 , github's star - 409.
XChange XChange is a Java library providing a streamlined API for interacting with 50+ Bitcoin and Altcoin exchanges providing a consistent interface for trading and accessing market data. License: MIT , github's star - 455.
bitcoinj A library for working with Bitcoin. License: Apache 2 , github's star - 453.
DiabloMiner OpenCL miner for Bitcoin. License: GNU 3, github's star - 443.
Netflix SimianArmy - Tools for keeping your cloud operating in top form. Chaos Monkey is a resiliency tool that helps applications tolerate random instance failures. License: Apache 2 , github's star - 2892.
Netflix Eureka AWS Service registry for resilient mid-tier load balancing and failover.. License: Apache 2 , github's star - 1051.
Aws sdk java Official mirror of the AWS (Amazon Web Services) SDK for Java. License: Apache 2 , github's star - 1008.
Syncany Syncany is a cloud storage and filesharing application with a focus on security and abstraction of storage. License: GNU 3, github's star - 772.
Legacy Jclouds jclouds is an open source library that helps you get started in the cloud and reuse your java development skills. Our api allows you to freedom to use portable abstractions or cloud-specific features. We support many clouds including Amazon, VMWare, Azure, and Rackspace. License: Apache 2 , github's star - 507.
Elasticsearch - Open Source, Distributed, RESTful Search Engine. License: Apache 2 , github's star - 11833.
Elasticsearch analysis ik The IK Analysis plugin integrates Lucene IK analyzer into elasticsearch, support customized dictionary. License: ?, github's star - 395.
Apache CloudStack Apache CloudStack is an IaaS (“Infrastracture as a Service”) cloud orchestration platform. License: Apache 2.
Apache Stratos Apache Stratos is a highly-extensible Platform-as-a-Service (PaaS) framework that helps run Apache Tomcat, PHP, and MySQL applications and can be extended to support many more environments on all major cloud infrastructures. License: Apache 2.
Apache Airavata Apache Airavata is a software framework for executing and managing computational jobs and workflows on distributed computing resources including local clusters, supercomputers, national grids, academic and commercial clouds. Airavata is dominantly used to build Web-based science gateways and assist to compose, manage, execute, and monitor large scale applications (wrapped as Web based services) and workflows composed of these services. License: Apache 2.
13. Cluster Management
Frameworks which can dynamically manage applications inside of a cluster.Up
Apache Aurora - Apache Aurora is a Mesos framework for long-running services and cron jobs. License: Apache 2.
Singularity - Singularity is a Mesos framework that makes deployment and operations easy. It supports web services, background workers, scheduled jobs, and one-off tasks. License: ?.
Apache Helix A cluster management framework for partitioned and replicated distributed resources. License: Apache 2.
Apache Airavata Apache Airavata is a software framework for executing and managing computational jobs and workflows on distributed computing resources including local clusters, supercomputers, national grids, academic and commercial clouds. Airavata is dominantly used to build Web-based science gateways and assist to compose, manage, execute, and monitor large scale applications (wrapped as Web based services) and workflows composed of these services. License: Apache 2.
14. Document Processing (XLS, DOC and PDF)
Libraries that assist with processing office document formats.
Apache POI - Supports OOXML (XLSX, DOCX, PPTX) as well as OLE2 (XLS, DOC or PPT). License: Apache 2.
documents4j - API for document format conversion using third-party converters such as MS Word. License: Apache 2.
Docx4j Docx4j is an open source Java library for manipulating Microsoft OpenXML files (Word docx, Powerpoint pptx, and Excel xlsx) via JAXB. License: Apache 2.
jOpenDocument - Processes the OpenDocument format. License: GNU or proprietary. and
Apache Tika The Apache Tika toolkit detects and extracts metadata and structured text content from various documents using existing parser libraries. License: Apache 2.
PDF
Everything that helps with the creation of PDF files.Up
For working with platform-specific native libraries.Up
Java Native Access (JNA)Work with native libraries without writing JNI. Also provides interfaces to common system libraries. License: GNU Lesser 2.1 or Apache 2. , github's star - 1750.
JNR - Work with native libraries without writing JNI. Also provides interfaces to common system libraries. Same goals as JNA, but faster, and serves as the basis for the upcoming Project Panama. License: Apache 2.
16. XML and SOAP
Xalan Xalan-J is an XSLT processor written in Java. License: Apache 2.
Xerces Xerces-J is a validating XML parser written in Java. License: Apache 2.
Santuario Library implementing XML Digital Signature Specification & XML Encryption Specification. License: Apache 2.
VXQuery Apache VXQuery implements a parallel XML Query processor. License: Apache 2.
Apache Axis Web Service containers that helps users to create, deploy, and run Web Services. Axis2 is a Web Services / SOAP / WSDL engine, the successor to the widely used Apache Axis SOAP stack. License: Apache 2.
17. Geospatial Service Interation
Libraries for working with geospatial data and algorithms.
Mockito Creation of test double objects in automated unit tests for the purpose of TDD or BDD. License: MIT , github's star - 1307.
Selenium Portable software testing framework for web applications. License: Apache 2 , github's star - 1305.
Cucumber jvm Cucumber-JVM is a pure Java implementation of Cucumber that supports the most popular programming languages for the JVM. License: MIT , github's star - 1047.
Spock JUnit-compatible framework featuring an expressive Groovy-derived specification language. License: Apache 2 , github's star - 669.
Google Firing range Firing Range is a test bed for web application security scanners, providing synthetic, wide coverage for an array of vulnerabilities. It can be deployed as a Google App Engine application. License: Apache 2 , github's star - 650.
Fitnesse FitNesse is the fully integrated stand-alone acceptance testing framework and wiki.. License: CPL-1.0, github's star - 618.
Sikuli Sikuli is a visual technology to automate graphical user interfaces (GUI) using images (screenshots). The current release of Sikuli includes Sikuli Script, a visual scripting API for Jython, and Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily. License: MIT , github's star - 609.
JavaHamcrest Matchers that can be combined to create flexible expressions of intent. License: BSD 3, github's star - 561.
Wiremock Stubbs and mocks web services. License: Apache 2 , github's star - 508.
Gatling - Load testing tool designed for ease of use, maintainability and high performance. License: MIT.
GreenMail - In-memory email server for integration testing. Supports SMTP, POP3 and IMAP including SSL. License: MIT.
JGiven - Developer-friendly BDD testing framework compatible with JUnit and TestNG. License: MIT.
JMockit - Mocks static, final methods and more. License: MIT.
JUnitParams - Creation of readable and maintainable parametrised tests. License: Apache 2.
Moco - Concise web services for stubs and mocks, Duke's Choice Award 2013. License: MIT.
PIT - Fast mutation-testing framework for evaluating fault-detection abilities of existing JUnit or TestNG test-suites. License: Creative Commons License.
PowerMock - Enables mocking of static methods, constructors, final classes and methods, private methods and removal of static initializers. License: Apache 2.
REST Assured - Java DSL for easy testing for REST/HTTP services. License: Apache 2.
Selenide -Concise API around Selenium to write stable and readable UI tests. License: MIT.
Unitils - Modular testing library for unit and integration testing. License: Apache 2.
2. Code Coverage
Frameworks and tools that enable collection of code coverage metrics for test suites.Up
JaCoCo - Framework that enables collection of code coverage metrics, using both offline and runtime bytecode instrumentation; prominently used by EclEmma, the Eclipse code-coverage plugin. License: Eclipse Public License v1.0, Apache 2, BSD.
Clover - Proprietary code coverage tool by Atlassian that relies on source-code instrumentation, instead of bytecode instrumentation. License: proprietary
Cobertura - Relies on offline (or static) bytecode instrumentation and class loading to collect code coverage metrics. License: GNU 2.
JCov - Code coverage tool used in the OpenJDK project's development toolchain. License: GNU 2.
3. Continuous Integration
Tools which support continuously building, testing and releasing applications.Up
Bamboo - Atlassian's solution with good integration of their other products. You can either apply for an open-source license or buy it.
TeamCity - JetBrain's CI solution with a free version. License: proprietary
Travis - Hosted service often used for open-source projects. License: ?
Hudson - Hudson monitors the execution of repeated jobs, such as building a software project or jobs run by cron. Currently Hudson focuses on the following two jobs: Building/testing software projects continuously and Monitoring executions of externally-run jobs. License: Eclipse Public License v1.0.
Apache Continuum Apache Continuum software is an enterprise-ready continuous integration server with features such as automated builds, release management, role-based security, and integration with popular build tools and source control management systems.. License: Apache 2.
4. Formal Verification
Formal-methods tools: proof assistants, model checking, symbolic execution etc.Up
CATG - Concolic unit testing engine. Automatically generates unit tests using formal methods. License: BSD 2, License: BSD 2.
Checker Framework - Pluggable type systems. Includes nullness types, physical units, immutability types and more. License: GNU 2.
Daikon - Daikon detects likely program invariants and can generate JML specs based on those invariats. License: GNU.
Java Modeling Language (JML) - Behavioral interface specification language that can be used to specify the behavior of code modules. It combines the design by contract approach of Eiffel and the model-based specification approach of the Larch family of interface specification languages, with some elements of the refinement calculus. Used by several other verification tools. License: GNU 2.
jCUTE - Concolic unit testing engine that automatically generates unit tests. Concolic execution combines randomized concrete execution with symbolic execution and automatic constraint solving. License: proprietary.
JMLOK 2.0 - Detects nonconformances between code and JML specification through the feedback-directed random tests generation, and suggests a likely cause for each nonconformance detected. License: GNU 3.
KeY - The KeY System is a formal software development tool that aims to integrate design, implementation, formal specification, and formal verification of object-oriented software as seamlessly as possible. Uses JML for specification and symbolic execution for verification. License: GNU.
OpenJML - Translates JML specifications into SMT-LIB format and passes the proof problems implied by the program to backend solvers. License: GNU 2 and Eclipse Public License v1.0.
V. Tools for developing
1. IDE
Integrated development environments that try to simplify several aspects of development.Up
JetBrains Ideavim Vim emulation plug-in for IDEs based on the IntelliJ platform. License: GNU 2, github's star - 1199.
Rstudio RStudio is an integrated development environment (IDE) for R. License: GNU AGPLv3, github's star - 1048.
Vrapper Vim-like editing in Eclipse. License: GNU 3.0, github's star - 669.
Eclipse themes Jeeeyul's Eclipse Themes allows you to customize every single details of Eclipse's appearance. License: Eclipse Public 1.0, github's star - 623.
Eclim Expose eclipse features inside of vim. License: GNU 3, github's star - 590.
JetBrains MPS JetBrains Meta programming System. Design your own Domain Specific Language with full development environment. Get code editor with completion, semantics and type checking with one click. Write generators to compile your DSL into multiple target languages, such as Java, C, XML, and many more. License: Apache 2 , github's star - 525.
Idea markdown Markdown language support for IntelliJ IDEA. License: Apache 2 , github's star - 405.
Tools which handle the build cycle and dependencies of an application.
Apache Maven - Declarative build and dependency management which favors convention over configuration. It might be preferable to Apache Ant which uses a rather procedural approach and can be difficult to maintain. License: Apache 2 , github's star - 614.
Google Bazel - Build tool from Google that builds code quickly and reliably. License: Apache 2 , github's star - 2809.
Gradle - Incremental builds which are programmed via Groovy instead of declaring XML. Works well with Maven's dependency management. License: Apache 2 , github's star - 2465.
Apache Ant - pache Ant is a Java library and command-line tool whose mission is to drive processes described in build files as targets and extension points dependent upon each other. Subproject: Apache AntUnit - testing Ant task, Apache Compress Ant Library - support additional archive formats, Apache Ivy - very powerful dependency manager, Apache IvyDE - IvyDE plugin for Eclipse. License: Apache 2.
Facebook Buck - A fast build system that encourages the creation of small, reusable modules over a variety of platforms and languages. License: Apache 2 , github's star - 1449.
Archiva Apache The Build Artifact Repository Manager. Apache Archiva™ is an extensible repository management software that helps taking care of your own personal or enterprise-wide build artifact repository. It is the perfect companion for build tools such as Maven, Continuum, and ANT. License: Apache 2.
config - Configuration library for JVM languages. License: Apache 2 , github's star - 614.
owner - Reduces boilerplate of properties. License: BSD 3.
Netflix Archaius - Library for configuration management API. Archaius includes a set of configuration management APIs used by Netflix. License: Apache 2 , github's star - 614.
LightAdmin - Pluggable data administration UI library for Java web applications. License: Apache 2.
Apache Yetus A collection of libraries and tools that enable contribution and release processes for software projects. License: Apache 2.
Distribution
Tools which handle the distribution of applications in native formats.Up
Bintray - Version control for binaries which handles the publishing. Can also be used with Maven or Gradle and has a free plan for open-source software or several business plans. License: proprietary
Capsule - Simple and powerful packaging and deployment. A fat JAR on steroids or a "Docker for Java" that supports JVM-optimized containers. github's star - 576. License: Eclipse Public License v1.0.
Central Repository - Largest binary component repository available as a free service to the open-source community. Default used by Apache Maven and available in all other build tools. License: proprietary
IzPack - Setup authoring tool for cross-platform deployments. License: Apache 2 , github's star - 614.
JitPack - Easy to use package repository for GitHub. Builds Maven/Gradle projects on demand and publishes ready-to-use packages. License: Apache 2 , github's star - 614.
Launch4j - Wraps JARs in lightweight and native Windows executables. License: BSD 3 or MIT.
Nexus - Binary management with proxy and caching capabilities. License: proprietary
packr - Packs JARs, assets and the JVM for native distribution on Windows, Linux and Mac OS X. License: Apache 2.
Tools for performance analysis, profiling and benchmarking.Up
Square Leakcanary A memory leak detection library for Android and Java. License: Apache 2 , github's star - 4168.
Dropwizard Metrics - Capturing JVM- and application-level metrics. License: Apache 2 , github's star - 3188.
GCViewer Fork of tagtraum industries' GCViewer. Tagtraum stopped development in 2008, I aim to improve support for Sun's / Oracle's java 1.6+ garbage collector logs (including G1 collector). License: GNU Lesser 2.1, github's star - 990.
AdoptOpenJDK Jitwatch Log analyser / visualiser for Java HotSpot JIT compiler. Inspect inlining decisions, hot methods, bytecode, and assembly. View results in the JavaFX user interface. License: BSD 2, github's star - 547.
Naver Pinpoint Pinpoint is an open source APM (Application Performance Management) tool for large-scale distributed systems written in Java. License: Apache 2 , github's star - 486.
jHiccup - Logs and records platform JVM stalls. License: BSD 2.
JMH - Microbenchmarking tool for the JVM. License: GNU 2.
LatencyUtils - Utilities for latency measurement and reporting. License: BSD 2.
Google Error prone - Catches common programming mistakes as compile-time errors. License: Apache 2 , github's star - 590.
OpenGrok OpenGrok is a fast and usable source code search and cross reference
engine, written in Java. It helps you search, cross-reference and navigate
your source tree. It can understand various program file formats and
version control histories like Mercurial, Git, SCCS, RCS, CVS, Subversion,
Teamware, ClearCase, Perforce, Monotone and Bazaar. License: CDDL 1.0, github's star - 570.
jmxtrans - Tool to connect to multiple JVMs and to query them for their attributes via JMX. Its query language is based on JSON, which allows non-Java programmers to access the JVMs attributes. Likewise, this tool supports different output writes, including Graphite, Ganglia, StatsD, among others. License: MIT.
Kamon - Tool for monitoring applications running on the JVM. License: Apache 2.
New Relic - Commercial performance monitor. License: proprietary
SPM - Commercial performance monitor with distributing transaction tracing for JVM apps. License: proprietary
Takipi - Commercial in-production error monitoring and debugging. License: proprietary
Dynamic Code Evolution Virtual Machine (DCE VM) - The Dynamic Code Evolution Virtual Machine (DCE VM) is a modification of the Java HotSpot(TM) VM that allows unlimited redefinition of loaded classes at runtime. License: GNU 2
DCEVM - This project is a fork of original DCEVM project. The purpose of the project is to maintain enhanced class redefinition functionality for OpenJDK HotSpot 7/8 and Oracle JVM. License: GNU 2
HotswapAgent - Java unlimited redefinition of classes at runtime. License: GNU 2
JRebel - Reload code changes instantly. Skip the build and redeploy process. JRebel reloads changes to Java classes, resources, and over 90 frameworks. License: proprietary
Spring Loaded - Java agent that enables class reloading in a running JVM. License: Apache 2
Google J2ObjC: A Java to iOS Objective-C translation tool and runtime. License: Apache 2 , github's star - 2940.
Bytecode viewer A Java 8 Jar & Android APK Reverse Engineering Suite (Decompiler, Editor, Debugger & More). License: GNU 3, github's star - 617.
Reflections Java runtime metadata analysis, in the spirit of Scannotations. Reflections scans your classpath, indexes the metadata, allows you to query it on runtime and may save and collect that information for many modules within your project. License: WTFPL, github's star - 514.
Current implementations of the JVM/JDK.
JDK 9 - Early access releases of JDK 9. License: GNU 2.
OpenJDK - Open-source implementation for Linux. License: GNU 2.
Zulu OpenJDK - OpenJDK builds for Windows, Linux, and Mac OS X through Java 8. License: GNU 2.
Zulu OpenJDK 9 - Early access OpenJDK 9 builds for Windows, Linux, and Mac OS X. License: GNU 2.
VI. Program languages and applications, that was written with Java
Go lang idea plugin Google Go language IDE built using the IntelliJ Platform. License: Apache 2 , github's star - 1717.
Processing js A port of the Processing visualization language to JavaScript. License: MIT , github's star - 1696.
Pysonar2 PySonar2 is a type inferencer and indexer for Python, which performs sophisticated interprocedural analysis to infer types. License: GNUGNU AGPLv3, github's star - 1654.
Yuicompressor The YUI Compressor is a JavaScript compressor which, in addition to removing comments and white-spaces, obfuscates local variables using the smallest possible variable name. License: BSD, github's star - 1840.
Frontend maven plugin "Maven-node-grunt-gulp-npm-node-plugin to end all maven-node-grunt-gulp-npm-plugins." A Maven plugin that downloads/installs Node and NPM locally, runs NPM install, Grunt, Gulp and/or Karma. License: Apache 2 , github's star - 586.
Dynjs ECMAScript runtime for the JVM. License: Apache 2 , github's star - 533.
4. Frameworks that help to create parsers, interpreters or compilers
Frameworks that help to create parsers, interpreters or compilers.Up
Square Keywhiz - A system for distributing and managing secrets. License: Apache 2 , github's star - 979.
Rundeck Job scheduler and runbook automation. Enable self-service access to existing scripts and tools. License: Apache 2 , github's star - 853.
KeyBox KeyBox is a web-based SSH console that centrally manages administrative access to systems. Web-based administration is combined with management and distribution of user's public SSH keys. License: Apache 2 , github's star - 792.
OpenTripPlanner An open source multi-modal trip planner. License: Apache 2 , github's star - 704.
Jitsi Jitsi is an audio/video and chat communicator that supports protocols such as SIP, XMPP/Jabber, AIM/ICQ, IRC, Yahoo! and many other useful features. License: Apache 2 , github's star - 676.
Netflix Exhibitor ZooKeeper co-process for instance monitoring, backup/recovery, cleanup and visualization. License: Apache 2 , github's star - 610.
Glyptodon Guacamole client - The HTML5/JavaScript Guacamole client, its containing web application, and related components. License: MIT , github's star - 556.
Bateman - Simple stock trading system that optimizes its parameters with particle swarm optimization. License: MIT , github's star - 543.
Java repl - Java REPL is a simple Read-Eval-Print-Loop for Java language. License: Apache 2 , github's star - 536.
Seyren An alerting dashboard for Graphite. License: Apache 2 , github's star - 527.
Graphhopper Open source routing library and server using OpenStreetMap. License: Apache 2 , github's star - 506.
Ttorrent Turn's BitTorrent Java library (tracker and client). License: Apache 2 , github's star - 460.
Geoserver Official GeoServer repository. License: GNU 2.0, github's star - 435.
Languagetool - Style and Grammar Checker for 25+ Languages. License: GNU Lesser 2.1, github's star - 416.
Apache OpenMeetings Video conferencing, instant messaging, white board and collaborative document editing application. License: Apache 2.
Bukkit The Minecraft Mod API. License: GNU 2, github's star - 1600.
MovingBlocks Terasology Terasology - open source voxel world. The Terasology project was born from a Minecraft-inspired tech demo and is becoming a stable platform for various types of gameplay settings in a voxel world. License: Apache 2 , github's star - 1070.
MinecraftForge Modifications to the Minecraft base files to assist in compatibility between mods. License: GNU AGPLv2.1, github's star - 981.
SpongePowered Sponge A Forge mod that implements SpongeAPI. License: MIT , github's star - 803.
BuildCraft BuildCraft — mod for Minecraft. License: Apache 2 , github's star - 799.
WorldEdit An in-game voxel map editor for Minecraft. License: GNU Lesser 3, github's star - 715.
Essentials Essentials - Minecraft server command mod - Adds over 100 commands for use in-game to help manage a server. License: GNU 3, github's star - 423.
GlowstoneMC Glowstone An open-source server for the Bukkit Minecraft modding interface. License: MIT , github's star - 421.
Tribal Trouble - Tribal Trouble is a realtime strategy game released by Oddlabs in 2004. In 2014 the source was released under GPL2 license. License: GNU 2, github's star - 50.
Spring integration samples You are looking for examples, code snippets, sample applications for Spring Integration? This is the place. License: Apache 2 , github's star - 517.
Jboss developer Jboss eap quickstarts The quickstarts demonstrate JBoss EAP, Java EE 7 and a few additional technologies. They provide small, specific, working examples that can be used as a reference for your own project. License: Apache 2 , github's star - 434.
Gitblit Gitblit is an open source, pure Java Git solution for managing, viewing, and serving Git repositories. It can serve repositories over the GIT, HTTP, and SSH transports; it can authenticate against multiple providers; and it allows you to get up-and-running with an attractive, capable Git server in less than 5 minutes.. License: Apache 2 , github's star - 787.
WhisperSystems BitHub BTC + BitHub = An experiment in funding privacy OSS. BitHub is a service that will automatically pay a percentage of Bitcoin funds for every submission to a GitHub repository. License: ?, github's star - 491.