CTools:MilepostGCC

From cTuning.org

(Difference between revisions)

Revision as of 21:34, 24 October 2010

	MILEPOST GCC
	*machine-learning enabled self-tuning compiler*

Web shortcut: http://cTuning.org/milepost-gcc

Navigation: cTuning.org > CTools

MILEPOST GCC is now a part of the cTuning Compiler Collection (cTuning CC).

ANNOUNCEMENT: After the release of the cTuning CC (MILEPOST GCC) and a relatively quiet summer and autumn 2010 spent mostly on thinking ;), we plan to resume our open collaborative activities in 2011 and will work on a new collaborative platform and a repository cTuning₂. Currently, we are looking for additional funding to keep it running and to access various new hardware (embedded or HPC systems, GPUs, etc) to perform empirical collective learning and optimization to suggest better program optimizations or hardware designs based on multi-objective criteria (execution time/power/architecture size/code size/compilation time/etc) (ref₁, ref₂, ref₃), so if you are interested to support cTuning initiative in 2011, please don't hesitate to contact Dr. Grigori Fursin (cTuning founder and R&D coordinator). More information will be available at the beginning of 2011.

MILEPOST GCC is the first practical attept to build machine learning enabled open-source self-tuning production (and research) compiler that can adapt to any architecture using iterative feedback-directed compilation, machine learning and collective optimization. It is based on production quality GCC that supports more than 30 families of architectures and can compile real, large applications including Linux, and on Interactive Compilation Interface that provides plugin system to access internals of compilers. MILEPOST GCC attempts to correlate program features and program optimizations during empirical iterative compilation to predict good optimizations for unseen programs based on prior learning. MILEPOST and cTuning infrastructure automates code and architecture optimization to improve execution time, code size, compilation time and other characteristics at the same time. This technology is not GCC-dependent and can be used in any compiler using common Interactive Compilation Interface and compiler independent plugins. The first version of the MILEPOST GCC and MILEPOST framework has been created during the MILEPOST project. All public MILEPOST developments have been coordinated by Grigori Fursin. More information can be found in the following paper about MILEPOST GCC.

Background:

Downloads

Documentation

User suggestions and feedback

Bug reports

FAQs - Does MILEPOST GCC solve all optimization problems? How similar is it ACOVEA tool? etc...

Related:
- Online predictor of optimizations based on program features.
- Collective optimization repository to continuously collect profitable optimization cases from the community that improve program execution time, code size, compilation time, etc...
- CCC framework - Continuous Collective Compilation Framework to automate search of profitable optimization cases to improve program execution time, code size, compilation time, etc. It is used to train MILEPOST GCC and has some similarities with the useful ACOVEA tool but also allows automatic sharing of optimization knowledge with the community in the Collective Optimization Database and uses plugins to implement various search techniques besides genetic algorithms.
- Official info for the MILEPOST project (2006-2009).

News

2010.September.10 - The CFP for the 3rd International Workshop on GCC Research Opportunities (GROW 2011) co-located with CGO 2010 (early April 2011, Chamonix, France) is now available on-line. Please, follow our announcements about GROW 2011 and submit your best papers!..

2010.August.24 - Congratulations to Mircea et al for the paper Practical Aggregation of Semantical Program Properties for Machine Learning Based Optimization accepted to CASES 2010. This work has been integrated with MILEPOST GCC and cTuning CC.

2010.August.16 - Submissions are now open for CGO 2011.

2010.June.30 - Call for papers: CGO'11.

2010.June.9 - Finally, we recovered all cTuning website and services after physical hard drive failure. However, if you still experience some problems or abnormal behavior, please report that to the cTuning discussions mailing list! Thanks and sorry for any inconvenience!

2010.May.22 - Pre-release of cTuning CC V2.5 is now available. cTuning CC is a free, open source compiler collection that combines multiple tools and techniques including MILEPOST GCC, ICI, CCC framework, cTuning web-services and Collective Optimization Database and cBench as the first practical step toward self-tuning, adaptive computing systems based on industrial tools, empirical techniques, transparent collective optimization, statistical analysis and machine learning. cTuning CC is a wrapper around any compiler such as GCC, LLVM, Open64, Path64, etc that can transparently invoke machine learning mode to correlate program features of a compiled program with the ones stored in the Collective Optimization Database and suggest better optimizations for multi-objective criteria such as improving execution time, compilation time, code size, etc (using optimization space frontier detection).

2010.May.14 - Call for papers: ASPLOS 2011.

2010.April.28 - List of all projects accepted for Google Summer of Code 2010 is now available on-line. There are many projects related to GCC, LLVM, MONO, etc.
Discussion page about GCC as a research compiler has been updated.
Diego Novillo started a proposal to modularize GCC.

2010.April.14 - Long awaited GCC 4.5 has been released! It features new plugin framework with some parts of ICI to continue GCC modularization and parametrization, simplify pass manipulation and reordering, and enable better integration with cTuning/MILEPOST tools to automate optimization space exploration and prediction of profitable combinations of program transformations during multi-objective optimizations (balancing execution time, code size, compilation time, etc) for a given program/dataset/architecture.

2010.March.17 - We pre-released all tools including MILEPOST GCC, CCC framework, cBench and cDatabase. It's a major update of cTuning tools including support of transparent optimizations of programs and libraries, better multi-objective optimization (including balancing of execution time, code size and compilation time), bug fixes in averaging multiple optimization cases, C++ support in MILEPOST GCC, support of all version of GCC 4.4, new static features in MILEPOST GCC, extended documentation, etc. Feedback and comments are welcome here.

2010.March.01 - CGO'10 program is available on-line.

2010.February.22 - MILEPOST 1.5 GCC 4.4.0 pre-release is now available.

2010.February.18 - We are in the process of updating this website as well as MILEPOST GCC, CCC framework, web-services.).

News archive

MILEPOST GCC friends:

@@ Line 11: / Line 11: @@
 <div style="color:red; font-weight:bold; "><H2>MILEPOST GCC is now a part of the [[CTools:CTuningCC|cTuning Compiler Collection (cTuning CC)]].</H2></div>
-:::::::::::::::::''Dear friends,<BR>I would like to thank [[Community:People|all great colleagues]] for interesting research discussions, feedback, collaboration and support during the tough times when I was developing cTuning concept, public tools and repository!<BR>Yours,<BR>[http://fursin.net/research Grigori Fursin] (author of cTuning concept and R&D coordinator)''
+<div style="font-style: italic; background-color: #FF7F7F">
+:::::::::''ANNOUNCEMENT:'' After the release of the [[CTools:CTuningCC|cTuning CC (MILEPOST GCC)]] and a relatively quiet summer and autumn 2010 spent mostly on thinking ;), we plan to resume our open collaborative activities in 2011 and will work on a new collaborative platform and a repository cTuning<sub>2</sub>. Currently, we are looking for additional funding to keep it running and to access various new hardware (embedded or HPC systems, GPUs, etc) to perform empirical collective learning and optimization to suggest better program optimizations or hardware designs based on multi-objective criteria (execution time/power/architecture size/code size/compilation time/etc) ([http://fursin.net/wiki/index.php5?title=Research:Dissemination#Fur2009 ref<sub>1</sub>], [http://fursin.net/wiki/index.php5?title=Research:Dissemination#FT2009 ref<sub>2</sub>], [[CDatabase|ref<sub>3</sub>]]), so if you are interested to support cTuning initiative in 2011, please don't hesitate to contact [http://fursin.net/research Dr. Grigori Fursin] (cTuning founder and R&D coordinator). More information will be available at the beginning of 2011.</div>
 MILEPOST GCC is the first practical attept to build machine learning enabled open-source self-tuning production (and research) compiler that can adapt to any architecture using iterative feedback-directed compilation, machine learning and collective optimization. It is based on production quality [http://gcc.gnu.org GCC] that supports more than 30 families of architectures and can compile real, large applications including Linux, and on [[CTools:ICI|Interactive Compilation Interface]] that provides plugin system to access internals of compilers. MILEPOST GCC attempts to correlate [[CTools:MilepostGCC:StaticFeatures|program features]] and [[CDatabase|program optimizations]] during empirical iterative compilation to predict good optimizations for unseen programs based on prior learning. MILEPOST and cTuning infrastructure automates code and architecture optimization to improve execution time, code size, compilation time and other characteristics at the same time. This technology is not GCC-dependent and can be used in any compiler using common [[CTools:ICI|Interactive Compilation Interface]] and compiler independent plugins. The first version of the MILEPOST GCC and [[CTools:MilepostFramework|MILEPOST framework]] has been created during the [http://cTuning.org/project-milepost MILEPOST project]. All public MILEPOST developments have been coordinated by [http://fursin.net/research Grigori Fursin]. More information can be found in the following paper about [http://unidapt.org/index.php/Dissemination#FMTP2008 MILEPOST GCC].