From cTuning.org
Current revision (15:51, 12 September 2015) (view source) |
|||
| (64 intermediate revisions not shown.) | |||
| Line 1: | Line 1: | ||
| + | '''''NEWS: Since 2015, we moved all related developments to our new [http://github.com/ctuning/ck/wiki Collective Knowledge Framework]! Demo of a new live repository is available [http://cknowledge.org/repo here].''''' | ||
| + | |||
| + | |||
| + | |||
{{CTitle|http://ctuning.org/wiki/images/logo_ccc.gif|Continuous Collective Compilation Framework|Enabling collective optimization}} | {{CTitle|http://ctuning.org/wiki/images/logo_ccc.gif|Continuous Collective Compilation Framework|Enabling collective optimization}} | ||
| - | {{ | + | |
| - | + | {{CShortCut|ccc}} | |
| - | + | ||
| - | }} | + | |
{{CMenu:CTools|}} | {{CMenu:CTools|}} | ||
| - | Continuous Collective Compilation Framework (CCC) is a collaborative modular plugin-enabled R&D infrastructure to automate program and architecture optimizations (i.e. iteratively search for ''good'' program and architecture optimizations in a feedback-directed manner) and gather various static and dynamic optimization profile data in a [[CDatabase|Collective Optimization Database]]. It supports both global program optimization and fine-grain procedure, loop or instruction level optimizations if compiler supports [[CTools:ICI|Interactive Compilation Interface]]. | + | {{NEWS}} |
| + | |||
| + | Continuous Collective Compilation Framework (CCC) is a collaborative modular plugin-enabled R&D infrastructure to automate program and architecture optimizations (i.e. iteratively search for ''good'' program and architecture optimizations in a feedback-directed manner) and gather various static and dynamic optimization profile data in a [[CDatabase|Collective Optimization Database]]. It supports both global program optimization and fine-grain procedure, loop or instruction level optimizations if compiler supports [[CTools:ICI|Interactive Compilation Interface]]. CCC is used to help end-users optimize their programs, libraries and whole OS automatically (improve execution time/code size, etc), test and tune compiler optimization heuristic. It also enables collaborative R&D and optimization knowledge reuse with statistical and machine learning techniques ({{Ref|FT2010}}, {{Ref|FMTP2008}}, {{Ref|FT2009}}). | ||
| + | Current version of CCC supports optimization of ''cBench/MiBench/EEMBC/Polyhedron/SPEC_CPU95,2000,2006'' benchmark suites. | ||
| + | |||
| + | '''''Some more scientific aspects/details on Collective Optimization can be found in the following [http://fursin.net/wiki/index.php5?title=Research:Dissemination#FT2010 ACM TACO'10 publication]'''''. | ||
CCC Framework is a community-driven project - you are welcome to [[Join|join]] the project, [[CTools:CCC:Projects|extend]] it, provide smart search and data analysis plugins, leave [[CTools:CCC:Feedback|feedback]] and add your optimization data to help the community. You can also communicate with cTuning community through our [[Community|mailing lists]]. | CCC Framework is a community-driven project - you are welcome to [[Join|join]] the project, [[CTools:CCC:Projects|extend]] it, provide smart search and data analysis plugins, leave [[CTools:CCC:Feedback|feedback]] and add your optimization data to help the community. You can also communicate with cTuning community through our [[Community|mailing lists]]. | ||
| Line 25: | Line 32: | ||
* [[CTools:CCC:Documentation|'''Documentation and APIs''']] | * [[CTools:CCC:Documentation|'''Documentation and APIs''']] | ||
| - | * | + | * [[CTools:CCC:FAQs|'''FAQs''']] - Why do we need CCC framework? Is it similar to ACOVEA tool? etc... |
* '''[[CTools:CCC:Projects|Projects to extend CCC Framework (development plan)]]''' | * '''[[CTools:CCC:Projects|Projects to extend CCC Framework (development plan)]]''' | ||
| Line 33: | Line 40: | ||
**[[CTools:CCC:Dev:Discussions|Discussion forum]] | **[[CTools:CCC:Dev:Discussions|Discussion forum]] | ||
**[[CTools:CCC:Dev:Bugs|Bug reports]] | **[[CTools:CCC:Dev:Bugs|Bug reports]] | ||
| + | |||
| + | * '''Related:''' | ||
| + | ** [[CDatabase|Collective optimization repository]] to continuously collect profitable optimization cases from the community that improve program execution time, code size, compilation time, etc... | ||
| + | ** [[CTools:MilepostGCC|MILEPOST GCC]] - machine learning-enabled compiler that automatically correlates program features and optimizations collected using CCC framework to be able to predict profitable optimizations to improve execution time, code size and compilation time for unseen programs. | ||
| + | |||
| + | ** [http://www.coyotegulch.com/products/acovea ACOVEA] - Using Natural Selection to Investigate Software Complexities | ||
| + | ** [http://www.research.ibm.com/haifa/projects/systems/cot/esto/index.html IBM Expert System for Tuning Optimizations (ESTO)] | ||
| + | ** [http://www.pathscale.com pathopt tool from EKOPath compiler suite] | ||
| + | ** [http://software.intel.com/en-us/articles/intel-software-autotuning-tool Intel auto-tuning tool] | ||
| + | ---- | ||
| + | |||
| + | Example of complex optimization search spaces for susan_c from [[CTools:CBench|Collective Benchmark]] and [[CTools:MilepostGCC|MILEPOST GCC 4.4.0]] | ||
| + | after randomly selecting about 80 optimization flags: | ||
| + | <div align="center">http://unidapt.org/images/fig_opt_case_susan_c_1.gif http://ctuning.org/wiki/images/fig_opt_case_susan_c_2.gif</div> | ||
| + | |||
| + | We can automatically improve execution time of the program by nearly 2 times over the highest GCC optimization level after using CCC framework | ||
| + | (we obtain similar results on LLVM, Open64, Intel and IBM compilers). We can also use CCC framework to perform multi-objective | ||
| + | optimizations (selecting optimization cases on the optimization space frontier shown by red circles and blue dots) such as: | ||
| + | * optimize both execution time and code size (important for optimizing libraries and embedded/mobile computing systems) | ||
| + | * optimize just execution time (important for desktop computers and HPC servers/supercomputers) | ||
| + | * optimize both execution time and compilation time (important for cloud computing services and real-time systems) | ||
| + | |||
| + | Furthermore, we are developing [http://cTuning.org/milepost-gcc MILEPOST GCC] to correlate program features and behavior to predict good optimizations | ||
| + | for unseen programs based on prior learning. | ||
---- | ---- | ||
''You are welcome to [[Join|join]] us and participate in CCC developments, discussions, provide feedback or suggestions to extend CCC or add new functionality. The framework currently supports multiple compilers including GCC, Open64, PathScale, Intel ICC, IBM XLC and a large number of server, desktop and embedded architectures.'' | ''You are welcome to [[Join|join]] us and participate in CCC developments, discussions, provide feedback or suggestions to extend CCC or add new functionality. The framework currently supports multiple compilers including GCC, Open64, PathScale, Intel ICC, IBM XLC and a large number of server, desktop and embedded architectures.'' | ||
| + | |||
| + | <div align="center"> | ||
| + | {| cellspacing="0" cellpadding="3" border="0" width="100%" style="color: black;" | ||
| + | |- | ||
| + | | align="center" style="background: rgb(0, 100, 159) none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-origin: -moz-initial; -moz-background-inline-policy: -moz-initial; color: white;" | '''CCC supporters:''' | ||
| + | |- | ||
| + | | align="center" valign="top" | {{CTools:CCC:Logo_Friends}} | ||
| + | |} | ||
| + | </div> | ||
Current revision
NEWS: Since 2015, we moved all related developments to our new Collective Knowledge Framework! Demo of a new live repository is available here.
 |
Continuous Collective Compilation Framework |
| Enabling collective optimization |
Web shortcut: http://cTuning.org/ccc
Navigation: cTuning.org > CTools
NOTES:
- Reference publications about cTuning.org long-term vision: GCC Summit'09, ACM TACO'10 journal and IJPP'11 journal.
Continuous Collective Compilation Framework (CCC) is a collaborative modular plugin-enabled R&D infrastructure to automate program and architecture optimizations (i.e. iteratively search for good program and architecture optimizations in a feedback-directed manner) and gather various static and dynamic optimization profile data in a Collective Optimization Database. It supports both global program optimization and fine-grain procedure, loop or instruction level optimizations if compiler supports Interactive Compilation Interface. CCC is used to help end-users optimize their programs, libraries and whole OS automatically (improve execution time/code size, etc), test and tune compiler optimization heuristic. It also enables collaborative R&D and optimization knowledge reuse with statistical and machine learning techniques (FT2010, FMTP2008, FT2009). Current version of CCC supports optimization of cBench/MiBench/EEMBC/Polyhedron/SPEC_CPU95,2000,2006 benchmark suites.
Some more scientific aspects/details on Collective Optimization can be found in the following ACM TACO'10 publication.
CCC Framework is a community-driven project - you are welcome to join the project, extend it, provide smart search and data analysis plugins, leave feedback and add your optimization data to help the community. You can also communicate with cTuning community through our mailing lists.
- Background:
- FAQs - Why do we need CCC framework? Is it similar to ACOVEA tool? etc...
- Current development:
- Related:
- Collective optimization repository to continuously collect profitable optimization cases from the community that improve program execution time, code size, compilation time, etc...
- MILEPOST GCC - machine learning-enabled compiler that automatically correlates program features and optimizations collected using CCC framework to be able to predict profitable optimizations to improve execution time, code size and compilation time for unseen programs.
- ACOVEA - Using Natural Selection to Investigate Software Complexities
- IBM Expert System for Tuning Optimizations (ESTO)
- pathopt tool from EKOPath compiler suite
- Intel auto-tuning tool
Example of complex optimization search spaces for susan_c from Collective Benchmark and MILEPOST GCC 4.4.0 after randomly selecting about 80 optimization flags:
We can automatically improve execution time of the program by nearly 2 times over the highest GCC optimization level after using CCC framework (we obtain similar results on LLVM, Open64, Intel and IBM compilers). We can also use CCC framework to perform multi-objective optimizations (selecting optimization cases on the optimization space frontier shown by red circles and blue dots) such as:
- optimize both execution time and code size (important for optimizing libraries and embedded/mobile computing systems)
- optimize just execution time (important for desktop computers and HPC servers/supercomputers)
- optimize both execution time and compilation time (important for cloud computing services and real-time systems)
Furthermore, we are developing MILEPOST GCC to correlate program features and behavior to predict good optimizations for unseen programs based on prior learning.
You are welcome to join us and participate in CCC developments, discussions, provide feedback or suggestions to extend CCC or add new functionality. The framework currently supports multiple compilers including GCC, Open64, PathScale, Intel ICC, IBM XLC and a large number of server, desktop and embedded architectures.
| CCC supporters: |
        
|