From cTuning.org

Revision as of 12:35, 23 May 2011 by Gfursin (Talk | contribs)
Jump to: navigation, search
logo_ici.gif

Interactive Compilation Interface

Enabling Collaborative Interactive Research Compilers
Web shortcut: http://cTuning.org/ici
Navigation: cTuning.org > CTools 

The Interactive Compilation Interface (or 'ICI' for short) is a plugin system with a high-level compiler-independent and low-level compiler-dependent API to transform current compilers into collaborative open modular interactive toolsets. The ICI framework acts as a "middleware" interface between the compiler and the user-definable plugins. It opens up and reuses the production-quality compiler infrastructure to enable program analysis and instrumentation, fine-grain program optimizations, simple prototyping of new development and research ideas while avoiding building new compilation tools from scratch. For example, it is used in MILEPOST GCC to automate compiler and architecture design and program optimizations based on statistical analysis and machine learning. It should enable universal self-tuning compilers adaptable to heterogeneous, reconfigurable, multi-core architectures ranging from supercomputers to embedded systems.

At the beginning of 2010, parts of ICI and related plugin framework have been finally included in mainline GCC 4.5!

gcc-ici-structure.gif

ICI is an open collaborative community-driven project. You are welcome to join and participate in developments, discussions, provide feedback or suggestions to extend ICI or add new features. We develop ICI for GCC at the moment, but trying to keep it compiler independent in case someone would like to port it to other compilers to extend collaborative tools.

News
  • 2011.April.7 - All papers and presentations from SMART 2011 are now available online. Thanks to all the participants for very interesting and lively discussions!
  • 2011.April.6 - CGO 2012 will be in San Jose, California. Abstract deadline is set to September 13, 2011. More info will be available soon at the official website.
  • 2011.April.6 - Please, check out new publication paradigm for HiPEAC 2012 that will take place in Paris in January 23-25, 2012.
  • 2011.April.6 - ASPLOS 2012 abstract deadline: Monday, July 18, 2011
  • 2011.February.25 - Call for papers: EXADAPT 2011 (co-located with PLDI/FCRC 2011): 1st International Workshop on Adaptive Self-Tuning Computing Systems for the Exaflop Era. Paper submission deadline: March 27, 2011.
  • 2010.December.31 - Dear all, we wish you very nice and relaxing holidays and super-exciting, productive and successful New Year ;) !..
  • 2010.December.25 - The website for SMART'2011 workshop (co-located with CGO'2011) is now finalized and the submission website is open! Please, follow this link, submit your best papers ;) and spread the word!
  • 2010.December.20 - Extended variant of our paper on "Collective Optimization" will appear in December issue of the ACM Transactions on Architecture and Code Optimization (TACO). PDF and BIB are now available here: FT2010.
  • 2010.October.31 - Paper about practical aggregation of semantical program properties for machine learning based optimization by M.Namolaru et al from CASES'10 is now available on-line here. It describes mechanisms of feature extraction inside MILEPOST GCC/cTuning CC.
  • 2010.October.26 - SMART'11 will be co-located with the CGO'11 conference. More information will be following soon!
  • 2010.August.16 - Submissions are now open for CGO 2011.
  • 2010.June.30 - Call for papers: CGO'11.
  • 2010.June.9 - Finally, we recovered all cTuning website and services after physical hard drive failure. However, if you still experience some problems or abnormal behavior, please report that to the cTuning discussions mailing list! Thanks and sorry for any inconvenience!
  • 2010.May.22 - Pre-release of cTuning CC V2.5 is now available. cTuning CC is a free, open source compiler collection that combines multiple tools and techniques including MILEPOST GCC, ICI, CCC framework, cTuning web-services and Collective Optimization Database and cBench as the first practical step toward self-tuning, adaptive computing systems based on industrial tools, empirical techniques, transparent collective optimization, statistical analysis and machine learning. cTuning CC is a wrapper around any compiler such as GCC, LLVM, Open64, Path64, etc that can transparently invoke machine learning mode to correlate program features of a compiled program with the ones stored in the Collective Optimization Database and suggest better optimizations for multi-objective criteria such as improving execution time, compilation time, code size, etc (using optimization space frontier detection).
  • 2010.April.28 - List of all projects accepted for Google Summer of Code 2010 is now available on-line. There are many projects related to GCC, LLVM, MONO, etc.
    Discussion page about GCC as a research compiler has been updated.
    Diego Novillo started a proposal to modularize GCC.
  • 2010.April.14 - Long awaited GCC 4.5 has been released! It features new plugin framework with some parts of ICI to continue GCC modularization and parametrization, simplify pass manipulation and reordering, and enable better integration with cTuning/MILEPOST tools to automate optimization space exploration and prediction of profitable combinations of program transformations during multi-objective optimizations (balancing execution time, code size, compilation time, etc) for a given program/dataset/architecture.
  • 2010.March.17 - We pre-released all tools including MILEPOST GCC, CCC framework, cBench and cDatabase. It's a major update of cTuning tools including changes behind to support transparent optimizations of programs and libraries, better multi-objective optimization (including balancing of execution time, code size and compilation time), bug fixes in averaging multiple optimization cases, C++ support in MILEPOST GCC, support of all version of GCC 4.4, new static features in MILEPOST GCC, extended documentation, etc. Feedback and comments are welcome here.
  • 2010.March.01 - CGO'10 program is available on-line.
  • 2010.January.28 - Proceedings and slides from GROW'10 and SMART'10 are now available online.
  • 2010.January.4 - Call for participation: GROW'10 and SMART'10 workshops will be held on the 23rd and 24th of January in Pisa, Italy co-located with the HiPEAC conference. Preliminary programs are available: SMART'10 program and GROW'10 program.
  • 2010.January.1 - We wish you all a very happy and prosperous New Year with lots of exciting achievements maybe even related to cTuning technology ;) !
  • 2009.November.11 - Small CCC analysis plugins update available at SVN to speedup queries when dealing with large amount of optimization data in cDatabases (gigabytes of data).
  • 2009.November.7 - Submission deadline for SMART'10 workshop has been extended until the 22nd of November, 2009.
  • 2009.October.2 - We successfully passed the final MILEPOST review and the project is officially over. We would like to thank all the partners from the University of Edinburgh, IBM Haifa, CAPS and ARC for a great collaborative work during last 3 years and cTuning community for a very interesting feedback and extensions! We released all the tools from the project and hope to continue extending them within community-driven cTuning.org. This infrastructure should open up many interesting research opportunities for performance auto-tuning based on statistical and machine learning techniques so we hope to see many more interesting extensions to the MILEPOST/cTuning technology soon ;) !..
  • 2009.September.25 - New CFP for SMART'10 workshop co-located with HiPEAC'10 conference in Pisa, Italy is now available. Prof. Keith Cooper from Rice University kindly agreed to give a keynote talk.
  • 2009.September.22 - Congratulations to Dr.Christophe Dubach who has won a presitigious BCS/CPHC Distinguished Dissertation Award for his thesis "Using Machine-Learning to Efficiently Explore the Architecture/Compiler Co-Design Space" supervised by Prof. Michael O'Boyle. This topic is related to cTuning technology!
  • 2009.July.22 - cTuning-related CFP: SMART'10 and GROW'10 workshops will be co-located with HiPEAC'10 conference in Pisa, Italy at the end of January, 2009. You are warmly invited to submit your novel research results and developments to our workshops! At the websites of these workshops you can find all information about topics, PC, deadlines and submission procedures.
  • 2009.July.08 - The preprint of a paper "Collective Tuning Initiative: automating and accelerating development and optimization of computing systems" describing cTuning infrastructure is now available online (Fur2009).
  • 2009.June.29 - Stable MILEPOST GCC 4.4.0 has been released. Follow further community developments at cTuning GCC ICI page and cTuning development mailing list.
    Next, we plan to use MILEPOST/cTuning technology to enable realistic adaptive parallelization, data partitioning and scheduling for heterogeneous multi-core systems using statistical and machine learning techniques.
  • 2009.June.26 - The pdf of the paper that describes Collective Tuning Infrastructure and cTuning concept (presented at the GCC Summit'09) will be available in a few weeks here.
  • 2009.June.17 - We participated in discussions to include plugin system similar to ICI to mainline GCC for a long time and finally GCC 4.5 will feature a low-level plugin system. We are now synchronizing high-level ICI/MILEPOST with the mainline to be able to reuse all our available plugins. We also develop several new plugins within Google Summer of Code'2009 to enable XML representation of the compilation flow, fine-grain program optimizations and instrumentation, automatic tuning of optimization heuristic based on machine learning, and function-level run-time adaptation. Comparison of GCC low-level and high-level ICI plugins is available here. The ICI development and discussions mailing list is available here.
  • 2009.June.01 - After nearly 1 year of developments we released/updated all our open-source collaborative R&D tools:
    • fully redesigned and documented Interactive Compilation Interface v2.0 for GCC 4.4.0 synchronized with the official plugin GCC branch - transforming compilers into plugin-enabled research toolsets
    • MILEPOST GCC 4.4.0 pre-release version at SVN - automating program optimization and compiler optimization heuristic tuning using machine learning
    • Continuous Collective Compilation Framework v2.0 - enabling automatic collaborative program optimization based on statistical and machine learning techniques
    • Collective Benchmark/MiDataSets v1.0 - enabling realistic program optimization research and benchmarking using multiple open-source programs/datasets.

      We also updated Collective Optimization Database with various optimization cases for Intel and AMD processors and comparison of different compilers including GCC, LLVM, Open64, Intel, etc - enabling sharing and reuse of optimization knowledge.

      We would like to thank cTuning community for feedback, help and support! You are welcome to join this community effort to automate program optimization and compiler/architecture design.
  • 2009.April.27 - We gave a talk at the University of Illinois at Urbana-Champaign about Collective Tuning Initiative and tools and MILEPOST project ("Collective Optimization, run-time adaptation and machine learning"). Presentation is available here. We would like to thank all the UIUC colleagues for a very interesting and useful feedback.
  • 2009.April.21 - Several projects to enable automatic fine-grain program optimization and run-time adaptation in GCC using iterative compilation and machine learning (based on our cTuning/UNIDAPT/ICI/MILEPOST technology) have been accepted by the Google Summer of Code. You are welcome to join cTuning community and follow or participate in the developments using our dedicated mailing lists.
  • 2009.Mar.24 - the new functionality implemented in the master branch on Gitorious was backported to a newly created gcc-4.2.4 branch to support and promote the use of ICI in production environments.
  • 2009.Mar.20 - the master branch of the ICI framework was updated to SVN revision 144783 dated 2009-03-11 16:57:01.
  • 2009.Feb.27 - a GCC patch combining ICI-based high-level plugin infrastructure with low-level plugin infrastructure of GCC was submitted to the gcc-patches mailing list.
  • 2009.Feb.13 - the comparison of Mozilla and ICI plugin APIs was uploaded to the GCC Wiki.
  • 2009.Feb.9 - the master branch of the ICI framework was updated to SVN revision 144014 dated 2009-02-08 09:10:15.
  • 2009.Feb.6 - the GCC Steering Committee agreed on the way plugins should be integrated into GCC. A new GCC Wiki page devoted to plugins was opened, and a dedicated "plugins" branch (svn://gcc.gnu.org/svn/gcc/branches/plugins) created in GCC SVN.
  • 2009.Jan.12 - the result of a new SVN sync (SVN rev. 143113 dated 6 January 2009) has been uploaded to Gitorious. It fixes several performance issues which were introduced in GCC 4.3.x.



News archive
ICI supporters:
logo_inria.gif logo_uvsq1.jpg logo_ue.gif logo_ibm.jpg logo_caps.gif logo_arc.gif logo_milepost.jpg logo_unidapt1.gif logo_cea.gif logo_nxp.gif logo_st.gif logo_mandriva.gif logo_ict.gif logo_hipeac.jpg
Locations of visitors to this page