Tools:CM - Revision history

Gfursin at 12:16, 5 August 2014

2014-08-05T12:16:45Z

Gfursin at 10:44, 10 July 2014

2014-07-10T10:44:17Z

Gfursin at 10:43, 10 July 2014

2014-07-10T10:43:57Z

Gfursin at 10:43, 10 July 2014

2014-07-10T10:43:41Z

Gfursin at 13:13, 3 April 2014

2014-04-03T13:13:25Z

Gfursin at 13:11, 3 April 2014

2014-04-03T13:11:19Z

Gfursin at 13:19, 24 December 2013

2013-12-24T13:19:20Z

Gfursin at 22:31, 21 December 2013

2013-12-21T22:31:29Z

Gfursin at 13:31, 19 December 2013

2013-12-19T13:31:19Z

Gfursin at 08:34, 19 December 2013

2013-12-19T08:34:13Z

@@ Line 43: / Line 43: @@
 *''Collaborative computer system analysis, characterization and optimization:''
 **has extensible experimental pipeline for program/architecture auto-tuning with already exposed properties and characteristics at multiple levels for auto-tuning (supporting multiple compilers including GCC, LLVM, Open64, ICC, PathScale; profiling tools including perf, likwid, vTune; OpenME plugin framework for online analysis and auto-tuning particularly for CUDA and OpenCL codes on heterogeneous architectures; frequency monitoring and changing tools, etc)
 **has powerful graph plotters (for multidimensional spaces) with export functions to png, pdf and eps
 **had data export functions to csv, json, txt

@@ Line 6: / Line 6: @@
 == What is Collective Mind infrastructure, repository and methodology?<br/> ==
-<p style="align: center">[[File:C-mind-picture.png|none|C-mind-picture.png]]</p>
 Collective Mind (cM or cMind) is a light-weight, portable, modular and extensible NoSQL infrastructure and repository for collective research and development through collaborative knowledge discovery, systematization, sharing and reuse. It is currently used to understand complex behavior of computer systems through collaborative decomposition of these systems into simple and semantically connected modules with defined interfaces and associated data. cMind allows to preserve the whole experimental setup with any associated artifact and with extensible meta-data (codelet, benchmark, datasets, tool, model, etc) helping to distribute or reproduce experiments by the community. Having enough knowledge about existing computer systems should allow scientists and engineers to build more power efficient computer systems in terms of performance, power consumption, code size, compilation time and other characteristics. It also helps the community to adopt the new research methodology and [http://cTuning.org/lab/education publication model] where experimental results and all associated artifacts are continuously shared, validated and extended by the community to help improve quality and reproducibility of computer engineering often seen as "hacking".

@@ Line 6: / Line 6: @@
 == What is Collective Mind infrastructure, repository and methodology?<br/> ==
-<p style="text-align: center">[[File:C-mind-picture.png|none]]</p>
+<p style="align: center">[[File:C-mind-picture.png|none|C-mind-picture.png]]</p>
 Collective Mind (cM or cMind) is a light-weight, portable, modular and extensible NoSQL infrastructure and repository for collective research and development through collaborative knowledge discovery, systematization, sharing and reuse. It is currently used to understand complex behavior of computer systems through collaborative decomposition of these systems into simple and semantically connected modules with defined interfaces and associated data. cMind allows to preserve the whole experimental setup with any associated artifact and with extensible meta-data (codelet, benchmark, datasets, tool, model, etc) helping to distribute or reproduce experiments by the community. Having enough knowledge about existing computer systems should allow scientists and engineers to build more power efficient computer systems in terms of performance, power consumption, code size, compilation time and other characteristics. It also helps the community to adopt the new research methodology and [http://cTuning.org/lab/education publication model] where experimental results and all associated artifacts are continuously shared, validated and extended by the community to help improve quality and reproducibility of computer engineering often seen as "hacking".

@@ Line 5: / Line 5: @@
 This documentation is written by [http://cTuning.org/lab/people/gfursin Grigori Fursin] and is gradually evolving together with the project (until the stable version is released). Please [[#Contacts|contact us]] if you notice mistakes or inconsistencies to collaboratively improve this document!
-== What is Collective Mind framework, infrastructure and methodology?<br/> ==
+== What is Collective Mind infrastructure, repository and methodology?<br/> ==
+<p style="text-align: center">[[File:C-mind-picture.png|none]]</p>
 Collective Mind (cM or cMind) is a light-weight, portable, modular and extensible NoSQL infrastructure and repository for collective research and development through collaborative knowledge discovery, systematization, sharing and reuse. It is currently used to understand complex behavior of computer systems through collaborative decomposition of these systems into simple and semantically connected modules with defined interfaces and associated data. cMind allows to preserve the whole experimental setup with any associated artifact and with extensible meta-data (codelet, benchmark, datasets, tool, model, etc) helping to distribute or reproduce experiments by the community. Having enough knowledge about existing computer systems should allow scientists and engineers to build more power efficient computer systems in terms of performance, power consumption, code size, compilation time and other characteristics. It also helps the community to adopt the new research methodology and [http://cTuning.org/lab/education publication model] where experimental results and all associated artifacts are continuously shared, validated and extended by the community to help improve quality and reproducibility of computer engineering often seen as "hacking".

@@ Line 83: / Line 83: @@
 == Where to get?<br/> ==
-The project is currently hosted at SourceForge:
+The project is currently hosted at SourceForge (with the latest available stable release):
+<pre>[http://sourceforge.net/projects/c-mind http://sourceforge.net/projects/c-mind]</pre>
 [http://sourceforge.net/projects/c-mind]
-−
 Current development version can be obtained anonymously from SourceForge SVN server (in the future, we plan to move to GIT):

@@ Line 81: / Line 81: @@
 cMind was also tested on various Linux distributions under ''[http://www.vmware.com VMWare 6.x and 7.x]''. cMind can be easily deployed as a bootable live USB key (we tested 8/16/32Gb USB keys with live UBUNTU 12.x and cM).
-== Where to get? ==
+== Where to get?<br/> ==
-Current development version can be obtained anonymously using SourceForge SVN server (we plan to move to GIT when we find time):
+The project is currently hosted at SourceForge:
   svn checkout [https://svn.code.sf.net/p/c-mind/code/projects/cm/trunk https://svn.code.sf.net/p/c-mind/code/projects/cm/trunk] cm-trunk

@@ Line 7: / Line 7: @@
 == What is Collective Mind framework, infrastructure and methodology?<br/> ==
-Collective Mind (cM or cMind) is a light-weight, portable, modular and extensible NoSQL infrastructure and repository for collective research and development through collaborative knowledge discovery, systematization, sharing and reuse. It is currently used to understand complex behavior of computer systems through collaborative decomposition of these systems into simple and semantically connected modules with defined interfaces and associated data. cMind allows to preserve the whole experimental setup with any associated artifact and with extensible meta-data (codelet, benchmark, datasets, tool, model, etc) helping to distribute or reproduce experiments by the community. Having enough knowledge about existing computer systems should allow scientists and engineers to build more power efficient computer systems in terms of performance, power consumption, code size, compilation time and other characteristics. It also helps the community to adopt the new research methodology and [http://cTuning.org/lab/education publication model] where experimental results and all associated artifacts are continuously shared, validated and extended by the community to help improve quality and reproducibility of computer engineering often seen as "hacking" nowadays
+Collective Mind (cM or cMind) is a light-weight, portable, modular and extensible NoSQL infrastructure and repository for collective research and development through collaborative knowledge discovery, systematization, sharing and reuse. It is currently used to understand complex behavior of computer systems through collaborative decomposition of these systems into simple and semantically connected modules with defined interfaces and associated data. cMind allows to preserve the whole experimental setup with any associated artifact and with extensible meta-data (codelet, benchmark, datasets, tool, model, etc) helping to distribute or reproduce experiments by the community. Having enough knowledge about existing computer systems should allow scientists and engineers to build more power efficient computer systems in terms of performance, power consumption, code size, compilation time and other characteristics. It also helps the community to adopt the new research methodology and [http://cTuning.org/lab/education publication model] where experimental results and all associated artifacts are continuously shared, validated and extended by the community to help improve quality and reproducibility of computer engineering often seen as "hacking".
 Modules serve as wrappers around all objects in the system (such as compilers, profilers, run-time systems, architectures, programs, predictive models, etc) to describe and record information flow in the system. Modules can either transparently pass information or perform various actions such as recording, retrieving, analyzing, searching and visualizing this information. Modules store information in associated data entries and provide API to access this data.

@@ Line 138: / Line 138: @@
 *1993-1997 - prototype of the experimental repository and analysis software to keep experiments for the development and modeling of semiconductor neural networks
-== Some references ==
+== Some references<br/> ==
 *Grigori Fursin. [http://arxiv.org/abs/1308.2410 "Collective Mind: cleaning up the research and experimentation mess in computer engineering using crowdsourcing, big data and machine learning"], ArXiv open access technical report, August 2013
@@ Line 144: / Line 144: @@
 *Grigori Fursin et al. [http://dx.doi.org/10.1145/1880043.1880047 "Collective Optimization: A Practical Collaborative Approach."] ACM Transactions on Architecture and Code Optimization (TACO), December 2010, Volume 7, Number 4, pages 20-49
 *Grigori Fursin et al. [http://hal.inria.fr/docs/00/29/47/04/PDF/fmtp2008.pdf "MILEPOST GCC: machine learning enabled self-tuning compiler."] International Journal of Parallel Programming (IJPP), June 2011, Volume 39, Issue 3, pages 296-327
 == All documentation ==

@@ Line 101: / Line 101: @@
 Users can access all cMind functionality from CMD using ''cm'' or ''cmx'' front-end (accessing repository, executing experimental pipelines, reproducing experiments, compose new experiments, etc). However, cMind also features built-in full featured python-based web server to allow users access most of cMind functionality through user-friendly cMind web front-end or expose data to the world through unified cMind web services - user can start web server using ''cm_web_start.sh'' in a separate terminal (new terminals will be opened through this root terminal in some usage scenarios) and access cMind front-end at ''[http://localhost:3333 http://localhost:3333]''
-*[[Tools:CM:Demos|Several prepared demos using live c-mind.org repository.]]
+*[[Tools:CM:Demos|Several prepared demos (either using web interface and live c-mind.org repository or using CMD).]]
 *[[Tools:CM:User Guide|cMind user guide (includes various usage scenarios).]]
 *Self-explanatory usage cases in cMind web front-end are available locally (see cMind top web menu 'Usage').

@@ Line 35: / Line 35: @@
 **can be deployed as extensible and customizable public or private (in-house company) online repository
 **can be easily deployed in cloud/grid environments to automate experiments
-**supports packages and unified installation with dependencies for full reproducibility of environment
+**supports packages and unified installation with dependencies for full reproducibility of environment and for co-existence of multiple versions of tools (such as compilers)
 **supports OpenME interface to open up LLVM, GCC, Open64 and other compilers for interactive and on-the-fly fine-grain analysis and tuning
 **data (experiments, models, etc) can be gradually classified and ranked