NYC Photo
Chaotic Cellular Neural/Nonlinear Networks for Solving Constraint Satisfaction

Marie Curie International Incoming Fellowship: FP7-PEOPLE-IIF-299915

Sponsored by the Research Executive Agency (REA)/European Commission

Scientist in charge: Prof. Zoltán Néda

Research Fellow: Dr. Mária Ercsey-Ravasz

E-mail: ercsey.ravasz@phys.ubbcluj.ro

Research topic:

Constraint satisfaction problems (such as Boolean satisfiability) constitute one of the hardest classes of optimization problems with many applications in technology and industry. In a recent paper the Fellow revealed a novel connection between these problems and chaotic dynamical systems. The paper provided an exact mapping of Boolean satisfiability (k-SAT) into a deterministic continuous-time dynamical system with a unique correspondence between its set of attractors and the k-SAT solutions. It was shown that optimization hardness is fundamentally equivalent to the phenomenon of chaos and turbulence: after a critical constraint density is reached, the trajectories become transiently chaotic before finding the solutions, signaling the appearance of optimization hardness. Numerical results have also shown that the presented dynamical system is very efficient in solving SAT problems. The system presented has the simplest possible form designed for fulfilling the mathematical requirements and is not yet suitable for direct implementation. However, the system is not necessarily unique. Using the same principles the goal of this project is to develop a deterministic continuous-time Cellular Neural/Nonlinear Network (CNN) model for solving constraint satisfaction. CNN models were already implemented in analog computers so this could result in a possible physical implementation of the model in the future, leading to numerous applications. The project will follow three major steps: 1) developing the CNN model and analyzing its mathematical properties. 2) Studying the efficiency of the CNN solver and properties of the transient chaotic behavior in hard problems. 3) Testing the robustness of the model to noise effects.

Foreground publications during the project:

- B. Molnár, R. Sumi, M. Ercsey-Ravasz, "A CNN SAT-solver robust to noise", CNNA2014 Proc. of the 14th IEEE Int. Conf. on Cellular Nanoscale Networks and their Applications, accepted, Notre Dame, IN, USA (2014)

- R. Sumi, B. Molnar, M. Ercsey-Ravasz, "Robust optimization with transiently chaotic dynamical systems", EPL, 2014, accepted.

- N.T. Markov, M. Ercsey-Ravasz, D.C. Van Essen, K. Knoblauch, Z. Toroczkai, H. Kennedy, "Cortical High-density Counter-stream Architectures", Science, 342, 1238406, 2013 doi:10.1126/science.1238406

- M. Ercsey-Ravasz, N.T. Markov, C. Lamy, D.C. Van Essen, K. Knoblauch, Z. Toroczkai, H. Kennedy, "A predictive network model of cerebral cortical connectivity based on a distance rule", Neuron, 80, 184, 2013 doi:10.1016/j.neuron.2013.07.036

- B. Molnár, M. Ercsey-Ravasz, "Asymmetric Continuous-Time Neural Networks without Local Traps for Solving Constraint Satisfaction Problems". PLoS ONE 8(9): e73400, 2013. doi:10.1371/journal.pone.0073400

- N.T. Markov, M. Ercsey-Ravasz, C. Lamy, A.R. Ribeiro Gomes, L. Magrou, P. Misery, P. Giroud, P. Barone, C. Dehay, Z. Toroczkai, K. Knoblauch, D.C. Van Essen, H. Kennedy. "The role of long-range connections on the specificity of the macaque interareal cortical network" PNAS 110, 5187 (2013), doi:10.1073/pnas.1218972110

- B. Molnár, Z. Toroczkai, M. Ercsey-Ravasz, "Continuous-time Neural Networks Without Local Traps for Solving Boolean Satisfiability", CNNA2012 Proc. of the 13th IEEE Int. Conf. on Cellular Nanoscale Networks and their Applications, p. 4012, Torino, Italy (2012) doi:10.1109/CNNA.2012.6331411

- M. Ercsey-Ravasz, Z. Toroczkai, "Dontesek fizikaja es rejtvenyek kaosza" ("Physics of decision making and chaos of puzzles") in A fizika, matematika es muveszet talalkozasa az oktatasban, kutatasban (Physics, mathematics and arts in education and research), Ed.: A. Juhasz, T. Tel, Publisher: Science Department of the Eotvos Lorand University, Hungary, 2013.

Background publications relevant to the project:

- M. Ercsey-Ravasz, Z. Toroczkai, "The Chaos Within Sudoku", Nature Scientific Reports 2, 755 (2012) doi:10.1038/srep00725

- M. Ercsey-Ravasz, Z. Toroczkai, "Optimization Hardness as Transient Chaos in an Analog Approach to Constraint Satisfaction", Nature Physics 7, 966 (2011) arxiv:1208.0526

- N. T. Markov, M. Ercsey-Ravasz, A.R. Ribiero Gomes, C. Lamy, J. Vezoli, L. Magrou, P. Misery, A. Falchier, R. Quilodran, J. Sallet, M.A. Gariel, R. Gamanut, C. Huissoud, S. Clavagnier, P. Giroud, D. Sappey-Marinier, P. Barone, C. Dehay, Z. Toroczkai, K. Knoblauch, D.C. Van Essen, H. Kennedy. "A weighted and directed interareal connectivity matrix for macaque cerebral cortex" Cerebral Cortex , advance access , Sep. 25 (2012)

- M. Ercsey-Ravasz, Z. Neda, T. Roska, "Stochastic optimization of spin-glasses on cellular neural/nonlinear network based processors", Physica A 388 , 1024 (2009) doi:10.1016/j.physa.2008.11.037

- M. Ercsey-Ravasz, Z. Neda, T. Roska, "Cellular Neural Networks for NP-Hard Optimization", EURASIP J. on Advances in Signal Processing , 646975 (2009) 10.1155/2009/646975

Full list of publications can be found here.

Conferences, Workshops, Invited seminars:

- M. Ercsey-Ravasz “Analog approaches to hard optimization: from Sudoku to CNNs”, Statistical Mechanics of Unsatisfiability and Glasses, Mariehamn, Finland, 23-26 May, 2012

- M. Ercsey-Ravasz "Döntések fizikája és rejtvények káosza" ("Physics of decisions and chaos of puzzles"), A fizika, matematika és művészet találkozása az oktatásban (Physics, mathematics and arts in high school) Tg. Mures, Romania, August 15, 2012

- M. Ercsey-Ravasz “Solving constraint satisfaction problems via transiently chaotic analog systems and CNN dynamics”, CNNA 2012, Torino, Italy (2012)

- B. Molnár, Z. Toroczkai. M. Ercsey-Ravasz, "Continuous-time Neural Networks Without Local Traps for Solving Boolean Satisfiability", CNNA 2012, Torino, Italy (2012)

- The fellow visited her collaborator Prof. Zoltan Toroczkai at the University of Notre Dame, IN, USA in Oct. 2012.

- M. Ercsey-Ravasz "Asymmetric neural networks for solving constraint satisfaction", invited seminar at the Information Technology Department of the Pazmany Peter Catholic University, Hungary,22 February, 2013

- M. Ercsey-Ravasz, "The highly connected brain", invited seminar, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, USA, 29 October 2013

- The fellow visited her collaborator Prof. Tamas Roska at the Information Technology Department of the Pazmany Peter Catholic University, Budapest, Hungary, Oct. 1-2, 2013.

- The fellow visited her collaborator Prof. Zoltan Toroczkai at the University of Notre Dame, IN, USA in Oct. 2013.

- A.R. Gamanut, R.B. Gamanut, A. Burkhalter, D. van Essen, M. Ercsey-Ravasz, Z. toroczkai, K. Knoblauch, H. Kennedy, "Correlations between brain size and network properties of the cortex", poster at the IPSEN conference Micro-, meso- and macro-connectomics of the brain, Paris, May 5, 2014.

- She participated at the IPSEN conference Micro-, meso- and macro-connectomics of the brain, Paris, May 5, 2014, where her neuroscientist collaborator Dr. Henry Kennedy gave a talk about their common work, this will also result in a book chapter with title "The Brain in Space", to appear at the end of 2014.

The fellow visited her collaborators Dr. Henry Kennedy and K. Knoblauch at the INSERM institute in Lyon, May 6-9, 2014.

Dissemination activities preformed by the fellow:

-the fellow gave a talk at a conference organized for highschool teachers in Transylvania: "Döntések fizikája és rejtvények káosza" ("Physics of decisions and chaos of puzzles"), A fizika, matematika és művészet találkozása az oktatásban (Physics, mathematics and arts in high school) Tg. Mures, Romania, August 15, 2012. She also wrote an article with the same title in the proceedings of this conference, which will reach highschool teachers from all over Trasylvania.

-She participated on the conference "Vandoregyetem" organized for college students, October 2012.

-She was invited to the Unitarian Highschool Janos Zsigmond, where she gave a talk with title "This Is All Physics", May 2013.

-She has given disseminating talks to the highschool students who participated on the Vermes Miklos Physics Competition, 2013.

-She gave a talk with title "Kaosz a Sudokuban" ("The Chaos within Sudoku"), for high-school students at the Transylvanian Scientific Conference for Students.

-She gave a talk at the opening ceremony of the 2013/2014 school year at the Faculty of Physics, Babes-Bolyai University.

-She prepared a high-school student for the National Physics Olympics, 2014

The heavily connected brain - Cortical high-density counterstream architectures

Background.The cerebral cortex is divisible into many individual areas, each exhibiting distinct connectivity profiles, architecture, and physiological characteristics. Interactions among cortical areas underlie higher sensory, motor, and cognitive functions. Graph theory provides an important framework for understanding network properties of the interareal weighted and directed connectivity matrix reported in recent studies.Density and topology of the cortical graph. Figure (Left) The 66% density of the cortical matrix (black triangle) is considerably greater than in previous reports (colored points) and is inconsistent with a small-world network. (Right) A bow-tie representation of the high-density cortical matrix. The high-efficiency cortical core has defined relations with the cortical periphery in the two fans. Advances. We derive an exponential distance rule that predicts many binary and weighted features of the cortical network, including efficiency of information transfer, the high specificity of long-distance compared to short-distance connections, wire length minimization, and the existence of a highly interconnected cortical core. We propose a bow-tie representation of the cortex, which combines these features with hierarchical processing. Outlook. The exponential distance rule has important implications for understanding scaling properties of the cortex and developing future large-scale dynamic models of the cortex.

- N.T. Markov, M. Ercsey-Ravasz, D.C. Van Essen, K. Knoblauch, Z. Toroczkai, H. Kennedy, "Cortical High-density Counter-stream Architectures", Science, 342, 1238406, 2013 doi:10.1126/science.1238406