2nd Workshop on High-dimensional Learning Dynamics (HiLD): The Emergence of Structure and Reasoning
Cengiz is one of the organizers for the 2nd ICML Workshop on High-dimensional Learning Dynamics (HiLD): The Emergence of Structure and Reasoning. Topics include but not limited to:
-
The emergence of interpretable behaviors (e.g., circuit mechanisms) and capabilities (e.g., compositionality and reasoning)
-
Work that adapts tools from stochastic differential equations, high-dimensional probability, random matrix theory, and other theoretical frameworks to understand learning dynamics and phase transitions
-
Scaling laws related to internal structures and functional differences
-
Competition and dependencies among structures and heuristics, e.g., simplicity bias or learning staircase functions
-
Relating optimizer design and loss landscape geometry to implicit regularization, inductive bias, and generalization