xie-lab-ml/deep-learning-dynamics-paper-list

This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.

41
/ 100
Emerging

This is a curated list of research papers focused on how deep learning models learn and optimize, particularly the 'dynamics' of their training process. It takes in recent, peer-reviewed academic papers related to deep learning optimization and outputs categorized lists with direct links to PDFs. This resource is for machine learning researchers, theoretical computer scientists, and academics interested in the fundamental mathematical underpinnings of deep neural networks.

294 stars. No commits in the last 6 months.

Use this if you are a researcher studying the theoretical aspects of deep learning optimization and need a focused collection of relevant literature.

Not ideal if you are a practitioner looking for practical implementation guides or tutorials on building deep learning models.

deep-learning-theory neural-network-optimization machine-learning-research stochastic-gradient-descent optimization-dynamics
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 15 / 25

How are scores calculated?

Stars

294

Forks

29

Language

License

MIT

Last pushed

Apr 10, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/xie-lab-ml/deep-learning-dynamics-paper-list"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.