Forwarded from Tensorflow(@CVision) (Vahid Reza Khazaie)
New Google Brain Optimizer Reduces BERT Pre-Training Time From Days to Minutes
کاهش مدت زمان pre-training مدل زبانی BERT از سه روز به 76 دقیقه با ارائه یک تابع بهینه ساز جدید!
Google Brain researchers have proposed LAMB (Layer-wise Adaptive Moments optimizer for Batch training), a new optimizer which reduces training time for its NLP training model BERT (Bidirectional Encoder Representations from Transformers) from three days to just 76 minutes.
لینک مقاله: https://arxiv.org/abs/1904.00962
لینک بلاگ پست: https://medium.com/syncedreview/new-google-brain-optimizer-reduces-bert-pre-training-time-from-days-to-minutes-b454e54eda1d
#BERT #language_model #optimizer
کاهش مدت زمان pre-training مدل زبانی BERT از سه روز به 76 دقیقه با ارائه یک تابع بهینه ساز جدید!
Google Brain researchers have proposed LAMB (Layer-wise Adaptive Moments optimizer for Batch training), a new optimizer which reduces training time for its NLP training model BERT (Bidirectional Encoder Representations from Transformers) from three days to just 76 minutes.
لینک مقاله: https://arxiv.org/abs/1904.00962
لینک بلاگ پست: https://medium.com/syncedreview/new-google-brain-optimizer-reduces-bert-pre-training-time-from-days-to-minutes-b454e54eda1d
#BERT #language_model #optimizer
arXiv.org
Large Batch Optimization for Deep Learning: Training BERT in 76 minutes
Training large deep neural networks on massive datasets is computationally very challenging. There has been recent surge in interest in using large batch stochastic optimization methods to tackle...
Forwarded from Hidden layer
Alternatives to Kaggle/other sites for machine learning & competitions.
Kaggle is the best, but there are a few alternatives:
https://challenger.ai
https://www.crowdai.org
https://www.drivendata.org
https://www.kdd.org
https://codalab.org/
https://www.crowdanalytix.co
https://www.datasciencechallenge.org
https://www.analyticsvidhya.com
https://www.topcoder.com
https://www.kesci.com
https://www.datafountain.cn
https://grand-challenge.org
https://signate.jp
https://www.dcjingsai.com
https://www.innocentive.com
#engineeringML
Kaggle is the best, but there are a few alternatives:
https://challenger.ai
https://www.crowdai.org
https://www.drivendata.org
https://www.kdd.org
https://codalab.org/
https://www.crowdanalytix.co
https://www.datasciencechallenge.org
https://www.analyticsvidhya.com
https://www.topcoder.com
https://www.kesci.com
https://www.datafountain.cn
https://grand-challenge.org
https://signate.jp
https://www.dcjingsai.com
https://www.innocentive.com
#engineeringML
The Thousand Brains Theory: A Framework for Understanding the Neocortex and Building Intelligent Machines
https://www.youtube.com/watch?v=5LFo36g4Lug
#neuroscience #AI #numenta
https://www.youtube.com/watch?v=5LFo36g4Lug
#neuroscience #AI #numenta
YouTube
The Thousand Brains Theory
The Thousand Brains Theory: A Framework for Understanding the Neocortex and Building Intelligent Machines
Recent advances in reverse engineering the neocortex reveal that it is a highly-distributed sensory-motor modeling system. Each cortical column learns…
Recent advances in reverse engineering the neocortex reveal that it is a highly-distributed sensory-motor modeling system. Each cortical column learns…
Forwarded from Tensorflow(@CVision) (Vahid Reza Khazaie)
طبقه بندی متن با استفاده از Flair
Flair delivers state-of-the-art performance in solving NLP problems such as named entity recognition (NER), part-of-speech tagging (PoS), sense disambiguation and text classification. It’s an NLP framework built on top of PyTorch.
لینک پست: https://towardsdatascience.com/text-classification-with-state-of-the-art-nlp-library-flair-b541d7add21f
کد: https://github.com/zalandoresearch/flair
#text_classification #nlp #flair
Flair delivers state-of-the-art performance in solving NLP problems such as named entity recognition (NER), part-of-speech tagging (PoS), sense disambiguation and text classification. It’s an NLP framework built on top of PyTorch.
لینک پست: https://towardsdatascience.com/text-classification-with-state-of-the-art-nlp-library-flair-b541d7add21f
کد: https://github.com/zalandoresearch/flair
#text_classification #nlp #flair
Medium
Text Classification with State of the Art NLP Library — Flair
Exciting news! A new version of Flair - state-of-the-art NLP library has just been released. Learn how to use it for text classification
Forwarded from AI in Science & Technology
Forwarded from Deleted Account
🔻چهارمین دورهمی مدرسه جهانی هوش مصنوعی در رشت
🔺School of AI
📘موضوع این جلسه: مسائل و الگوریتم های بهینه سازی
🗓دوشنبه 31 تیر 1398
🕐ساعت 9:30 الی 11:30
🏢 دانشکده ی علوم پایه، سالن امتحانات
*جهت ثبت نام به لینک زیر مراجعه کنید:
▪️https://evnd.co/4bvfP
برای کسب اطلاعات بیشتر درباره ی این مدرسه، به کانال زیر مراجعه کنید:
🏢 @schoolofairasht
✅ @Brainandcognition_GU
🔺School of AI
📘موضوع این جلسه: مسائل و الگوریتم های بهینه سازی
🗓دوشنبه 31 تیر 1398
🕐ساعت 9:30 الی 11:30
🏢 دانشکده ی علوم پایه، سالن امتحانات
*جهت ثبت نام به لینک زیر مراجعه کنید:
▪️https://evnd.co/4bvfP
برای کسب اطلاعات بیشتر درباره ی این مدرسه، به کانال زیر مراجعه کنید:
🏢 @schoolofairasht
✅ @Brainandcognition_GU
Introduction to computational thinking and Data Science by MIT
https://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-0002-introduction-to-computational-thinking-and-data-science-fall-2016/lecture-videos/
https://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-0002-introduction-to-computational-thinking-and-data-science-fall-2016/lecture-videos/
MIT OpenCourseWare
Lecture Videos | Introduction to Computational Thinking and Data Science | Electrical Engineering and Computer Science | MIT OpenCourseWare
MIT OpenCourseWare is a web based publication of virtually all MIT course content. OCW is open and available to the world and is a permanent MIT activity
https://www.youtube.com/watch?v=cQ48rP_Rs4g&t=1362s
A great talk about AI-related companies; Silicon Valley and China approach to solving real-world problems and developing apps; and a lot of other exciting topics which are related to technology and AI.
A great talk about AI-related companies; Silicon Valley and China approach to solving real-world problems and developing apps; and a lot of other exciting topics which are related to technology and AI.
YouTube
Kai-Fu Lee: AI Superpowers - China and Silicon Valley | Artificial Intelligence (AI) Podcast
Kai-Fu Lee is the Chairman and CEO of Sinovation Ventures that manages a 2 billion dollar dual currency investment fund with a focus on developing the next g...
A curated list of automated machine learning papers, articles, tutorials, slides and projects
https://github.com/hibayesian/awesome-automl-papers
https://github.com/hibayesian/awesome-automl-papers
GitHub
GitHub - hibayesian/awesome-automl-papers: A curated list of automated machine learning papers, articles, tutorials, slides and…
A curated list of automated machine learning papers, articles, tutorials, slides and projects - hibayesian/awesome-automl-papers
Curating a list of AutoML-related research, tools, projects and other resources
https://github.com/windmaple/awesome-AutoML
https://github.com/windmaple/awesome-AutoML
GitHub
GitHub - windmaple/awesome-AutoML: Curating a list of AutoML-related research, tools, projects and other resources
Curating a list of AutoML-related research, tools, projects and other resources - windmaple/awesome-AutoML
Forwarded from School of AI
Understanding Capsule Networks:
Part I:
https://pechyonkin.me/capsules-1/
Part II:
https://pechyonkin.me/capsules-2/
Part III:
https://pechyonkin.me/capsules-3/
Part IV:
https://pechyonkin.me/capsules-4/
Part I:
https://pechyonkin.me/capsules-1/
Part II:
https://pechyonkin.me/capsules-2/
Part III:
https://pechyonkin.me/capsules-3/
Part IV:
https://pechyonkin.me/capsules-4/
Forwarded from صرفا جهت اطلاع برنامهنویسان
☝️با توجه به اینکه گیت هاب داره حسابهای ایرانیها را بدون اخطار قبلی میبنده، توصیه میکنیم ریپازیتوریهاتون را دانلود کنید.
👈ریپو زیر هم لطفا استار کنید و دست به دست کنید. اگر هفتاد تا استار توی یه روز بخوره ترند میشه و دیده میشه و صدامون به یه جایی میرسه.
🔹https://github.com/1995parham/github-do-not-ban-us
#Github
🔹ارسالی از کاربر
〰️〰️〰️〰️〰️〰️
@programming_tips
👈ریپو زیر هم لطفا استار کنید و دست به دست کنید. اگر هفتاد تا استار توی یه روز بخوره ترند میشه و دیده میشه و صدامون به یه جایی میرسه.
🔹https://github.com/1995parham/github-do-not-ban-us
#Github
🔹ارسالی از کاربر
〰️〰️〰️〰️〰️〰️
@programming_tips