New Google Brain Optimizer Reduces BERT Pre-Training Time From Days to Minutes

کاهش مدت زمان pre-training مدل زبانی BERT از سه روز به 76 دقیقه با ارائه یک تابع بهینه ساز جدید!

Google Brain researchers have proposed LAMB (Layer-wise Adaptive Moments optimizer for Batch training), a new optimizer which reduces training time for its NLP training model BERT (Bidirectional Encoder Representations from Transformers) from three days to just 76 minutes.

لینک مقاله: https://arxiv.org/abs/1904.00962
لینک بلاگ پست: https://medium.com/syncedreview/new-google-brain-optimizer-reduces-bert-pre-training-time-from-days-to-minutes-b454e54eda1d

#BERT #language_model #optimizer

StarAi: FREE Deep Reinforcement Learning Course
---



@Machine_learn



----
https://www.starai.io/course/

Alternatives to Kaggle/other sites for machine learning & competitions.
Kaggle is the best, but there are a few alternatives:
https://challenger.ai
https://www.crowdai.org
https://www.drivendata.org
https://www.kdd.org
https://codalab.org/
https://www.crowdanalytix.co
https://www.datasciencechallenge.org
https://www.analyticsvidhya.com
https://www.topcoder.com
https://www.kesci.com
https://www.datafountain.cn
https://grand-challenge.org
https://signate.jp
https://www.dcjingsai.com
https://www.innocentive.com
#engineeringML

A great VIM tutorial:
https://www.systutorials.com/240159/vim-tutorial-beginners-vimtutor/

The Thousand Brains Theory: A Framework for Understanding the Neocortex and Building Intelligent Machines
https://www.youtube.com/watch?v=5LFo36g4Lug
#neuroscience #AI #numenta

طبقه بندی متن با استفاده از Flair

Flair delivers state-of-the-art performance in solving NLP problems such as named entity recognition (NER), part-of-speech tagging (PoS), sense disambiguation and text classification. It’s an NLP framework built on top of PyTorch.

لینک پست: https://towardsdatascience.com/text-classification-with-state-of-the-art-nlp-library-flair-b541d7add21f
کد: https://github.com/zalandoresearch/flair

#text_classification #nlp #flair

❇️ New fast.ai course about NLP
💠 https://www.fast.ai/2019/07/08/fastai-nlp

https://www.youtube.com/watch?v=Tyz1jRfyWgY
#ReinforcementLearning #Control #Robotics

🔻چهارمین دورهمی مدرسه جهانی هوش مصنوعی در رشت
🔺School of AI

📘موضوع این جلسه: مسائل و الگوریتم های بهینه سازی
🗓دوشنبه 31 تیر 1398
🕐ساعت 9:30 الی 11:30
🏢 دانشکده ی علوم پایه، سالن امتحانات

*جهت ثبت نام به لینک زیر مراجعه کنید:
▪️https://evnd.co/4bvfP

برای کسب اطلاعات بیشتر درباره ی این مدرسه، به کانال زیر مراجعه کنید:
🏢 @schoolofairasht

✅ @Brainandcognition_GU

Introduction to computational thinking and Data Science by MIT
https://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-0002-introduction-to-computational-thinking-and-data-science-fall-2016/lecture-videos/

https://www.youtube.com/watch?v=cQ48rP_Rs4g&t=1362s
A great talk about AI-related companies; Silicon Valley and China approach to solving real-world problems and developing apps; and a lot of other exciting topics which are related to technology and AI.

A curated list of automated machine learning papers, articles, tutorials, slides and projects
https://github.com/hibayesian/awesome-automl-papers

Curating a list of AutoML-related research, tools, projects and other resources
https://github.com/windmaple/awesome-AutoML

Understanding Capsule Networks:

Part I:
https://pechyonkin.me/capsules-1/

Part II:
https://pechyonkin.me/capsules-2/

Part III:
https://pechyonkin.me/capsules-3/

Part IV:
https://pechyonkin.me/capsules-4/

☝️با توجه به اینکه گیت هاب داره حساب‌های ایرانی‌ها را بدون اخطار قبلی می‌بنده، توصیه می‌کنیم ریپازیتوری‌هاتون را دانلود کنید.
👈ریپو زیر هم لطفا استار کنید و دست به دست کنید. اگر هفتاد تا استار توی یه روز بخوره ترند می‌شه و دیده می‌شه و صدامون به یه جایی می‌رسه.

🔹https://github.com/1995parham/github-do-not-ban-us

#Github
🔹ارسالی از کاربر
〰️〰️〰️〰️〰️〰️
@programming_tips