On Artificial Intelligence
@on_artificial_intelligence
108 subscribers
27 photos
36 files
466 links
If you want to know more about Science, specially Artificial Intelligence, this is the right place for you
Admin Contact:
@Oriea
Download Telegram
About
Blog
Apps
Platform
Join
On Artificial Intelligence
108 subscribers
On Artificial Intelligence
Forwarded from School of AI
zisserman-self-supervised.pdf
9.1 MB
A tutorial on Self-supervised Learning by Andrew Zisserman from Google Deep Mind.

Talks in ICML2019:
https://www.facebook.com/icml.imls/videos/2030095370631729/
6 views
On Artificial Intelligence
https://www.youtube.com/watch?v=38ZXwJj6j8k
YouTube
All Hail The Mighty Translatotron!
❤️ Pick up cool perks on our Patreon page: https://www.patreon.com/TwoMinutePapers

My talk and the full panel discussion at the NATO conference (I start at around the 12:30 minute mark):
▶️ https://www.facebook.com/StratComCOE/videos/698737203889068/

📝…
67 views
On Artificial Intelligence
https://www.youtube.com/watch?v=-9evrZnBorM
#NLP
YouTube
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
https://arxiv.org/abs/1810.04805

Abstract:
We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train…
64 viewsedited  
On Artificial Intelligence
An overview of old and new nlp pretrained models use-cases (Excluding XLNet):
https://www.youtube.com/watch?v=0EtD5ybnh_s
#NLP
YouTube
Language Learning with BERT - TensorFlow and Deep Learning Singapore
Speaker: Martin Andrews

Event Page: https://www.meetup.com/TensorFlow-and-Deep-Learning-Singapore/events/256431012/

Produced by Engineers.SG

Help us caption & translate this video!

https://amara.org/v/mToR/
205 viewsedited  
On Artificial Intelligence
Empirically, XLNet outperforms BERT on 20 tasks, often by a large margin, and achieves state-of-the-art results on 18 tasks including question answering, natural language inference, sentiment analysis, and document ranking.

https://arxiv.org/abs/1906.08237#
#NLP
arXiv.org
XLNet: Generalized Autoregressive Pretraining for Language Understanding
With the capability of modeling bidirectional contexts, denoising autoencoding based pretraining like BERT achieves better performance than pretraining approaches based on autoregressive language...
65 viewsedited  
On Artificial Intelligence
A great introduction to Multivariate Gaussian Distributations:
https://www.youtube.com/watch?v=eho8xH3E6mE
#statistics
YouTube
Multivariate Gaussian distributions
Properties of the multivariate Gaussian probability distribution
370 viewsedited  
On Artificial Intelligence
A great introduction to Multivariate Gaussian Distributations:
https://www.youtube.com/watch?v=JNlEIEwe-Cg
#statistics
YouTube
Gaussian Mixture Models - The Math of Intelligence (Week 7)
We're going to predict customer churn using a clustering technique called the Gaussian Mixture Model! This is a probability distribution that consists of multiple Gaussian distributions, very cool. I also have something important but unrelated to say in the…
70 viewsedited  
On Artificial Intelligence
https://www.youtube.com/watch?v=eqhUHyVpAwE
YouTube
The Impostor Syndrome
What holds us back from being more confident at work is often a sense that we are fundamentally different from those who succeed. We suffer – needlessly – from The Impostor Syndrome.

Enjoying our Youtube videos? Get full access to all our audio content…
64 views
On Artificial Intelligence
Forwarded from Machine learning books and papers (Ramin Mousa)
Adapters: A Compact and Extensible Transfer Learning Method for NLP
____



@Machine_learn



___
https://medium.com/dair-ai/adapters-a-compact-and-extensible-transfer-learning-method-for-nlp-6d18c2399f62
Medium
Adapters: A Compact and Extensible Transfer Learning Method for NLP
Adapters obtain comparable results to BERT on several NLP tasks while achieving parameter efficiency.
4 views
On Artificial Intelligence
Forwarded from School of AI
Neural Code Search: ML-based code search using natural language queries:

https://ai.facebook.com/blog/neural-code-search-ml-based-code-search-using-natural-language-queries/
Facebook
Neural Code Search: ML-based code search using natural language queries
We’ve developed an internal tool that applies natural language processing and information retrieval techniques directly to source code text, in order to produce an machine learning-based code search system.
4 views
On Artificial Intelligence
https://www.youtube.com/watch?v=ba1tND0B0xk
#Google #AI #News
YouTube
How Google's DeepMind is Using AI to Tackle Climate Change
AI is often seen as a magical fix-all. It's not, but it is, says Sims Witherspoon, a powerful tool for unlocking communities' problem-solving capacities. Witherspoon is a program manager at Google's DeepMind, which made headlines when it reduced energy required…
137 viewsedited  
On Artificial Intelligence
A great tutorial which shows you how you can implement algorithms above, in Python:
https://github.com/MorvanZhou/Evolutionary-Algorithm
90 viewsedited  
On Artificial Intelligence
Deep unsupervised Learning Course by Google:
https://sites.google.com/view/berkeley-cs294-158-sp19/home
Google
CS294-158-SP19 Deep Unsupervised Learning Spring 2019
About: This course will cover two areas of deep learning in which labeled data is not required: Deep Generative Models and Self-supervised Learning. Recent advances in generative models have made it possible to realistically model high-dimensional raw data…
109 views
On Artificial Intelligence
https://www.classcentral.com/report/coursera-monetization-revenues/
#MOOC #News
The Report by Class Central
Coursera’s Monetization Journey: From Zero to IPO — Class Central
Coursera used to be completely free. Now they make $400+ million a year. Here is how they did it.
93 viewsedited  
On Artificial Intelligence
Forwarded from Tensorflow(@CVision) (Vahid Reza Khazaie)
New Google Brain Optimizer Reduces BERT Pre-Training Time From Days to Minutes

کاهش مدت زمان pre-training مدل زبانی BERT از سه روز به 76 دقیقه با ارائه یک تابع بهینه ساز جدید!

Google Brain researchers have proposed LAMB (Layer-wise Adaptive Moments optimizer for Batch training), a new optimizer which reduces training time for its NLP training model BERT (Bidirectional Encoder Representations from Transformers) from three days to just 76 minutes.

لینک مقاله: https://arxiv.org/abs/1904.00962
لینک بلاگ پست: https://medium.com/syncedreview/new-google-brain-optimizer-reduces-bert-pre-training-time-from-days-to-minutes-b454e54eda1d

#BERT #language_model #optimizer
arXiv.org
Large Batch Optimization for Deep Learning: Training BERT in 76 minutes
Training large deep neural networks on massive datasets is computationally very challenging. There has been recent surge in interest in using large batch stochastic optimization methods to tackle...
5 views
On Artificial Intelligence
https://www.youtube.com/watch?v=GazFsfcijXQ&feature=youtu.be
YouTube
Learn Natural Language Processing
I've designed a free natural language processing curriculum for anyone interested in improving their skills in order to start a startup, get consulting work,...
897 views
On Artificial Intelligence
Forwarded from Machine learning books and papers (Ramin Mousa)
StarAi: FREE Deep Reinforcement Learning Course
---



@Machine_learn



----
https://www.starai.io/course/
StarAi Deep Reinforcement Learning Course
StarAi: Deep Reinforcement Learning Course | StarAi Deep Reinforcement Learning Course
5 views
On Artificial Intelligence
Forwarded from Hidden layer
Alternatives to Kaggle/other sites for machine learning & competitions.
Kaggle is the best, but there are a few alternatives:
https://challenger.ai
https://www.crowdai.org
https://www.drivendata.org
https://www.kdd.org
https://codalab.org/
https://www.crowdanalytix.co
https://www.datasciencechallenge.org
https://www.analyticsvidhya.com
https://www.topcoder.com
https://www.kesci.com
https://www.datafountain.cn
https://grand-challenge.org
https://signate.jp
https://www.dcjingsai.com
https://www.innocentive.com
#engineeringML
103 views
On Artificial Intelligence
A great VIM tutorial:
https://www.systutorials.com/240159/vim-tutorial-beginners-vimtutor/
SysTutorials
Vim Tutorial for Beginners: vimtutor - SysTutorials
Vim Tutorial for Beginners: vimtutor tagged Command, Command line, console, editor, Howto, Linux, Programming, Tutorial, vim.
121 views
On Artificial Intelligence
https://www.youtube.com/watch?v=S2GY3gh6qC8&feature=youtu.be
YouTube
Introducing arxiv-sanity
Arxiv is great, but there are many papers and we don't have good interfaces for interacting with this large body of work. Enter https://www.arxiv-sanity.com/ !
111 views