Flows for simultaneous manifold learning and density estimation

A new class of generative models that simultaneously learn the data manifold as well as a tractable probability density on that manifold.

Code: https://github.com/johannbrehmer/manifold-flow

Paper: https://arxiv.org/abs/2003.13913

Introduction to Quantization on PyTorch

Quantization refers to techniques for doing both computations and memory accesses with lower precision data, usually int8 compared to floating point implementations.

https://pytorch.org/blog/introduction-to-quantization-on-pytorch/

PYTORCH TUTORIALS: https://pytorch.org/tutorials/#model-optimization

Sum Product Flow: An Easy and Extensible Library for Sum-Product Networks

Simple interface to inference, learning and manipulation routines for deep and tractable probabilistic models called Sum-Product Networks (SPNs).

Github: https://github.com/SPFlow/SPFlow

Paper: https://arxiv.org/abs/2004.01167v1

⚪️ Tracking Objects as Points


Simultaneous object detection and tracking using center points

Github: https://github.com/xingyizhou/CenterTrack

Paper: https://arxiv.org/abs/2004.01177v1

kNN classification using Neighbourhood Components Analysis

NCA allows you to learn a linear transformation of your data that maximizes k-nearest neighbours performance.

https://kevinzakka.github.io/2020/02/10/nca/

PyTorch Code : https://github.com/kevinzakka/nca

Paper: https://www.cs.toronto.edu/~hinton/absps/nca.pdf

GANSpace: Discovering Interpretable GAN Controls

Simple technique to analyze Generative Adversarial Networks (GANs) and create interpretable controls for image synthesis, such as change of viewpoint, aging, lighting, and time of day.

Code: https://github.com/harskish/ganspace

Paper: https://arxiv.org/abs/2004.02546v1

Video: https://www.youtube.com/watch?v=jdTICDa_eAI&feature=youtu.be

Advancing Self-Supervised and Semi-Supervised Learning with SimCLR

https://ai.googleblog.com/2020/04/advancing-self-supervised-and-semi.html

Code and Pretrained-Models: https://github.com/google-research/simclr

Papaer: https://arxiv.org/abs/2002.05709

ML Code Completeness Checklist

https://medium.com/paperswithcode/ml-code-completeness-checklist-e9127b168501

Tips for Publishing Research Code: https://github.com/paperswithcode/releasing-research-code

Facebook blog: https://ai.facebook.com/blog/new-code-completeness-checklist-and-reproducibility-updates/

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization

Method achieves state-of-the-art performance on a public benchmark and outperforms the prior work for clothed human digitization from a single image.

https://shunsukesaito.github.io/PIFu/

Code: https://github.com/shunsukesaito/PIFu

Paper: https://arxiv.org/abs/1905.05172

TuiGAN: Learning Versatile Image-to-Image Translation with Two Unpaired Images


TuiGAN can be use for various computer vision tasks ranging from image style transfer to object transformation and appearance transformation.

Github: https://github.com/linjx-ustc1106/TuiGAN-PyTorch

Paper: https://arxiv.org/abs/2004.04634

Huawei announced that its TensorFlow and PyTorch-style MindSpore Deep Learning middleware is now open source

https://towardsdatascience.com/huaweis-mindspore-a-new-competitor-for-tensorflow-and-pytorch-d319deff2aec

Github: https://github.com/mindspore-ai/mindspore

Docs: https://www.mindspore.cn/docs/en/0.1.0-alpha/architecture.html

Official tutorials: https://www.mindspore.cn/en

Nevergrad, an evolutionary optimization platform, adds new key features

Facebook AI’s open source Python3 library for derivative-free and evolutionary optimization.

https://ai.facebook.com/blog/nevergrad-an-evolutionary-optimization-platform-adds-new-key-features/

GitHub: https://github.com/facebookresearch/nevergrad

Documentation: https://facebookresearch.github.io/nevergrad/index.html

EfficientDet from Google: Towards Scalable and Efficient Object Detection

A new family of scalable and efficient object detectors. EfficientDet achieves state-of-the-art accuracy while being up to 9x smaller and using significantly less computation compared to prior state-of-the-art detectors

https://ai.googleblog.com/2020/04/efficientdet-towards-scalable-and.html

Github: https://github.com/google/automl/tree/master/efficientdet

Paper: https://arxiv.org/abs/1911.09070

Tutorial: https://github.com/google/automl/blob/master/efficientdet/tutorial.ipynb

Local-Global Video-Text Interactions for Temporal Grounding

This paper addresses the problem of text-to-video temporal grounding, which aims to identify the time interval in a video semantically relevant to a text query

Github: https://github.com/JonghwanMun/LGI4temporalgrounding

Paper: https://arxiv.org/abs/2004.07514

Announcing PyCaret 1.0.0

An open source low-code machine learning library in Python. PyCaret allows you to go from preparing data to deploying models within seconds from your choice of notebook environment.

https://towardsdatascience.com/announcing-pycaret-an-open-source-low-code-machine-learning-library-in-python-4a1f1aad8d46

Habr RU : https://habr.com/ru/company/otus/blog/497770/

Github: https://github.com/pycaret/pycaret

Guide: https://pycaret.org/guide/

Neural Networks from Scratch - Coding a Layer

A beginner’s guide to understanding the inner workings of Deep Learning

https://morioh.com/p/fb1b9f5a52bc

Video Part 1: https://www.youtube.com/watch?v=Wo5dMEP_BbI

Video Part 2: https://www.youtube.com/watch?v=lGLto9Xd7bU

Transform and Tell: Entity-Aware News Image Captioning

End-to-end model which generates captions for images embedded in news articles.

Github: https://github.com/alasdairtran/transform-and-tell

Demo: https://transform-and-tell.ml/

Paper: https://arxiv.org/abs/2004.08070

Today, on April 22 is Earth day. It’s a right time to look at the climate issues in terms of data storage.
* 90% of all data was created in the last two years
* IoT, Big Data and AI are huge data creators
* 70% of all data stored is copy data2
* 70-80% of data is typically unstructured * 2018 HDD shipments = 869Eb
* 2023 HDD shipments = 2.6Zb
* In a normal DC, 1 watt of HDD consumption = 1 watt of cooling

What can everyone do for the ecology of our planet?

* Migrate suitable workloads to the cloud
* Collect, process and store less data; archive more to reduce carbon storage
* Use backup/archive instead of big data
* Leverage copy management tools
* If you must keep data for longer, use tape or cloud tape

Software solutions for backup, managing and recovering data help to move your data to the cloud and so you can take care of the environment. Commvault - leading experts in software-defined storage. Over 11 Exabytes of customer data are under Commvault management.

ResNeSt: Split-Attention Networks

Split-Attention Network, A New ResNet Variant. It significantly boosts the performance of downstream models such as Mask R-CNN, Cascade R-CNN and DeepLabV3.

Github: https://github.com/zhanghang1989/ResNeSt#pretrained-models

Paper: https://arxiv.org/abs/2004.08955v1