Some interesting game projects to look at from the past year-
- Montezuma’s Revenge
- StarCraft II
- Quake III Arena Capture the Flag
- Dota 2
- Obstacle Tower
There has been lots of progress in decreasing the compute time required for training AI models. One of the most comprehensive resources for the benchmarks for end-to-end learning in machine learning is Stanford DAWN Benchmark and Bayesian Deep Learning Benchmarks and GLUE Benchmark.
MIRI and OpenAI have been talking about security and alignment problems for a very long time but I think among the top problems there are two key contenders-
- OpenAI’s GPT-2- They recently released an Update: We’re implementing two mechanisms to responsibly publish GPT-2 and hopefully future releases: staged release and partnership-based sharing. We’re now releasing a larger 345M version of GPT-2 as a next step in staged release, and are sharing the 762M and 1.5B versions with partners in the AI and security communities who are working to improve societal preparedness for large language models.
- DeepFakes- CNN did a recent post to explain the danger of DeepFakes. The recent concerns on the topic have been of FakeNudes and its impact on the upcoming elections, esp in terms of FakeNews and FakeVideos.
The key trends in Deep Learning this year-
- Inverse Reinforcement Learning
- Curiosity Driven Exploration
- Quality Diversity Algorithms (For eg. POET)
- NLP breakthroughs: Some top mentions would be Google’s BERT, Transformer, CLEVR, Allen Institute’s ELMo, OpenAI’s Transformer, Fast.ai’s ULMFit, Microsoft’s MT-DNN (Honorary Mentions: Cyc)
Top Tools & Libraries-
- Facebook Horizon
- NeurIPS Competitions
- Ask a Counterfactual Oracle Competition