ICCV 2021 Workshop on

Neural Architectures: Past, Present and Future

Montreal, Canada
Full day, October 11th, 2021


The surge of deep learning has largely benefited from the success of neural architecture design. By evolving from LeNet to AlexNet to VGG and to ResNet, neural architecture keeps incorporating novel designs of architectural elements and network topologies, leading to significant improvements in representation learning. Recently, the emergence of neural architecture search (NAS) further advances the representational capacity of neural networks, by changing the architecture design from the hand-crafted manner to automation. Despite remarkable achievements being made on various benchmark tasks, the development of neural architectures still faces several challenges. On the one hand, current neural architecture designs are not fully automatic yet. For instance, even with NAS, we still require tremendous knowledge from human experts on designing the architecture search space, defining search strategies and selecting training hyperparameters. On the other hand, existing neural architectures are severely exposed to the problems of lacking interpretability, vulnerability to adversarial examples, incapability of abstract reasoning, etc.

In this workshop, we will focus on recent research and future directions on advancing the deep learning system, particularly from the perspective of neural architectures. We aim to bring experts from artificial intelligence, machine learning, deep learning, statistics, computer vision, and cognitive science communities together not only on discussing the current challenges of neural architecture designs, but also on charting out the blueprint of neural architectures for further bridging the gap between the human brain and neural networks.

Call For Papers

Submission Deadline:August 1, 2021 Anywhere on Earth (AoE)

Notification sent to authors: August 7, 2021 Anywhere on Earth (AoE)

Camera ready deadline: August 10, 2021 Anywhere on Earth (AoE)

Submission Server: https://cmt3.research.microsoft.com/NeurArch2021

Submission Format: Submissions need to be anonymized and follow the ICCV 2021 Author Instructions. Please use the ICCV 2021 template for the paper preparation.
The workshop considers two types of submissions:

Based on the PC recommendations, the accepted long papers/extended abstracts will be allocated either a contributed talk or a poster presentation.

Scope: We invite submissions on any aspect of neural architectures. This includes, but is not limited to:

Double Blind Review: ICCV reviewing is double blind, in that authors do not know the names of the area chair/reviewers of their papers, and the area chairs/reviewers cannot, beyond reasonable doubt, infer the names of the authors from the submission and the additional material. Avoid providing information that may identify the authors in the acknowledgments (e.g., co-workers and grant IDs) and in the supplemental material (e.g., titles in the movies, or attached papers). Avoid providing links to websites that identify the authors. Violation of any of these guidelines may lead to rejection without review. If you need to cite a different paper of yours that is being submitted concurrently to ICCV, the authors should (1) cite these papers; (2) argue in the body of your paper why your ICCV paper is non trivially different from these concurrent submissions; and (3) include anonymized versions of those papers in the supplemental material.


Organizing Committee

Please contact us if you have questions.