D-DARTS: Distributed Differentiable Architecture Search - Université d'Évry Access content directly
Journal Articles Pattern Recognition Letters Year : 2023

D-DARTS: Distributed Differentiable Architecture Search

Abstract

Differentiable ARchiTecture Search (DARTS) is one of the most trending Neural Architecture Search (NAS) methods. It drastically reduces search cost by resorting to weight-sharing. However, this approach also dramatically reduces the search space, thus excluding potential promising architectures. In this article, we propose D-DARTS, a solution that addresses this problem by nesting neural networks at the cell level instead of using weight-sharing to produce more diversified and specialized architectures. Moreover, we introduce a novel algorithm that can derive deeper architectures from a few trained cells, increasing performance and saving computation time. In addition, we introduce DARTOpti, an alternative search space in which we optimize existing handcrafted architectures instead of searching from scratch. Our solution reaches competitive performance on image classification tasks.
No file

Dates and versions

hal-04270973 , version 1 (05-11-2023)

Identifiers

Cite

Alexandre Heuillet, Hedi Tabia, Hichem Arioui, Kamal Youcef-Toumi. D-DARTS: Distributed Differentiable Architecture Search. Pattern Recognition Letters, 2023, 176, pp.42--48. ⟨10.1016/j.patrec.2023.10.019⟩. ⟨hal-04270973⟩
48 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More