Abstract

Deep learning has been revolutionizing many aspects of our society, powering various fields including computer vision, natural language processing, and activity recognition. However, the scaling trends for both datasets and model size are constraining system performance. Variability of memory requirements can lead to poor resource utilization. Reconfigurable photonic interconnects provide scalable solutions and enable efficient use of disaggregated memory resources. We propose a photonic switched optically connected memory system architecture that tackles the memory challenges while showing the functionality of optical switching for deep learning models. Our proposed system architecture utilizes a “lite” (de)serialization scheme for memory transfers via optical links to avoid network overheads and supports the dynamic allocation of remote memories to local processing systems. In order to test the feasibility of our proposal, we built an experimental testbed with a processing system and two remote memory nodes using silicon photonic switch fabrics and evaluated the system performance. The optical switching time is measured to be 119 μs and an overall 2.78 ms latency is achieved for the end-to-end reconfiguration. The collective results and existing high-bandwidth optical I/Os show the potential of integrating the photonic switched optically connected memory to state-of-the-art processing systems.

Optically Disaggregated Data Centers With Minimal Remote Memory Latency: Technologies, Architectures, and Resource Allocation [Invited]

Georgios Zervas, Hui Yuan, Arsalan Saljoghei, Qianqiao Chen, and Vaibhawa Mishra
J. Opt. Commun. Netw. 10(2) A270-A285 (2018)

Fast and scalable all-optical network architecture for distributed deep learning

Wenzhe Li, Guojun Yuan, Zhan Wang, Guangming Tan, Peiheng Zhang, and George N. Rouskas
J. Opt. Commun. Netw. 16(3) 342-357 (2024)

MONet: heterogeneous Memory over Optical Network for large-scale data center resource disaggregation

Vaibhawa Mishra, Joshua L. Benjamin, and Georgios Zervas
J. Opt. Commun. Netw. 13(5) 126-139 (2021)

Network-aware compute and memory allocation in optically composable data centers with deep reinforcement learning and graph neural networks

Zacharaya Shabka and Georgios Zervas
J. Opt. Commun. Netw. 15(2) 133-143 (2023)

At the intersection of optics and deep learning: statistical inference, computing, and inverse design

Deniz Mengu, Md Sadman Sakib Rahman, Yi Luo, Jingxi Li, Onur Kulce, and Aydogan Ozcan
Adv. Opt. Photon. 14(2) 209-290 (2022)