AI Data Center Network Design and Technologies [Paperback]

    Foreword.. . . . . . . . . . . . . . . . xv

    Preface.. . . . . . . . . . . . . . . . . xvii

    Acknowledgments.. . . . . . . . . . . . . . xix

    About the Authors.. . . . . . . . . . . . . . xxi

1 Wonders in the Workload. . . . . . . . . . . . 1

    Whats New in AI Data Center Workloads.. . . . . . . . 1

    The Life Cycle of an AI Model.. . . . . . . . . . . 2

        Training an AI Model. . . . . . . . . . . . 3

    Parallelism. . . . . . . . . . . . . . 4

    Job Completion Time (JCT). . . . . . . . . . . 6

    Tail Latency.. . . . . . . . . . . . . . 7

    Summary. . . . . . . . . . . . . . 16

    Test Your Knowledge. . . . . . . . . . . . 17

2 The Common-Man View of AI Data Center Fabrics.. . . . . 19

    Training vs. Inference AI Data Centers. . . . . . . . . 19

    InfiniBand vs. Ethernet for AI Training Data Centers.. . . . . . 21

    Ethernet Hardware Switches and Advanced Software Features.. . . . 22

    Handling Elephant Flows.. . . . . . . . . . . 24

 &nblS