Tech Talk

Real-Time Analytics at Meta: Tracking PyTorch Continuous Integration for Developer-Facing Dashboards

March 29th, 2023 at 10am PT/1pm ET

PyTorch is an open-source ML library with thousands of contributors from companies such as Google, Microsoft and NVIDIA. The PyTorch Continuous Integration (CI) system, managed by Meta, runs tens of thousands of tests on multiple platforms and compilers to validate every change. 

More Details

See how Meta tracks CI stats to enable real-time analytics, such as developer-facing dashboards and metrics, to monitor the health of the CI system and the greenness of each change.

In this tech talk, we will discuss how Meta used Rockset as the data backend for analytics on the PyTorch CI system. Topics to be covered:

  • Scale, latency and operational requirements for analytics on CI stats
  • How the PyTorch CI system is architected
  • How the Meta team builds data APIs using Rockset
  • Demo of how queries are constructed to serve dashboards and metrics

About the Speakers
1517737404918

Zain Rizvi, Meta

Zain Rizvi is a Tech Lead at Meta working to improve the developer experience of PyTorch contributors. He’s passionate about making their work as easy as possible. Previously Zain spent over a decade building large scale infrastructure at Azure and GCP. You can find him on Twitter @zainrzv or at zainrizvi.io.

0

Kevin Leong, Rockset

Kevin Leong is Director of Product Marketing at Rockset, where he works closely with Rockset's product team and partners to help users realize the value of real-time analytics. He has been around data and analytics for the last decade, holding various product management roles at SAP, VMware, and MarkLogic.

Register for the Tech Talk